CN116701571A - Page display method and device, electronic equipment and storage medium - Google Patents

Page display method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116701571A
CN116701571A CN202310577198.9A CN202310577198A CN116701571A CN 116701571 A CN116701571 A CN 116701571A CN 202310577198 A CN202310577198 A CN 202310577198A CN 116701571 A CN116701571 A CN 116701571A
Authority
CN
China
Prior art keywords
page
target
intention
node
operation information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310577198.9A
Other languages
Chinese (zh)
Inventor
李明德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apollo Zhilian Beijing Technology Co Ltd
Original Assignee
Apollo Zhilian Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Apollo Zhilian Beijing Technology Co Ltd filed Critical Apollo Zhilian Beijing Technology Co Ltd
Priority to CN202310577198.9A priority Critical patent/CN116701571A/en
Publication of CN116701571A publication Critical patent/CN116701571A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3343—Query execution using phonetics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/338—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure provides a page display method, a page display device, electronic equipment and a storage medium, and relates to the field of artificial intelligence such as voice recognition, natural language processing and knowledge graph. The method may include: acquiring report information of a client, wherein the report information comprises: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained by performing voice recognition on a voice form query sent by the user; determining user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to the target application, and returning the operation information to the client, wherein the operation information is used for determining and inquiring the corresponding target page according to the operation information by the client and displaying the target page, and the target application is the application to which the current page belongs. By applying the scheme disclosed by the disclosure, generalization capability, accuracy of processing results and the like can be improved.

Description

Page display method and device, electronic equipment and storage medium
Technical Field
The disclosure relates to the technical field of artificial intelligence, in particular to a page display method, a device, electronic equipment and a storage medium in the fields of voice recognition, natural language processing, knowledge graph and the like.
Background
At present, the technology is widely applied in different scenes, namely, after a user speaks names of menus, functions and the like on the displayed current page in a voice mode, corresponding operation is automatically completed, that is, corresponding control can be realized through voice.
Disclosure of Invention
The disclosure provides a page display method, a page display device, electronic equipment and a storage medium.
A page presentation method, comprising:
obtaining report information of a client, wherein the report information comprises: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained after voice recognition of a voice form query sent by the user;
determining user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to a target application, and returning the operation information to the client for the client to determine and display a target page corresponding to the query according to the operation information, wherein the target application is an application to which the current page belongs.
A page presentation method, comprising:
acquiring a query in a voice form sent by a user, and sending a text obtained after voice recognition of the query and an end state to a cloud as reporting information, wherein the end state comprises a current page displayed to the user;
And acquiring operation information returned by the cloud, determining a target page corresponding to the query according to the operation information, and displaying the target page, wherein the operation information is determined by the cloud according to the user intention after determining the user intention according to the report information and according to the user intention and a page tree corresponding to a target application, and the target application is an application to which the current page belongs.
A page display device, comprising: an information acquisition module and an information processing module;
the information acquisition module is configured to acquire report information of a client, where the report information includes: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained after voice recognition of a voice form query sent by the user;
the information processing module is used for determining user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to a target application, returning the operation information to the client, and determining and displaying a target page corresponding to the query according to the operation information by the client, wherein the target application is an application to which the current page belongs.
A page display device, comprising: the information reporting module and the page display module;
the information reporting module is used for acquiring a query in a voice form sent by a user, and sending a text obtained after voice recognition of the query and an end state to a cloud as reporting information, wherein the end state comprises a current page displayed to the user;
the page display module is used for acquiring operation information returned by the cloud, determining a target page corresponding to the query according to the operation information and displaying the target page, wherein the operation information is determined by the cloud according to the user intention after determining the user intention according to the report information and according to the user intention and a page tree corresponding to a target application, and the target application is an application to which the current page belongs.
An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method as described above.
A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform a method as described above.
A computer program product comprising computer programs/instructions which when executed by a processor implement a method as described above.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
FIG. 1 is a flowchart of a first embodiment of a page display method according to the present disclosure;
FIG. 2 is a schematic diagram of a page tree according to the present disclosure;
FIG. 3 is a flowchart of a second embodiment of a page display method according to the present disclosure;
fig. 4 is a schematic structural diagram of a first embodiment 400 of a page display device according to the present disclosure;
fig. 5 is a schematic structural diagram of a second embodiment 500 of a page display device according to the present disclosure;
fig. 6 shows a schematic block diagram of an electronic device 600 that may be used to implement embodiments of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In addition, it should be understood that the term "and/or" herein is merely one association relationship describing the associated object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
Fig. 1 is a flowchart of a first embodiment of a page display method according to the present disclosure. As shown in fig. 1, the following detailed implementation is included.
In step 101, obtaining report information of a client, where the report information includes: the terminal state and the text, wherein the terminal state comprises a current page displayed to a user, and the text is obtained by performing voice recognition on a query in a voice form sent by the user.
In step 102, determining a user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to the target application, and returning the operation information to the client, wherein the operation information is used for determining and displaying a target page corresponding to the query by the client, and the target application is an application to which the current page belongs.
In the traditional manner, the following implementation manner can be said to be generally adopted: and scanning elements on the current page to obtain a scanned text, and when a user sends out a query, performing fuzzy matching on the query and the scanned text, and simulating a position corresponding to the clicking if the matching is successful. However, this method has certain disadvantages, such as strong dependence on scanned text, mechanical matching, and poor generalization capability.
By adopting the scheme of the embodiment of the method, a simple fuzzy matching mode is not adopted any more, but a more accurate intention matching mode is adopted, so that the operation information can be determined based on the intention of a user and the page tree corresponding to the target application, and further, the target page can be determined and displayed according to the operation information, thereby improving generalization capability, improving the accuracy of a processing result and the like.
In practical applications, for each application with a user interface (UI, userInterface) in the system, a corresponding page tree may be generated respectively, that is, all pages of each application may be scanned once by using an automatic scanning tool, so as to obtain a plurality of page trees, and these operations may be completed at a client or at other places, and the obtained page trees may be configured to a cloud, for example, in a super service configured to the cloud.
Taking the target application as an example, preferably, the corresponding page tree may include: the method comprises the steps of nodes, sub-nodes and edges, wherein each page in a target application corresponds to one node respectively, each operable element in any page serves as one sub-node in the corresponding node of the page respectively, each sub-node is connected with the corresponding node through the edge respectively, for any sub-node, the corresponding node is the corresponding node of the page which is jumped to after clicking the sub-node, each edge has the corresponding edge intention, and each node has the corresponding page intention respectively.
Operable elements, i.e., elements that can effect page jumps/changes by manipulating (e.g., clicking) the corresponding element.
Through the processing, the constructed page tree can be recorded with all pages included in the target application, all operable elements included in each page, and the information of the pages respectively jumped to after clicking the elements, and the like, so that a good foundation is laid for subsequent processing.
Fig. 2 is a schematic diagram of a page tree according to the present disclosure. As shown in fig. 2, the home page (i.e., page 1) of the target application may be used as the root node, and it is assumed that 2 (numbers are only for illustration and may be far greater than these) operational elements are included in the home page, corresponding to the child node 1 and the child node 2, respectively, and if the child node 1 is clicked to jump to the page 2, then the node 2 corresponding to the child node 1 may be connected by an edge, and if the child node 2 is clicked to jump to the page 3, then the child node 2 may be connected by an edge to the node 3 corresponding to the page 3, and so on.
In addition, as shown in fig. 2, for each edge and each node (i.e., page), a corresponding intent may also be configured, respectively, and for convenience of distinction, the edge intent and the page intent may be both natural language understanding (NLU, naturalLanguageUnderstanding) intents.
How to determine the edge intent and the page intent are not limited and may be according to actual needs. For example, it may be determined by means of template matching, or may be determined by means of manual setting, or the like.
In practical applications, the execution body of the method embodiment shown in fig. 1 may be a cloud. The cloud end can acquire the report information of the client, wherein the report information comprises an end state and a text, the end state comprises a current page displayed to a user, and the text is obtained by performing voice recognition on a query in a voice form sent by the user. Further, the cloud end can determine the user intention according to the acquired report information, and can determine the operation information according to the user intention and the page tree corresponding to the target application, and the operation information is returned to the client.
The user intention means what operation the user wants to do. By combining the current page and text in the reported information, the corresponding target application and the user intention can be determined, and how to determine the user intention is not limited, for example, the existing intention recognition mode can be adopted.
Further, the user intent may be matched with the edge intent and the page intent in the page tree corresponding to the target application.
Preferably, in response to determining that the user intention matches any one of the edge intents corresponding to the current page, an element in the current page corresponding to the query may be determined according to the matched edge intention, and an identifier (id) or coordinates of the determined element may be used as operation information, and the client may skip to display the target page after clicking the identifier or the element corresponding to the coordinates in a simulation manner, where the coordinates are coordinates in the current page.
Taking the page tree shown in fig. 2 as an example, assuming that the current page is the page corresponding to the node 2 and assuming that the user intention is matched with the thickened edge intention shown in the figure, then it can be determined that the element corresponding to the query is the element corresponding to the child node 1 in the node 2, and then the identifier or the coordinate of the element can be returned to the client as the operation information.
Through the processing, the problem of poor generalization capability in the traditional mode can be effectively solved, and the method can be suitable for various applications including third party applications and the like, namely has universal applicability.
In addition, preferably, in response to determining that the user intention is matched with any page intention in the page tree, a target page can be determined according to the matched page intention, a path from a root node of the page tree to the target page can be obtained as operation information, and after the client returns to the home page of the target application from the current page, the target page can be found and displayed in a step-by-step clicking mode according to the path.
In the conventional manner, what is seen is that only elements visible on the current page are supported, but in practical applications, a user may have a requirement to say that a query is issued for elements not visible on the current page, and hope to realize corresponding operations. In addition, in the conventional manner, only a single-step operation is usually supported, but a user may want to be able to directly display a target page that can be finally displayed by sending out a plurality of queries in the conventional manner after the user wants to send out a query once.
In fact, for any application, any one of the pages is reachable from its home page via a certain path, i.e. if any one of the pages is intended, there must be a path from the home page to the page.
Accordingly, in the scheme disclosed by the disclosure, after determining that the user intention is matched with any page intention in the page tree, a target page can be determined according to the matched page intention, namely, a page corresponding to the matched page intention is determined, wherein the page is the target page, and further, a path from a root node of the page tree to the target page can be obtained as operation information.
Taking the page tree shown in fig. 2 as an example, assuming the target page is page 4, a path from page 1 to page 4 may be obtained, which may include passing nodes, child nodes, edges, and the like.
Accordingly, the client can find the target page and display the target page in a step-by-step clicking mode according to the path after returning to the home page of the target application from the current page.
Through the processing, the target page can be determined based on the determined path by returning to the home page, clicking step by step from the home page and the like, so that the user can meet the requirements of the user on the elements invisible on the current page, namely, the user can display the corresponding target page by only memorizing the corresponding content and sending out the corresponding query for the elements or the pages invisible on the current page, and the user can realize continuous skip of a plurality of steps by only sending out the query once, thereby realizing one-language direct.
For example, assuming that the target application is a video playing application, the current page is a player page, the user sends out a query and hopes to see the history playing record, then the target page is the history playing record page, the target application can firstly return to the first page from the current page, and then the history playing record page can be found and displayed in a step-by-step clicking mode according to the acquired path.
The solution of the present disclosure is mainly described above from the cloud side, and the solution of the present disclosure is further described below from the client side.
Fig. 3 is a flowchart of a second embodiment of a page display method according to the present disclosure. As shown in fig. 3, the following detailed implementation is included.
In step 301, a query in a voice form sent by a user is obtained, and a text obtained after the query is subjected to voice recognition and an end state are sent to a cloud as reporting information, wherein the end state comprises a current page displayed to the user.
In step 302, operation information returned by the cloud is obtained, a target page corresponding to the query is determined according to the operation information, and is displayed, wherein the operation information is determined by the cloud according to the user intention after the cloud determines the user intention according to the report information, and according to the user intention and a page tree corresponding to the target application, the target application is an application to which the current page belongs.
By adopting the scheme of the embodiment of the method, a simple fuzzy matching mode is not adopted any more, but a more accurate intention matching mode is adopted, so that the operation information can be determined based on the intention of a user and the page tree corresponding to the target application, and further the target page can be determined and displayed according to the operation information, thereby improving generalization capability, improving the accuracy of a processing result and the like.
Preferably, the page tree corresponding to the target application may include: the method comprises the steps of nodes, sub-nodes and edges, wherein each page in a target application corresponds to one node respectively, each operable element in any page serves as one sub-node in the corresponding node of the page respectively, each sub-node is connected with the corresponding node through the edge respectively, for any sub-node, the corresponding node is the corresponding node of the page which is jumped to after clicking the sub-node, each edge has the corresponding edge intention, and each node has the corresponding page intention respectively.
Through the processing, the constructed page tree can be recorded with all pages included in the target application, all operable elements included in each page, and the information of the pages respectively jumped to after clicking the elements, and the like, so that a good foundation is laid for subsequent processing.
Preferably, the operation information may include: the method for determining the target page corresponding to the query according to the operation information includes the steps of: and jumping to display the target page by simulating clicking the element corresponding to the mark or the coordinate.
Through the processing, the problem of poor generalization capability in the traditional mode can be effectively solved, and the method can be suitable for various applications including third party applications and the like, namely has universal applicability.
Preferably, the operation information may further include: the method for determining the target page corresponding to the query according to the operation information includes: and returning to the home page of the target application from the current page, starting from the home page, finding out the target page in a step-by-step clicking mode according to the path, and displaying.
Through the processing, the target page can be determined based on the determined path by returning to the home page, clicking step by step from the home page and the like, so that the requirements of a user on elements invisible on the current page can be met, namely, for the elements or pages invisible on the current page, the corresponding target page can be displayed as long as the user remembers corresponding contents and sends out corresponding query, and the user can realize continuous skip of a plurality of steps and the like by sending out the query once, thereby realizing one-language direct.
Preferably, the home page may be returned from the current page step by step through a return (back) event, and in addition, in the process of returning to the home page, in response to determining that the currently returned page is the target page, the target page may be directly displayed.
That is, the home page can be returned step by step from the current page through the back event, in the returning process, once the page which is returned currently is determined to be the target page, the returning can be stopped, the target page is directly displayed, otherwise, after the home page is returned, the target page can be found and displayed in a step-by-step clicking mode according to the path from the home page.
Through the processing, the display speed of the target page can be improved, and resource consumption caused by step-by-step returning, step-by-step clicking and the like can be saved.
It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present disclosure is not limited by the order of actions described, as some steps may take place in other order or simultaneously in accordance with the present disclosure. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all of the preferred embodiments, and that the acts and modules referred to are not necessarily required by the present disclosure. In addition, portions of one embodiment that are not described in detail may be referred to in the description of other embodiments.
The foregoing is a description of embodiments of the method, and the following further describes embodiments of the present disclosure through examples of apparatus.
Fig. 4 is a schematic structural diagram of a first embodiment 400 of a page display device according to the present disclosure. As shown in fig. 4, includes: the information acquisition module 401 and the information processing module 402.
The information obtaining module 401 is configured to obtain reporting information of the client, where the reporting information includes: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained by performing voice recognition on a query in a voice form sent by the user.
The information processing module 402 is configured to determine a user intention according to the reported information, determine operation information according to the user intention and a page tree corresponding to a target application, and return the operation information to the client, where the client is configured to determine a target page corresponding to the query according to the operation information and display the target page, and the target application is an application to which the current page belongs.
By adopting the scheme of the embodiment of the device, a simple fuzzy matching mode is not adopted any more, but a more accurate intention matching mode is adopted, so that the operation information can be determined based on the intention of a user and the page tree corresponding to the target application, and further, the target page can be determined and displayed according to the operation information, thereby improving generalization capability, improving the accuracy of a processing result and the like.
Preferably, the page tree may include: the method comprises the steps of nodes, sub-nodes and edges, wherein each page in a target application corresponds to one node respectively, each operable element in any page serves as one sub-node in the corresponding node of the page respectively, each sub-node is connected with the corresponding node through the edge respectively, for any sub-node, the corresponding node is the corresponding node of the page which is jumped to after clicking the sub-node, each edge has the corresponding edge intention, and each node has the corresponding page intention respectively.
The user intention means what operation the user wants to do. By combining the current page and text in the reported information, the corresponding target application and user intention can be determined, and further, the user intention can be matched with the edge intention and the page intention in the page tree corresponding to the target application.
Preferably, in response to determining that the user intention matches any one of the edge intents corresponding to the current page, the information processing module 402 may determine, according to the matched edge intention, an element in the current page corresponding to the query, and may use the determined identifier or coordinates of the element as operation information, and jump to display the target page after the client side simulates clicking the identifier or the element corresponding to the coordinates, where the coordinates are coordinates in the current page.
In addition, preferably, in response to determining that the user intention matches any one of the page intents in the page tree, the information processing module 402 may determine a target page according to the matched page intention, and may acquire a path from a root node of the page tree to the target page as operation information, and after the client returns to the home page of the target application from the current page, find the target page according to the path by clicking step by step and display the target page.
Fig. 5 is a schematic structural diagram of a second embodiment 500 of a page display device according to the present disclosure. As shown in fig. 5, includes: information reporting module 501 and page presentation module 502.
The information reporting module 501 is configured to obtain a query in a voice form sent by a user, and send a text obtained by performing voice recognition on the query and an end state, including a current page displayed to the user, as reporting information to a cloud.
The page display module 502 is configured to obtain operation information returned by the cloud, determine a target page corresponding to the query according to the operation information, and display the target page, where the operation information is determined by the cloud according to the user intention after determining the user intention according to the report information, and according to the user intention and a page tree corresponding to the target application, and the target application is an application to which the current page belongs.
By adopting the scheme of the embodiment of the device, a simple fuzzy matching mode is not adopted any more, but a more accurate intention matching mode is adopted, so that the operation information can be determined based on the intention of a user and the page tree corresponding to the target application, and further, the target page can be determined and displayed according to the operation information, thereby improving generalization capability, improving the accuracy of a processing result and the like.
Preferably, the page tree corresponding to the target application may include: the method comprises the steps of nodes, sub-nodes and edges, wherein each page in a target application corresponds to one node respectively, each operable element in any page serves as one sub-node in the corresponding node of the page respectively, each sub-node is connected with the corresponding node through the edge respectively, for any sub-node, the corresponding node is the corresponding node of the page which is jumped to after clicking the sub-node, each edge has the corresponding edge intention, and each node has the corresponding page intention respectively.
Preferably, the operation information may include: the method for determining the target page corresponding to the query and displaying the target page according to the operation information by the page display module 502 may include: and jumping to display the target page by simulating clicking the element corresponding to the mark or the coordinate.
In addition, preferably, the operation information may further include: the method for determining, for the cloud, that the user intention matches any one of the page intents in the page tree and determining the target page according to the matched page intention, by using the operation information as the path from the root node of the page tree to the target page, and accordingly, the method for determining, by using the page display module 502, the target page corresponding to the query according to the operation information and displaying the target page may include: and returning to the home page of the target application from the current page, starting from the home page, finding out the target page in a step-by-step clicking mode according to the path, and displaying.
Preferably, the page display module 502 can return to the first page step by step from the current page through the back event, and in addition, in the process of returning to the first page, in response to determining that the current returned page is the target page, the target page can be directly displayed.
The specific workflow of each device embodiment may refer to the related description in the foregoing method embodiment, and will not be repeated.
In a word, by adopting the scheme disclosed by the disclosure, generalization capability and accuracy of processing results can be improved, and invisible and visible speaking, direct one-language and the like can be realized.
The scheme disclosed by the disclosure can be applied to the field of artificial intelligence, and particularly relates to the fields of voice recognition, natural language processing, knowledge graph and the like. Artificial intelligence is the subject of studying certain thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.) that make a computer simulate a person, and has technology at both hardware and software levels, and artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, etc., and artificial intelligence software technologies mainly include computer vision technologies, speech recognition technologies, natural language processing technologies, machine learning/deep learning, big data processing technologies, knowledge graph technologies, etc.
In addition, the voice and the like in the embodiments of the present disclosure are not specific to a particular user, and cannot reflect personal information of a particular user. In the technical scheme of the disclosure, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information of the user accord with the regulations of related laws and regulations, and the public order colloquial is not violated.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.
Fig. 6 shows a schematic block diagram of an electronic device 600 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile apparatuses, such as personal digital assistants, cellular telephones, smartphones, wearable devices, and other similar computing apparatuses. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data required for the operation of the device 600 may also be stored. The computing unit 601, ROM602, and RAM603 are connected to each other by a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Various components in the device 600 are connected to the I/O interface 605, including: an input unit 606 such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the various methods and processes described above, such as the methods described in this disclosure. For example, in some embodiments, the methods described in the present disclosure may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM602 and/or the communication unit 609. One or more steps of the methods described in this disclosure may be performed when a computer program is loaded into RAM603 and executed by computing unit 601. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the methods described in the present disclosure in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (21)

1. A page presentation method, comprising:
obtaining report information of a client, wherein the report information comprises: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained after voice recognition of a voice form query sent by the user;
determining user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to a target application, and returning the operation information to the client for the client to determine and display a target page corresponding to the query according to the operation information, wherein the target application is an application to which the current page belongs.
2. The method of claim 1, wherein,
the page tree comprises the following steps: nodes, child nodes, and edges;
each page in the target application corresponds to a node respectively, each operable element in any page is used as one child node in the nodes corresponding to the page respectively, each child node is connected with the corresponding node through an edge respectively, for any child node, the corresponding node is the node corresponding to the page which is jumped to after clicking the child node, each edge respectively has a corresponding edge intention, and each node respectively has a corresponding page intention.
3. The method of claim 2, wherein,
the determining operation information according to the user intention and the page tree corresponding to the target application comprises the following steps:
and responding to the fact that the user intention is matched with any one of the edge intents corresponding to the current page, determining the elements in the current page corresponding to the query according to the matched edge intents, taking the identification or coordinates of the determined elements as the operation information, and jumping to display the target page after the client side simulates clicking the identification or the elements corresponding to the coordinates, wherein the coordinates are coordinates in the current page, and the edge intents corresponding to the current page are edge intents of edges corresponding to child nodes in the nodes corresponding to the current page.
4. The method of claim 2, wherein,
the determining operation information according to the user intention and the page tree corresponding to the target application comprises the following steps:
and responding to the fact that the user intention is matched with any page intention in the page tree, determining the target page according to the matched page intention, acquiring a path from a root node of the page tree to the target page as the operation information, and after the client returns to a first page of the target application from the current page, finding out the target page and displaying the target page in a step-by-step clicking mode according to the path.
5. A page presentation method, comprising:
acquiring a query in a voice form sent by a user, and sending a text obtained after voice recognition of the query and an end state to a cloud as reporting information, wherein the end state comprises a current page displayed to the user;
and acquiring operation information returned by the cloud, determining a target page corresponding to the query according to the operation information, and displaying the target page, wherein the operation information is determined by the cloud according to the user intention after determining the user intention according to the report information and according to the user intention and a page tree corresponding to a target application, and the target application is an application to which the current page belongs.
6. The method of claim 5, wherein,
the page tree comprises the following steps: nodes, child nodes, and edges;
each page in the target application corresponds to a node respectively, each operable element in any page is used as one child node in the nodes corresponding to the page respectively, each child node is connected with the corresponding node through an edge respectively, for any child node, the corresponding node is the node corresponding to the page which is jumped to after clicking the child node, each edge respectively has a corresponding edge intention, and each node respectively has a corresponding page intention.
7. The method of claim 6, wherein,
the operation information includes: the operation information is determined for the cloud after the user intention is matched with any one of the edge intents corresponding to the current page according to the matched edge intents, the coordinates are coordinates in the current page, and the edge intention corresponding to the current page is the edge intention of the edge corresponding to the child node in the node corresponding to the current page;
the step of determining and displaying the target page corresponding to the query according to the operation information comprises the following steps: and jumping to display the target page by simulating clicking the element corresponding to the mark or the coordinate.
8. The method of claim 6, wherein,
the operation information includes: the path from the root node of the page tree to the target page is generated after the operation information determines that the user intention is matched with any page intention in the page tree for the cloud and determines the target page according to the matched page intention;
the step of determining and displaying the target page corresponding to the query according to the operation information comprises the following steps: and returning to the home page of the target application from the current page, starting from the home page, finding out the target page in a step-by-step clicking mode according to the path, and displaying.
9. The method of claim 8, wherein,
the returning from the current page to the home page of the target application includes: step by step returning to the home page through a return event;
the method further comprises the steps of: and in the process of returning to the home page, responding to the determination that the currently returned page is the target page, and directly displaying the target page.
10. A page display device, comprising: an information acquisition module and an information processing module;
the information acquisition module is configured to acquire report information of a client, where the report information includes: the terminal state comprises a current page displayed to a user and a text, wherein the text is obtained after voice recognition of a voice form query sent by the user;
The information processing module is used for determining user intention according to the reported information, determining operation information according to the user intention and a page tree corresponding to a target application, returning the operation information to the client, and determining and displaying a target page corresponding to the query according to the operation information by the client, wherein the target application is an application to which the current page belongs.
11. The apparatus of claim 10, wherein,
the page tree comprises the following steps: nodes, child nodes, and edges;
each page in the target application corresponds to a node respectively, each operable element in any page is used as one child node in the nodes corresponding to the page respectively, each child node is connected with the corresponding node through an edge respectively, for any child node, the corresponding node is the node corresponding to the page which is jumped to after clicking the child node, each edge respectively has a corresponding edge intention, and each node respectively has a corresponding page intention.
12. The apparatus of claim 11, wherein,
the information processing module is used for responding to the fact that the user intention is matched with any one of the edge intents corresponding to the current page, determining elements in the current page corresponding to the query according to the matched edge intents, taking the identification or coordinates of the determined elements as the operation information, performing jump display on the target page after the client side simulates clicking the identification or the elements corresponding to the coordinates, wherein the coordinates are coordinates in the current page, and the edge intents corresponding to the current page are edge intents of edges corresponding to child nodes in the nodes corresponding to the current page.
13. The apparatus of claim 11, wherein,
the information processing module responds to the fact that the user intention is matched with any page intention in the page tree, determines the target page according to the matched page intention, acquires a path from a root node of the page tree to the target page as the operation information, and is used for finding out and displaying the target page in a step-by-step clicking mode according to the path after the client returns to a first page of the target application from the current page.
14. A page display device, comprising: the information reporting module and the page display module;
the information reporting module is used for acquiring a query in a voice form sent by a user, and sending a text obtained after voice recognition of the query and an end state to a cloud as reporting information, wherein the end state comprises a current page displayed to the user;
the page display module is used for acquiring operation information returned by the cloud, determining a target page corresponding to the query according to the operation information and displaying the target page, wherein the operation information is determined by the cloud according to the user intention after determining the user intention according to the report information and according to the user intention and a page tree corresponding to a target application, and the target application is an application to which the current page belongs.
15. The apparatus of claim 14, wherein,
the page tree comprises the following steps: nodes, child nodes, and edges;
each page in the target application corresponds to a node respectively, each operable element in any page is used as one child node in the nodes corresponding to the page respectively, each child node is connected with the corresponding node through an edge respectively, for any child node, the corresponding node is the node corresponding to the page which is jumped to after clicking the child node, each edge respectively has a corresponding edge intention, and each node respectively has a corresponding page intention.
16. The apparatus of claim 15, wherein,
the operation information includes: the operation information is determined for the cloud after the user intention is matched with any one of the edge intents corresponding to the current page according to the matched edge intents, the coordinates are coordinates in the current page, and the edge intention corresponding to the current page is the edge intention of the edge corresponding to the child node in the node corresponding to the current page;
and the page display module is used for jumping and displaying the target page by simulating clicking the element corresponding to the mark or the coordinate.
17. The apparatus of claim 15, wherein,
the operation information includes: the path from the root node of the page tree to the target page is generated after the operation information determines that the user intention is matched with any page intention in the page tree for the cloud and determines the target page according to the matched page intention;
and the page display module returns to the home page of the target application from the current page, starts from the home page, and finds out and displays the target page in a step-by-step clicking mode according to the path.
18. The apparatus of claim 17, wherein,
the page display module returns to the home page step by step through a return event;
the page display module is further used for directly displaying the target page in response to determining that the currently returned page is the target page in the process of returning to the home page.
19. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.
20. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1-9.
21. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the method of any of claims 1-9.
CN202310577198.9A 2023-05-22 2023-05-22 Page display method and device, electronic equipment and storage medium Pending CN116701571A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310577198.9A CN116701571A (en) 2023-05-22 2023-05-22 Page display method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310577198.9A CN116701571A (en) 2023-05-22 2023-05-22 Page display method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116701571A true CN116701571A (en) 2023-09-05

Family

ID=87826882

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310577198.9A Pending CN116701571A (en) 2023-05-22 2023-05-22 Page display method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116701571A (en)

Similar Documents

Publication Publication Date Title
CN112597754B (en) Text error correction method, apparatus, electronic device and readable storage medium
CN113012695B (en) Intelligent control method and device, electronic equipment and computer readable storage medium
CN113641804A (en) Pre-training model obtaining method and device, electronic equipment and storage medium
CN113641829A (en) Method and device for training neural network of graph and complementing knowledge graph
CN117492743A (en) Target application generation method and device based on large language model and storage medium
CN117370520A (en) Method, device, equipment and medium for processing split dialogue
CN115879469B (en) Text data processing method, model training method, device and medium
CN115292467B (en) Information processing and model training method, device, equipment, medium and program product
CN114490990B (en) Method, device, equipment and storage medium for determining text to be annotated
CN115481594B (en) Scoreboard implementation method, scoreboard, electronic equipment and storage medium
CN113360590B (en) Method and device for updating interest point information, electronic equipment and storage medium
CN113554062B (en) Training method, device and storage medium for multi-classification model
CN113742581B (en) Method and device for generating list, electronic equipment and readable storage medium
CN113691403B (en) Topology node configuration method, related device and computer program product
CN116701571A (en) Page display method and device, electronic equipment and storage medium
CN112817463A (en) Method, equipment and storage medium for acquiring audio data by input method
CN113836291B (en) Data processing method, device, equipment and storage medium
CN113114851B (en) Incoming call intelligent voice reply method and device, electronic equipment and storage medium
CN115510203B (en) Method, device, equipment, storage medium and program product for determining answers to questions
CN116257611B (en) Question-answering model training method, question-answering processing device and storage medium
CN113343090B (en) Method, apparatus, device, medium and product for pushing information
CN116450917B (en) Information searching method and device, electronic equipment and medium
CN117421400A (en) Dialogue interaction method and device and electronic equipment
CN117971661A (en) Large model test method and device, electronic equipment and storage medium
CN117093691A (en) System help method, device, equipment and storage medium based on large language model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination