CN117610664A - Reply method, reply system and related device - Google Patents

Reply method, reply system and related device Download PDF

Info

Publication number
CN117610664A
CN117610664A CN202311384951.9A CN202311384951A CN117610664A CN 117610664 A CN117610664 A CN 117610664A CN 202311384951 A CN202311384951 A CN 202311384951A CN 117610664 A CN117610664 A CN 117610664A
Authority
CN
China
Prior art keywords
information
reply
user
query
displaying
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311384951.9A
Other languages
Chinese (zh)
Inventor
钟锟
刘胜寒
郭晓天
孙国俊
王玮
苏文畅
江嘉辉
徐迪迪
孔常青
高建清
刘聪
胡国平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Xunfei Reading And Writing Technology Co ltd
Original Assignee
Hefei Xunfei Reading And Writing Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Xunfei Reading And Writing Technology Co ltd filed Critical Hefei Xunfei Reading And Writing Technology Co ltd
Priority to CN202311384951.9A priority Critical patent/CN117610664A/en
Publication of CN117610664A publication Critical patent/CN117610664A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computing arrangements using knowledge-based models
    • G06N5/04Inference or reasoning models
    • G06N5/041Abduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a reply method, a reply system and a related device, wherein the method comprises the following steps: acquiring inquiry information input by a user, and determining reference information matched with the inquiry information; obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information; and displaying the reply information and the corresponding association information. By the method, the accuracy and the efficiency of reply can be improved.

Description

Reply method, reply system and related device
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a reply method, system, and related device.
Background
With the continuous development of intelligence, users can generate various information in daily work, study and life, and when the users need to answer the current questions based on the past information, the current common mode is that the users turn over the past information and answer automatically according to the past information, or generate corresponding answers through intelligent analysis.
The process of replying by intelligent analysis mainly comprises the steps of manually selecting part of previous information by a user, and uploading the selected information and the selected questions to an analysis model so that the analysis model outputs corresponding replies. The method requires the user to select and upload the previous information in advance, so that the efficiency of the analysis model is lower when the analysis model replies; in addition, only replies generated by the user are displayed, so that the user cannot trace back the past information, and the efficiency of understanding the reply content by the user is reduced. In view of this, how to propose an efficient answer method is a problem to be solved.
Disclosure of Invention
The technical problem mainly solved by the application is to provide a reply method, a reply system and a related device, which can improve the accuracy and the efficiency of reply.
In order to solve the technical problems, one technical scheme adopted by the application is as follows: there is provided a reply method including: acquiring inquiry information input by a user, and determining reference information matched with the inquiry information; obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information; and displaying the reply information and the corresponding association information.
In order to solve the technical problems, another technical scheme adopted by the application is as follows: there is provided a reply system comprising: the processing module is used for acquiring query information input by a user and determining reference information matched with the query information; the reply module is used for obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information; and the display module is used for displaying the reply information and the corresponding association information.
In order to solve the technical problems, another technical scheme adopted by the application is as follows: there is provided an electronic device including: a memory and a processor coupled to each other, the memory having stored therein program instructions for executing the program instructions to implement the reply method as mentioned in the above-mentioned technical solution.
In order to solve the technical problems, another technical scheme adopted by the application is as follows: there is provided a computer-readable storage medium having stored thereon program instructions which, when executed by a processor, implement a reply method as mentioned in the above-mentioned technical solution.
The beneficial effects of this application are: in contrast to the situation in the prior art, the reply method provided by the application actively acquires the reference information matched with the query information after acquiring the query information provided by the user, so as to efficiently and accurately generate the reply information. And meanwhile, the relevant information related to the reply information in the reference information is displayed to the user, so that the user can refer to the reply information in combination with the relevant information, and a solving basis is provided for the user, so that the user can understand the reply information and backtrack the corresponding relevant information.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
FIG. 1 is a flow chart of an embodiment of a reply method of the present application;
fig. 2 is a flow chart corresponding to another embodiment of step S101;
fig. 3 is a schematic diagram of an embodiment corresponding to step S201;
fig. 4 is a schematic diagram of an embodiment corresponding to step S202;
fig. 5 is a flow chart corresponding to the step S103;
FIG. 6 is a diagram of step S301 according to an embodiment;
FIG. 7 is a diagram of step S302 corresponding to an embodiment;
fig. 8 is a schematic diagram of another embodiment corresponding to step S302;
fig. 9 is a schematic diagram of another embodiment corresponding to step S302;
FIG. 10 is a flow chart of yet another embodiment of the reply method of the present application;
FIG. 11 is a schematic diagram of an embodiment of a reply system of the present application;
FIG. 12 is a schematic diagram of an embodiment of an electronic device of the present application;
fig. 13 is a schematic structural view of an embodiment of the computer readable storage medium of the present application.
Detailed Description
The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The reply method provided by the application is realized by means of an application on the intelligent terminal or at least the intelligent terminal integrated with the data processing function. The intelligent terminal can be an intelligent office book, a mobile phone, a tablet personal computer, a personal computer or a wearable intelligent device.
Referring to fig. 1, fig. 1 is a flow chart illustrating an embodiment of a reply method according to the present application, the method includes:
s101: query information input by a user is acquired, and reference information matched with the query information is determined.
In one embodiment, a user's question audio is obtained and converted to text as query information. Or acquiring a question text input by the user, and taking the question text as query information. The conversion of the question audio into text can be realized by the existing voice recognition technology; and, ways in which the user enters the quiz text include, but are not limited to, input by an input method or handwriting.
Further, reference information matching the query information of the user is acquired.
In one embodiment, listing data associated with a user is obtained and a portion of the listing data associated with the query text is selected as the reference text.
In one implementation scenario, the recording data associated with the user may be various types of data, such as, for example, scene recording data recorded by the user in the relevant scene, mail data sent or received by the user, books read by the user, or reminder data created by the user. Wherein, the related scene can be at least one of conference, classroom or lecture, and the scene recording data comprises at least one of audio, image and text; the user-created reminder data may be a user-created calendar or memo text or the like.
In another embodiment, after the query information of the user is acquired, information extraction is performed on the query information, and the extracted information is used as reference information.
In yet another embodiment, after the query information of the user is acquired, part of data related to the query information may be searched through the network as reference information.
S102: and obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information.
In one embodiment, the reference information is used for replying to the query information to generate reply information corresponding to the query information, and part of information used for generating the reply information in the reference information is used as associated information to provide corresponding answering basis for the user.
S103: and displaying the reply information and the corresponding association information.
In an embodiment, the reply information and the associated information are displayed in corresponding areas of the intelligent terminal display interface, so that a user can browse the reply information in combination with the associated information.
Further, after step S103, the method further includes: and responding to the continuous questioning of the user, returning to acquiring the questioning information input by the user, determining the reference information matched with the questioning information, and sequentially executing the follow-up steps.
According to the reply method, after the query information proposed by the user is obtained, the reference information matched with the query information is actively obtained, so that the reply information is efficiently and accurately generated. And meanwhile, the relevant information related to the reply information in the reference information is displayed to the user, so that the user can refer to the reply information in combination with the relevant information, and a solving basis is provided for the user, so that the user can understand the reply information and backtrack the corresponding relevant information.
In another embodiment, referring to fig. 2, fig. 2 is a flowchart of step S101 corresponding to another embodiment. After acquiring the query information input by the user, determining the reference information matched with the query information, wherein the step comprises the following steps:
s201: and acquiring the reference authority determined by the user. Wherein the reference rights are used to select listing data that includes at least one candidate data category.
In one embodiment, a prompt message for prompting the user to select the reference rights is generated and presented to the user. Wherein the prompt message includes a selection box for the user to select or deselect.
Further, in response to detecting that the user selects a selection frame in the prompt message, the reference authority is acquired.
In another embodiment, in addition to the above selection boxes, the prompt message includes an "consent" option and a "reject" option for the user to select, for convenience of user operation. After the prompt information is displayed to the user, responding to the fact that the user clicks the 'consent' option, and acquiring the reference authority; in response to detecting that the user clicks the "reject" option, the reference rights cannot be obtained.
In a specific application scenario, please refer to fig. 3, fig. 3 is a schematic diagram corresponding to an embodiment of step S201. Specifically, as shown in fig. 3, the generated prompt information includes a first prompt text 11 and a second prompt text 12, the first prompt text 11 is "apply for retrieving your personal data, answer your question based on personal data", the second prompt text 12 is "refer to personal data when answering question", and "consent" and "reject" options are set at the corresponding positions of the first prompt text 11, and a selection box is set at the corresponding position of the second prompt text 12. After detecting that a user selects a selection frame, acquiring reference rights; or after detecting that the user clicks the 'agree' option, the reference authority is acquired. In addition, in response to detecting that the user unhooked the selection box corresponding to the second prompt text 12 in the process of question answering with the user, the acquisition of the reference authority is stopped.
S202: based on the query information and the reference rights, reference information matching the query information is determined.
In one embodiment, in response to the currently acquired query information and reference rights of the user, all the recording data matched with the reference rights are used as reference information. The method does not need the user to actively select the data which is created or browsed in the past for uploading, so that convenience of question and answer is greatly improved; meanwhile, when the user query information is solved according to all the recorded data, the accuracy of the solution is improved.
In another embodiment, in response to the reference rights not being acquired after the query information of the user is acquired, part of the information is extracted from the query information as the reference information.
In one implementation scenario, query information is input into a pre-built extraction model, so that the extraction model extracts a part of keywords and/or key sentences from the query information, and the part of keywords and/or key sentences are used as reference information. The extraction model may be obtained by training a plurality of training texts, where each training text includes a corresponding training label, and the training label includes at least a part of keywords and/or key sentences in the corresponding training text, and a specific training process may refer to a training process of an existing neural network model, which is not described in detail herein.
In a specific application scenario, in response to the acquired inquiry information of the user being "I want to attend a meeting about the AI intelligent robot next," please help I arrange some specific applications about the AI intelligent robot in an office scenario, "the inquiry information is input into the extraction model, and the obtained keyword" AI intelligent robot "and the key sentence" specific applications in the office scenario "are used as reference information.
In still another embodiment, after the query information and the reference rights of the user are acquired, the implementation process of step S202 may further include: and displaying all candidate data categories included in the recording information matched with the reference authority. And responding to the detection that the user selects at least one candidate data category as a target category, and taking the recorded data corresponding to the target category as reference information, so that the matching degree of the reply information obtained subsequently based on the reference information and the user requirement is higher.
Specifically, after the user finishes recording, creating or referring to the data, synchronizing the partial data to a local memory of the intelligent terminal for the processor of the intelligent terminal to call; or the part of data is synchronized to the cloud server, so that the consumption of storage resources of the intelligent terminal is saved. And responding to the completion of the synchronization of the data, and endowing the corresponding synchronization identification of the partial data. After the reference authority is acquired, taking all the data with the synchronous identification as the recording data, and displaying all candidate data types corresponding to the partial recording data on a display interface. And responding to the detection that the user selects at least one candidate data category, taking the candidate data category selected by the user as a target category, and taking the recorded data corresponding to the target category as reference information.
In an implementation scenario, please refer to fig. 4, fig. 4 is a schematic diagram corresponding to an embodiment of step S202. In response to the listing data corresponding to the reference authority including the notes recorded by the user, the books read by the user, the schedule reminders recorded by the user and the mails received and sent by the user, all the corresponding candidate data categories, namely "notes", "books", "schedules" and "mails", are displayed in the category display area 13 of the display interface. And responding to the detection that the user selects the candidate data category of 'notes' and confirms, and taking notes recorded by the user as reference information in all the recorded data.
In another embodiment, after the query information and the reference rights of the user are acquired, the implementation process of step S202 may further include: and in response to detecting that the user selects at least a portion of the listing data for which the reference rights match, displaying the user-selected listing data. And acquiring a data segment selected by the user from the displayed recorded data as reference information matched with the query information.
In an implementation scene, after obtaining the reference authority, responding to the displayed recording data to comprise original texts, and obtaining one or more sections of texts in the original texts selected by a user to be used as reference information matched with query information; responding to the displayed recording data to comprise original audio, wherein the data segment selected by the user can be one or more audio segments in the original audio, and the audio segments can be determined according to the acquired starting time and ending time selected by the user on the playing progress bar of the original audio and used as reference information matched with the query information; and responding to the displayed recorded data to comprise an original image, and acquiring an image block obtained by cutting the original image by a user and using the image block as reference information matched with the query information.
In a specific application scenario, please continue to refer to fig. 3, when the second prompt text 12 is "answer to the question," the corresponding listing data list is displayed on the display interface after detecting that the user clicks "personal data" in the second prompt text 12. And in response to the detection that the user selects the conference audio in the recording data list, displaying a playing progress bar corresponding to the conference audio and a transfer text corresponding to the conference audio. The method is used for detecting that the user selects a part in the transcribed text, and the user selected part of the transcribed text is used as a reference text.
In another embodiment, step S102 includes: and obtaining a preset template. And obtaining task text based on the preset template, the query information and the reference information. And inputting the task text into the intelligent analysis model so that the intelligent analysis model analyzes the task text and outputs corresponding reply information and associated information. The intelligent analysis model is deployed at the cloud end, and a synchronization identifier corresponds to the reference information for completing data synchronization. The specific process of data synchronization with the cloud may refer to the above-mentioned corresponding embodiment, and will not be described in detail herein.
In an implementation scenario, the intelligent analysis model is a large language model with better information analysis capability, a task text is generated according to a preset template, query information and reference information, the task text is provided for the large language model, and the large language model is required to output corresponding reply information according to the task text and generate a basis corresponding to the reply information. For example, when the reference information is a meeting note recorded by the user, and the query information proposed by the user is "what form the intelligent office book X3 release will take is suitable", the generated task text is: "answer from meeting notes: the smart office X3 release will take what form is appropriate).
In one specific application scenario, the large language model is a Generative Pre-Training (GPT) model.
In another embodiment, in order to improve the solution efficiency, the intelligent analysis model may be deployed in the processor of the intelligent terminal, so that after the processor of the intelligent terminal generates the task text according to the preset template, the query information and the reference information, the task text is input into the intelligent analysis model to obtain the corresponding reply information and the corresponding association information. It should be noted that, in response to deployment of the intelligent analysis model in the present embodiment to the intelligent terminal, the reference information for generating the task text may be obtained from the recording data synchronized in the memory of the intelligent terminal, or may be obtained from the recording data synchronized in the cloud.
In another embodiment, the query information and the reference information may also be analyzed using a pre-trained solution model to generate corresponding reply information and corresponding association information.
Specifically, the solution model extracts a part of keywords or sentences related to the query information from the reference information, and color-rendering the extracted keywords and sentences to generate the semantically smooth reply information. The specific structure of the solution model can refer to the existing semantic analysis model structure, the solution model can be obtained through training through a plurality of training data, each training data comprises a training answer and a plurality of training elements corresponding to the training answer, and the training elements can be keywords and/or sentences.
In another embodiment, referring to fig. 5, fig. 5 is a flowchart corresponding to an embodiment of step S103. Specifically, the implementation procedure of step S103 includes:
s301: and displaying the reply information on a display interface according to the target format. The reply information comprises at least one reply key point, and each reply key point is provided with a corresponding guide identifier, and the guide identifier is matched with the corresponding association information.
In one embodiment, the reply information is displayed on the display interface according to the target format, and the guide identifiers corresponding to the reply key points in the reply information are displayed at the corresponding positions of the display interface. And responding to the obtained click of any guide identifier by the user, and displaying the corresponding associated information so as to provide a corresponding answer basis for each answer key point for the user. Wherein, the target format can be a text format or an audio format; and the guide identifier comprises a guide superscript and a guide list, the guide superscript is positioned at the corresponding position of the reply key point, the guide list comprises a description label matched with the guide superscript, and the description label comprises part of key information in corresponding associated information.
In a specific application scenario, referring to fig. 6, fig. 6 is a schematic diagram corresponding to an embodiment of step S301. When the generated reply information containing a plurality of reply key points is presented in the reply area 14 of the presentation interface, a guide superscript 15 is set at the end position of each reply key point, as shown in [1], [2] and [3] in fig. 6. And displaying a guide list 16 in a region below the reply information, wherein the guide list 16 comprises description labels corresponding to the reply key points, and the description labels comprise generalized texts of the corresponding associated information. In addition, the data category of the corresponding association information and the position information in the corresponding recorded data are also marked at the position corresponding to each description tag in the guide list 16. For example, referring to description tag [1] in the guide list 16 in fig. 6, when the associated information is a partial handwritten text segment in the second page of the corresponding listing information, the partial handwritten text segment is summarized to obtain a summarized text: "intelligent office book X3 highlight function arrangement", the summary text, corresponding data category "handwriting" and position information "P2" are composed to a description tag [1].
In another embodiment, the guide identifier may also include only a guide superscript or guide list.
S302: and responding to the detection that the user selects the guide identifier, and displaying the associated information corresponding to the guide identifier selected by the user on a display interface according to an original format. Wherein, the original format is the format of the associated information in the corresponding reference information.
In one embodiment, in response to detecting that a user selects any guide superscript, a pop-up box is displayed at a corresponding position of the guide superscript, and corresponding association information is displayed within the pop-up box. The display position of the pop-up box can be located below the corresponding guide superscript or in the middle of the display interface.
In a specific application scenario, please refer to fig. 7 in conjunction with fig. 6, fig. 7 is a schematic diagram corresponding to an embodiment of step S302. In response to the user clicking on the guide superscript [1] corresponding to the first reply key, a pop-up box 17 is presented at the respective location of the presentation interface, with at least part of the associated information corresponding to the first reply key presented within the pop-up box 17.
In yet another specific application scenario, please continue to refer to fig. 6 and fig. 7, in response to the guide identifier including a guide superscript and a guide list, the corresponding description label 18 is simultaneously displayed in the pop-up box 17, so that when the user clicks the description label 18 in the pop-up box 17, the corresponding association information is displayed in detail on the display interface.
In another embodiment, in response to detecting that the user selects any description tag in the guide list, the corresponding association information is presented in detail on the presentation interface in order to facilitate the user to refer to the association information.
In a specific application scenario, please refer to fig. 8 in conjunction with fig. 6, fig. 8 is a schematic diagram corresponding to another embodiment of step S302. In response to the user clicking the first description tab "smart office book X3 highlight feature sort, handwriting, P2" in the guide list 16, the current presentation interface is jumped to present the corresponding associated information, i.e., the user's handwritten content as shown in fig. 8. In addition, when the associated information is displayed, a key part in the associated information is highlighted.
Optionally, in other specific application scenarios, in response to the fact that the corresponding description label is displayed in the pop-up box corresponding to the guide identifier, after detecting that the user selects the description label in the pop-up box, the current display interface is jumped to display corresponding associated information.
In still another embodiment, in response to the guide identifier selected by the user to index a plurality of associated information, in order to facilitate the user to browse different associated information, the implementation process of step S302 may further include: and responding to the detection that the user switches the currently displayed associated information, and displaying the associated information adjacent to the currently associated information.
In an implementation scenario, according to the acquired time or the position in the same recording data, the plurality of associated information indexed by the same guide identifier are ordered to obtain an associated information sequence corresponding to the guide identifier. And after the user selects the guide identifier, the first associated information in the corresponding associated information sequence is preferentially displayed on the display interface. And responding to the detection that the user switches the currently displayed associated information, and displaying the last associated information or the next associated information adjacent to the current associated information on the display interface.
In a specific application scenario, by acquiring a left sliding operation or a right sliding operation of a user on a display interface, next associated information or previous associated information is displayed on the display interface. Or when the display interface is displaying the associated information, displaying a 'last' option and a 'next' option at corresponding positions of the display interface, and in response to detecting that a user clicks the 'next' option, displaying the next associated information at the display interface; in response to detecting a user clicking on the "last" option, last associated information is presented at the presentation interface.
In another specific application scene, responding to the association information displayed by the current display interface as a file in PDF format comprising multi-page content, and after detecting a switching instruction of a user, switching page numbers. For example, after detecting an operation of the user sliding the presentation interface to the left, the next page of the document is presented.
In yet another embodiment, in response to the reference information including the original audio piece, the implementation of step S302 includes: and displaying a playing progress bar corresponding to the original audio segment in a first area of the display interface, and marking the reference segment in the playing progress bar based on the starting time and the ending time corresponding to the reference segment. And displaying the transcribed text corresponding to the original audio segment in a second area of the display interface, and highlighting the part of the transcribed text corresponding to the reference segment.
In a specific application scenario, please refer to fig. 9 in conjunction with fig. 6, fig. 9 is a schematic diagram corresponding to another embodiment of step S302. In response to the user clicking on the third descriptive tab within the guide list 16: and (3) the meeting summary function demonstration discussion and records 13'30 to 13'55 ', and the current display interface is jumped to display the corresponding meeting record. Responding to the conference record comprising the corresponding conference audio and the corresponding transfer text of the conference audio, displaying a playing progress bar and a corresponding playing adjusting key corresponding to the conference audio in a first area 19 of a display interface, and adjusting the playing time in the playing precision bar to the starting time of the corresponding reference segment, namely 13 minutes and 30 seconds; and displaying the transcribed text in the second area 20 and highlighting the portion of the transcribed text corresponding to the reference fragment.
In still another embodiment, the reply method provided by the present application generates confirmation information for asking the user whether to accept the generated reply information after obtaining the reply information corresponding to the query information and the associated information associated with the reply information in the reference information. Responsive to detecting the user selection to accept the reply information, the reply information is inserted as target information into a target area of the presentation interface.
In a specific application scenario, after generating the reply information and the corresponding associated information, generating acknowledgement information "accept or not", and in response to detecting that the user selects the "accept" option, inserting the generated reply information as target information into a note area in the display interface for storage. Alternatively, the generated reply information, the corresponding query information, and the associated information may be sorted according to the target template, and stored as the target file.
In yet another embodiment, referring to fig. 10, fig. 10 is a schematic flow chart diagram of a yet another embodiment of the reply method of the present application. When the intelligent terminal on which the implementation of the reply method provided by the application depends is a wearable intelligent device, the specific process of the reply method can be as follows:
S401: and acquiring original information recorded by the user in real time.
In one embodiment, in response to detecting an input instruction of a user, original information of the user is obtained in real time and is synchronized to a memory or cloud of the wearable intelligent device; and responding to the original information to complete synchronization, and giving a synchronization identifier to the original information. The original information may be audio of a user's oral description, and specifically may include at least one of a schedule, a daily diet condition, a sport condition, a health condition, or memo information, etc. orally set forth by the user.
In one implementation scenario, in response to the wearable smart device being a smart watch, the smart watch receives verbal descriptive audio of a user through a microphone and takes it as raw information when it is detected that the user clicks a record button on the smart watch.
Alternatively, the wearable smart device may be a smart bracelet, a smart necklace, a bio-implantable device, or the like in other embodiments.
S402: query information input by a user is acquired, and reference information matched with the query information is determined.
In one embodiment, in response to the wearable device being a smart watch, the smart watch detects that a user clicks an inquiry button on the smart watch, obtains inquiry information of the user with a microphone, and converts the inquiry information into inquiry text.
Further, the part related to the query text is obtained from the original information with the synchronous identification as the reference information.
In another embodiment, in response to the wearable device being a smart watch, and the smart watch being associated with another device, the other device may be a mobile phone, a tablet computer, a personal computer, or the like, the query information input by the user on the other device is obtained, and the reference information matching the query information is determined based on the method mentioned in any of the above embodiments.
S403: and obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information.
In an embodiment, task text is generated based on the query information and the reference information, and the task text is input to the intelligent analysis model to obtain corresponding reply information and corresponding association information, and the specific process can refer to the corresponding embodiment.
Further, after obtaining the reply information and the corresponding association information, the reply information and the corresponding association information are displayed to the user.
In an embodiment, in response to the limited display interface of the wearable device, the generated reply information and the corresponding association information may be displayed on other terminals connected to the wearable device, and the specific display process may refer to the corresponding embodiment.
Referring to fig. 11, fig. 11 is a schematic structural diagram of an embodiment of a reply system of the present application. The reply system includes a processing module 30, a reply module 40, and a presentation module 50 coupled to one another.
Specifically, the processing module 30 is configured to obtain query information input by a user, and determine reference information matching the query information.
The reply module 40 is configured to obtain reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information.
The display module 50 is used for displaying the reply information and the associated information corresponding to the reply information.
In an embodiment, referring to fig. 11, the reply system further includes an information matching module 31 coupled to the processing module 30, where the information matching module 31 is configured to obtain a reference authority determined by a user; the reference authority is used for selecting recording data, and the recording data comprises at least one candidate data category; based on the query information and the reference rights, reference information matching the query information is determined.
In an implementation scenario, please continue to refer to fig. 11, the reply system provided in the present application further includes a rights acquisition module 32 coupled to the information matching module 31, where the rights acquisition module 32 is configured to generate a prompt message for prompting the user to select the reference rights; the prompt information comprises a selection frame for a user to select or deselect; and in response to detecting that the user selects the selection frame, acquiring the reference authority.
In one implementation scenario, the information matching module 31 determines reference information matching the query information based on the query information and the reference rights, including: displaying all candidate data categories included in the recorded data matched with the reference authority; in response to detecting that the user selects at least one candidate data category as the target category, listing data corresponding to the target category is used as the reference information.
In one implementation scenario, the information matching module 31 determines reference information matching the query information based on the query information and the reference rights, including: responsive to detecting that the user selects at least a portion of the listing data for which the presentation reference rights match, presenting the user-selected listing data; and acquiring a data segment selected by the user from the displayed recorded data as reference information matched with the query information.
In one embodiment, the reply module 40 obtains reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information, including: acquiring a preset template; obtaining task text based on a preset template, query information and reference information; and inputting the task text into the intelligent analysis model to obtain corresponding reply information and associated information.
The intelligent analysis model is deployed at the cloud end, and a synchronization identifier corresponds to the reference information for completing data synchronization.
In an embodiment, the display module 50 displays reply information and corresponding association information thereof, including: displaying the reply information on a display interface according to a target format; the reply information comprises at least one reply key point, each reply key point is provided with a corresponding guide identifier, and the guide identifiers are matched with the corresponding associated information; responding to the detection that the user selects the guide identifier, and displaying the associated information corresponding to the guide identifier selected by the user on a display interface according to an original format; wherein, the original format is the format of the associated information in the corresponding reference information.
In an implementation scenario, the guide identifier includes a guide superscript and a guide list, the guide superscript is located at a corresponding position of the reply key point, the guide list includes a description tag matched with the guide superscript, and the description tag includes part of key information in the corresponding associated information.
In an implementation scenario, in response to indexing a plurality of associated information by a user-selected guide identifier, the display module 50 displays the associated information corresponding to the user-selected guide identifier on a display interface according to an original format, including: and responding to the detection that the user switches the currently displayed associated information, and displaying the associated information adjacent to the currently associated information.
In an implementation scenario, in response to the reference information including the original audio segment, the associated information is a portion of the reference segment in the original audio segment, and the presenting module 50 presents the associated information corresponding to the guide identifier selected by the user on the presentation interface according to the original format, where the presenting module includes: displaying a playing progress bar corresponding to the original audio segment in a first area of a display interface, and marking the reference segment in the playing progress bar based on a starting time and a stopping time corresponding to the reference segment; and displaying the transcribed text corresponding to the original audio segment in a second area of the display interface, and highlighting the part of the transcribed text corresponding to the reference segment.
In an embodiment, referring to fig. 11, the reply system further includes an information inserting module 60 coupled to the display module 50, where the information inserting module 60 is configured to insert the reply information as target information into the target area of the display interface in response to detecting that the user selects to accept the reply information.
Referring to fig. 12, fig. 12 is a schematic structural diagram of an embodiment of an electronic device according to the present application. The electronic device includes: a memory 70 and a processor 80 coupled to each other. The memory 70 has stored therein program instructions for execution by the processor 80 to implement the reply method mentioned in any of the embodiments above. Specifically, the electronic device includes, but is not limited to: desktop computers, notebook computers, tablet computers, servers, etc., are not limited herein. Further, the processor 80 may also be referred to as a CPU (Center Processing Unit, central processing unit). The processor 80 may be an integrated circuit chip having signal processing capabilities. Processor 80 may also be a general purpose processor, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. In addition, the processor 80 may be commonly implemented by an integrated circuit chip.
Referring to fig. 13, fig. 13 is a schematic structural diagram of an embodiment of a computer readable storage medium 90 of the present application, where a program instruction 100 capable of being executed by a processor is stored in the computer readable storage medium 90, and the program instruction 100 implements the reply method mentioned in any of the foregoing embodiments when executed by the processor.
In the several embodiments provided in the present application, it should be understood that the disclosed methods and apparatus may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical, or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in part or all or part of the technical solution contributing to the prior art or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing description is only of embodiments of the present application, and is not intended to limit the scope of the patent application, and all equivalent structures or equivalent processes using the descriptions and the contents of the present application or other related technical fields are included in the scope of the patent application.

Claims (15)

1. A reply method, comprising:
acquiring inquiry information input by a user, and determining reference information matched with the inquiry information;
obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information;
and displaying the reply information and the corresponding association information.
2. The method of claim 1, wherein the determining the reference information that matches the query information comprises:
acquiring a reference authority determined by a user; wherein the reference rights are used to select listing data, the listing data comprising at least one candidate data category;
and determining reference information matched with the query information based on the query information and the reference authority.
3. The method of claim 2, wherein the obtaining the user-determined reference rights comprises:
generating prompt information for prompting a user to select the reference authority; the prompt message comprises a selection frame for a user to select or deselect;
and responding to detection of selection of the selection frame by a user, and acquiring the reference authority.
4. The method of claim 3, wherein the determining the reference information that matches the query information based on the query information and the reference rights comprises:
displaying all candidate data categories included in the recorded data matched with the reference authority;
and in response to detecting that a user selects at least one candidate data category as a target category, taking the recorded data corresponding to the target category as the reference information.
5. The method of claim 2, wherein the determining the reference information that matches the query information based on the query information and the reference rights comprises:
responsive to detecting a user selection to present at least a portion of the listing data for which the reference rights match, presenting the listing data selected by the user;
And acquiring a data segment selected by a user from the displayed recorded data as the reference information matched with the query information.
6. The method according to claim 1, wherein the obtaining reply information corresponding to the query information based on the query information and the reference information, and associated information associated with the reply information in the reference information, includes:
acquiring a preset template;
obtaining task text based on the preset template, the query information and the reference information;
and inputting the task text into an intelligent analysis model to obtain the corresponding reply information and the associated information.
7. The method of claim 6, wherein the intelligent analysis model is deployed in a cloud, and the reference information that is synchronized with the data by the cloud corresponds to a synchronization identifier.
8. The method of claim 1, wherein the presenting the reply information and the associated information corresponding thereto comprises:
displaying the reply information on a display interface according to a target format; the reply information comprises at least one reply key point, each reply key point is provided with a corresponding guide identifier, and the guide identifiers are matched with the corresponding associated information;
Responding to the detection that the user selects the guide identifier, and displaying the associated information corresponding to the guide identifier selected by the user on the display interface according to an original format; the original format is a format of the association information in the corresponding reference information.
9. The method of claim 8, wherein the guidance identification includes a guidance superscript located at a corresponding location of the reply keypoint and a guidance list including a description tag matching the guidance superscript, the description tag including a portion of the key information corresponding to the association information.
10. The method according to claim 9, wherein, in response to the guide identifier selected by the user indexing a plurality of associated information, the presenting the associated information corresponding to the guide identifier selected by the user in the presentation interface according to a raw format includes:
and responding to the detection of switching the currently displayed associated information by the user, and displaying the associated information adjacent to the currently displayed associated information.
11. The method of claim 8, wherein the responding to the reference information comprises an original audio piece, the associated information is a part of the reference piece in the original audio piece, and the displaying the associated information corresponding to the guide identifier selected by the user on the display interface according to an original format includes:
Displaying a playing progress bar corresponding to the original audio segment in a first area of a display interface, and marking the reference segment in the playing progress bar based on a starting time and a stopping time corresponding to the reference segment;
and displaying the transfer text corresponding to the original audio segment in a second area of the display interface, and highlighting a part of the transfer text corresponding to the reference segment.
12. The method according to claim 1, wherein after obtaining reply information corresponding to the query information based on the query information and the reference information, and association information associated with the reply information in the reference information, the method further comprises:
and in response to detecting that the user selects to accept the reply information, inserting the reply information into a target area of the display interface as target information.
13. A reply system, comprising:
the processing module is used for acquiring query information input by a user and determining reference information matched with the query information;
the reply module is used for obtaining reply information corresponding to the query information and associated information associated with the reply information in the reference information based on the query information and the reference information;
And the display module is used for displaying the reply information and the corresponding association information.
14. An electronic device, comprising: a memory and a processor coupled to each other, the memory having stored therein program instructions for executing the program instructions to implement the reply method of any one of claims 1 to 12.
15. A computer readable storage medium having stored thereon program instructions, which when executed by a processor implement the reply method of any one of claims 1 to 12.
CN202311384951.9A 2023-10-23 2023-10-23 Reply method, reply system and related device Pending CN117610664A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311384951.9A CN117610664A (en) 2023-10-23 2023-10-23 Reply method, reply system and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311384951.9A CN117610664A (en) 2023-10-23 2023-10-23 Reply method, reply system and related device

Publications (1)

Publication Number Publication Date
CN117610664A true CN117610664A (en) 2024-02-27

Family

ID=89950492

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311384951.9A Pending CN117610664A (en) 2023-10-23 2023-10-23 Reply method, reply system and related device

Country Status (1)

Country Link
CN (1) CN117610664A (en)

Similar Documents

Publication Publication Date Title
CN102349087B (en) Automatically providing content associated with captured information, such as information captured in real-time
US20200294487A1 (en) Hands-free annotations of audio text
US11366634B2 (en) Memory retention system
CN109871440B (en) Intelligent prompting method, device and equipment based on semantic analysis
US20160217704A1 (en) Information processing device, control method therefor, and computer program
Li et al. A new measure of text formality: An analysis of discourse of Mao Zedong
Fan et al. The accessibility of data visualizations on the web for screen reader users: Practices and experiences during covid-19
US10216989B1 (en) Providing additional information for text in an image
CN110308947A (en) Processing method, system, computer equipment and the storage medium of question and answer information
KR102287431B1 (en) Apparatus for recording meeting and meeting recording system
CN111933128B (en) Method and device for processing question bank of questionnaire and electronic equipment
CN110008314B (en) Intention analysis method and device
CN114254076B (en) Audio processing method, system and storage medium for multimedia teaching
CN117610664A (en) Reply method, reply system and related device
CN114492310B (en) Text labeling method, text labeling device, electronic equipment and storage medium
CN115640790A (en) Information processing method and device and electronic equipment
CN115511435A (en) Auxiliary recruitment method and device, electronic equipment and readable storage medium
Campos et al. Machine generation of audio description for blind and visually impaired people
CN114969542A (en) Information pushing method, server, device and system
CN116821323A (en) Summary generation method, system and related device
Bousbahi From poster to mobile calendar: an event reminder using mobile ocr
Seo et al. MAIDR: Making Statistical Visualizations Accessible with Multimodal Data Representation
CN116719460A (en) Important content interaction method and device, terminal, handwriting suite and storage medium
CN111046863B (en) Data processing method, device, equipment and computer readable storage medium
CN116862397A (en) Backlog extraction method, related device, terminal, kit and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination