CN110929122A

CN110929122A - Data processing method and device and data processing device

Info

Publication number: CN110929122A
Application number: CN201811101152.5A
Authority: CN
Inventors: 刘文文; 李琳; 潘牧野
Original assignee: Beijing Sogou Technology Development Co Ltd
Current assignee: Beijing Sogou Technology Development Co Ltd
Priority date: 2018-09-20
Filing date: 2018-09-20
Publication date: 2020-03-27
Anticipated expiration: 2038-09-20
Also published as: WO2020056948A1; CN110929122B

Abstract

The embodiment of the invention provides a data processing method and device and a device for data processing. The method specifically comprises the following steps: determining information to be replied from clipboard information; the information to be replied corresponds to all or part of the clipboard information; determining reply candidates corresponding to the information to be replied; and displaying the reply candidate. The embodiment of the invention can improve the reply efficiency and can realize intelligent reply in the reply scene of the cross-communication window.

Description

Data processing method and device and data processing device

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a data processing method and apparatus, and an apparatus for data processing.

Background

With the development of communication technology, communication applications such as short message applications and instant messaging applications can provide information interaction functions for users, so that information interaction can be performed among different users. For example, different users may send short messages to each other through a short message application. As another example, different users may also send messages to each other via an instant messaging application.

In practical applications, when a user receives a message sent by a correspondent node, the user usually needs to cut a proper sentence to reply the message, and the reply efficiency is low.

Disclosure of Invention

The embodiment of the invention provides a data processing method and device and a data processing device, which can improve the reply efficiency and can realize intelligent reply in a reply scene of a cross-communication window.

In order to solve the above problem, an embodiment of the present invention discloses a data processing method, including:

determining information to be replied from clipboard information; the information to be replied corresponds to all or part of the clipboard information;

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

On the other hand, the embodiment of the invention discloses a data processing device, which comprises:

the system comprises a to-be-replied information determining module, a to-be-replied information determining module and a reply receiving module, wherein the to-be-replied information determining module is used for determining the to-be-replied information from clipboard information; the information to be replied corresponds to all or part of the clipboard information;

a reply candidate determining module, configured to determine a reply candidate corresponding to the to-be-replied message; and

and the reply candidate display module is used for displaying the reply candidates.

In yet another aspect, an embodiment of the present invention discloses an apparatus for data processing, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by the one or more processors includes instructions for:

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

In yet another aspect, an embodiment of the invention discloses a machine-readable medium having stored thereon instructions, which, when executed by one or more processors, cause an apparatus to perform a data processing method as described in one or more of the preceding.

The embodiment of the invention has the following advantages:

the embodiment of the invention supports the user to carry the information to be replied through the clipboard, further determines the information to be replied from the clipboard information, and provides the reply candidate corresponding to the information to be replied, thereby improving the reply efficiency. The embodiment of the invention can be applied to the reply scene of the cross-communication window, and particularly, the user can copy the information in the first communication window and jump to the second communication window, so that the embodiment of the invention can automatically determine the information to be replied from the clipboard information and provide reply candidates corresponding to the information to be replied, thereby realizing intelligent reply in the reply scene of the cross-communication window and improving the reply efficiency.

The embodiment of the invention can also be applied to reply scenes in the communication window. The reply scene in the communication window is specifically as follows: the information received by the user is located in the same communication window as the information sent. For an operating system with a strict requirement on security, such as an IOS system, it cannot support directly reading the content of the screen, so the embodiment of the present invention may determine the information to be replied through the clipboard information.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a schematic representation of an application environment for a data processing method of an embodiment of the present invention;

FIG. 2 is a flow chart of steps of a first embodiment of a data processing method of the present invention;

FIG. 3 is a flowchart illustrating steps of a second embodiment of a data processing method according to the present invention;

FIG. 4 is a schematic of an interface according to an embodiment of the present invention;

FIG. 5 is a block diagram of an embodiment of a data processing apparatus of the present invention;

FIG. 6 is a block diagram of an apparatus 800 for data processing of the present invention; and

fig. 7 is a schematic diagram of a server in some embodiments of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides a data processing scheme, which can comprise the following steps: determining information to be replied from clipboard information; the information to be replied may correspond to all or part of the clipboard information; determining reply candidates corresponding to the information to be replied; and displaying the reply candidate.

In the embodiment of the invention, the clipboard is an area in the memory and is a plug-in a preset program, and through the clipboard, a user can transmit and share selected information among various application programs through simple actions of cutting, copying, pasting and the like. The clipboard temporarily stores the cut and copied information by using an internal resource storage of the terminal, or a virtual memory.

The preset program may specifically include: browser programs, instant messenger programs, social networking (e.g., microblog, forum, news, etc.) programs, and the like have clipboard functionality.

The information in the clipboard is selected by the user. The type of clipboard information may include at least one of the following types: text, picture, audio, video, and page address.

In practical applications, only one piece of information may be included in the clipboard; alternatively, multiple pieces of information may be included in the clipboard. For example, 3 pieces of information may be included in the clipboard, wherein the 1 st piece of information may be a text type, the 2 nd piece of information may be a voice type, the 3 rd piece of information may be a picture type, and so on. It is understood that the number of clipboard information and the specific type of clipboard information are not limited by the embodiments of the present invention.

The embodiment of the invention can be suitable for the reply scene of the cross-communication window. The cross-communication window may include: different communication windows of different applications, or different communication windows of the same application, etc.

Different windows for different applications may include: the communication window of the short message application and the communication window of the instant messaging application, or the communication window of the first instant messaging application and the communication window of the second instant messaging application, and the like. For example, the user a receives the message a sent by the user B through the short message application, and the corresponding short message charge is consumed for sending the short message, so that the embodiment of the invention supports the user a to send the corresponding reply of the message a to the user B through the instant messaging application. Correspondingly, the user A can copy the information A and jump to a communication window between the user A and the user B in the instant messaging application, so that the clipboard information (namely the content of the information A) can be used as the information to be replied, reply candidates are automatically provided for the user A to select, the user A can quickly reply under the condition of cross-scene, and the reply efficiency can be improved.

Different windows of the same application are described herein. For example, the user C receives the message B sent by the user D through the communication window a of the instant messaging application, and since the communication window a is a group window and a reply corresponding to the message B may relate to privacy, the embodiment of the present invention supports the user C to send the reply corresponding to the message B to the user D through the communication window B of the instant messaging application. Accordingly, the user C can copy the information B and jump to the communication window B between the user C and the user D in the instant messaging application, and the embodiment of the present invention can use the clipboard information (i.e., the content of the information B) as the information to be replied, and automatically provide the reply candidates for the user C to select, so that the user C can rapidly reply in the cross-scene situation, and further improve the reply efficiency. For example, the user D is the leader of the user C, the communication window a is the communication window of the work group, and the communication window B is the communication window between the user C and the user D, and it is inconvenient to reply to the message B in the communication window of the work group because the reply generated in the communication window of the work group may be seen by other users except the user C and the user D.

It should be noted that the above-mentioned user jumping to the second communication window is only an optional embodiment, and actually, the scheme of the embodiment of the present invention may not depend on the communication window jumping, even if the user does not jump the communication window, the embodiment of the present invention may still automatically determine the information to be replied from the clipboard information, and provide the reply candidate corresponding to the information to be replied.

The data processing method provided by the embodiment of the invention can be applied to Application environments such as websites and/or APPs (Application programs) to improve the reply efficiency. For example, the APP may be a communication application, the website may be a web page for providing communication services, and so on.

The data processing method provided by the embodiment of the present invention can be applied to the application environment shown in fig. 1, as shown in fig. 1, the client 100 and the server 200 are located in a wired or wireless network, and the client 100 and the server 200 perform data interaction through the wired or wireless network.

Optionally, the client 100 may run on a terminal, which specifically includes but is not limited to: smart phones, tablet computers, electronic book readers, MP3 (Moving Picture experts Group Audio Layer III) players, MP4 (Moving Picture experts Group Audio Layer IV) players, laptop portable computers, car-mounted computers, desktop computers, set-top boxes, smart televisions, wearable devices, and the like.

The client 100 may be an APP running on the device, such as an instant messaging APP, a short message APP, an input method APP, or an APP carried by the operating system itself, and the embodiment of the present application does not limit the specific APP corresponding to the client.

Method embodiment one

Referring to fig. 2, a flowchart illustrating steps of a first embodiment of a data processing method according to the present invention is shown, which may specifically include the following steps:

step 201, determining information to be replied from clipboard information; the information to be replied may correspond to all or part of the clipboard information;

step 202, determining reply candidates corresponding to the information to be replied;

and step 203, displaying the reply candidates.

At least one step of the method embodiment shown in fig. 2 may be executed by a server and/or a client, and of course, the specific execution subject of each step is not limited by the embodiment of the present invention.

The method embodiment of fig. 2 may correspond to a trigger condition.

According to an embodiment, the trigger condition may include: the input method keyboard is turned up. The input method keyboard is turned on, which indicates that the user wants to reply by inputting, and therefore, the method of the embodiment of the invention can be triggered.

According to another embodiment, the trigger condition may include: the clipboard information is updated. Updating the clipboard information may indicate that the user has generated new clipboard information indicating that the user has a reply request, and may therefore trigger the method of embodiments of the present invention.

According to yet another embodiment, the trigger condition may include: clipboard information is updated and the input method keypad is invoked. In this case, it is described that the user has a requirement to reply by inputting, and thus, the method of the embodiment of the present invention may be triggered.

According to yet another embodiment, the trigger condition may include: and jumping to a communication window after the clipboard information is updated. The jumping to the communication window may mean that the communication window is jumped from the interface before the clipboard operation, and in this case, it may be stated that the user wants to reply through the jumped communication window, so the method of the embodiment of the present invention may be triggered. The interface before the clipboard operation can be a communication window or a non-communication window.

According to yet another embodiment, the trigger condition may include: after the clipboard information is updated, a jump is made to the communication window, and the input method keyboard is invoked.

It should be understood that the above-mentioned trigger condition is only used as an alternative embodiment, and actually, a person skilled in the art may determine the above-mentioned trigger condition according to the actual application requirement, for example, the above-mentioned trigger condition may also be a preset gesture of a user, and the embodiment of the present invention does not limit the specific trigger condition.

In step 201, clipboard information may be obtained by accessing a clipboard. The clipboard information may include: a piece of content, or a plurality of pieces of content. For example, in response to a long-press operation of a user, a selection interface corresponding to each piece of information can be displayed in the communication window, so that the user can select at least one piece of information required to be copied

Step 201 may determine information to be replied from the clipboard information, where the information to be replied may correspond to all or part of the clipboard information. For example, clipboard information may include: the information and the sender identification of the information can filter the sender identification from the clipboard information, and the information can be reserved as the information to be replied.

In this embodiment of the present invention, optionally, the type of the clipboard information may include at least one of the following types: text, picture, audio, video, and page address. The embodiment of the invention can determine at least one type of information to be replied and determine the corresponding reply candidate aiming at the at least one type of information to be replied.

The embodiment of the invention can provide the following technical scheme for determining the reply candidate corresponding to the information to be replied:

in technical scheme 1, the step 202 of determining the reply candidate corresponding to the message to be replied specifically may include: determining a theme corresponding to the information to be replied; and determining reply candidates corresponding to the information to be replied according to the theme.

A topic may refer to a central idea represented by a message to be replied. The embodiment of the invention can represent the theme through the theme key words, and the theme key words can refer to the key words of the theme capable of reflecting the information to be replied.

Optionally, the determining the topic corresponding to the message to be replied may specifically include:

determining a mode A1, and determining a theme corresponding to a page address according to the content of the page corresponding to the page address; and/or

Determining a mode A2, performing first identification on a video stream and/or an audio stream corresponding to a video, and determining a theme corresponding to the video according to an obtained first identification result; and/or

Determining a mode A3, performing second identification on the picture, and determining a theme corresponding to the picture according to an obtained second identification result; and/or

Determining a mode A4, performing voice recognition on the audio, and determining a theme corresponding to the information to be replied according to the obtained voice recognition result.

Video is typically composed of still pictures, which are referred to as video frames. A video stream corresponding to a video may be used to represent successive video frames. The audio stream corresponding to the video can be used to represent a continuous audio signal, and the audio stream has synchronization with the continuous video frames to achieve the effect of synchronous playing of the video picture and the audio.

In practical applications, the audio stream corresponding to the video may correspond to video content such as a speech, a score, and the score may include: theme music, inserting music, tail music, background music corresponding to the lines and the like. It is understood that the embodiment of the present application does not impose a limitation on the specific video content corresponding to the audio stream.

In practical applications, the video stream and the Audio stream corresponding to the video may be located in the same file, in this case, the Audio may be extracted from the video file, and specifically, the video file may be converted into an Audio file, for example, a video file in MP4 (Moving Picture Experts Group Audio Layer 4) format may be converted into an Audio file in MP3 (Moving Picture Experts Group Audio Layer III) format, and the like. Or, the video stream and the audio stream corresponding to the video may be located in separate files, that is, the video file and the audio file may be separate, and in this case, the audio file may be directly obtained. The audio file may include an audio stream corresponding to a video, so that the audio stream corresponding to the video may be read from the audio file.

In practical application, a plurality of video frames can be extracted from a video according to a preset time interval, and the extracted video frames can be used as an object of image recognition. It is understood that, a person skilled in the art may determine the preset time interval according to practical application requirements, for example, the preset time interval may be a playing time length corresponding to N video frames, where N is a positive integer, and it is understood that the embodiment of the present application does not limit specific N and the preset time interval.

The embodiment of the application can identify the video stream and/or the audio stream corresponding to the video by adopting the following identification modes:

the identification method comprises the steps of 1, carrying out image identification on a video stream corresponding to a video to obtain corresponding image target information; and/or

The identification mode 2 is used for carrying out text identification on the video stream corresponding to the video to obtain corresponding text information; and/or

And 3, performing voice recognition on the audio stream corresponding to the video to obtain corresponding text information.

In recognition mode 1, image recognition refers to a technique of processing, analyzing, and understanding an image by a machine to recognize various different patterns of image objects. In particular to the embodiments of the present application, techniques for processing, analyzing, and understanding video frames with a machine to identify various different patterns of image objects may be utilized. In general, an image object in a video frame may correspond to a certain image area in the video frame, and the image object in the video frame may include: items, people, spaces, etc. For example, the person may be a person in the video frame, the article may be an article worn by the person in the video frame, and the space may be an environmental space in which the person is located in the video frame, such as an outdoor environment, an indoor environment, and the like, for example, the indoor environment may include information of indoor walls, floors, and the like, and it is understood that the embodiment of the present application is not limited to a specific image object in the video frame.

In an optional embodiment of the present application, the process of performing image recognition on video frames corresponding to a video stream and/or an audio stream may include: the method includes the steps of detecting an image target in a video frame, and analyzing the obtained image target by using a depth learning method to obtain corresponding image target information, so that the identification result of the embodiment of the application can include: and image target information corresponding to the video frame. The image object information may include: the image of the image object (i.e. the image of the image object in the video frame, the image object usually corresponds to a certain closed region in the video frame), and the recognition result of the image object (such as the name, category, etc. of the recognized image object). For example, a face detection technique may be used to detect a face in a video frame, and a deep learning method may be used to analyze the face to obtain information such as gender, age, etc. of a person, and even to obtain a source of the person, such as from which movie or television show, etc., and even to obtain which celebrity the person is. Furthermore, articles worn by the person, such as clothes, shoes, worn watches, jewelry and the like, can be detected. Alternatively, spatial information or the like in which the person is located may be detected.

The text information in the video frame may include: text information included in the image, and/or text information in the subtitle.

For the recognition mode 2, text recognition technology may be used to perform text recognition on video frames corresponding to the video stream and/or the audio stream. The text recognition techniques described above may include: an OCR (Optical character recognition) technology, which may segment characters in an image after preprocessing such as noise reduction is performed on the image to obtain a single character image, and recognize characters corresponding to the single character image. It is to be understood that the embodiments of the present application are not limited to the specific text recognition technology.

For the identification mode 2, a subtitle file corresponding to the subtitle of the video frame can be obtained, and text information in the subtitle can be obtained from the subtitle file; or, a picture corresponding to the video frame may be subjected to screen capture, and text recognition may be performed on the captured image, so as to obtain text information in the subtitle. It can be understood that the embodiment of the present application does not impose a limitation on the specific manner of acquiring the text information in the subtitles.

For the recognition mode 3, a voice recognition technology can be adopted to convert the audio stream corresponding to the video into text information. If the audio stream corresponding to the video is denoted as S, a series of processing is performed on S to obtain a speech feature sequence O corresponding to S, which is denoted as O ═ O1, O2, …, Oi, …, OT }, where Oi is the ith speech feature and T is the total number of speech features. The sentence corresponding to the audio stream S can be regarded as a word string composed of many words, and is denoted by W { W1, W2, …, wn }, where n is a natural number. The process of speech recognition is to find the most likely word string W based on the known speech feature sequence O.

Specifically, the speech recognition is a model matching process, in which a speech model is first established according to the speech characteristics of a person, and a template required for the speech recognition is established by extracting required features through analysis of an input speech signal; the process of recognizing the voice input by the user is a process of comparing the characteristics of the voice input by the user with the template, and finally determining the best template matched with the voice input by the user so as to obtain a voice recognition result. The specific speech recognition algorithm may adopt a training and recognition algorithm based on a statistical hidden markov model, or may adopt other algorithms such as a training and recognition algorithm based on a neural network, a recognition algorithm based on dynamic time warping matching, and the like.

In an application example of the present invention, a user G receives a web address a sent by a user H and copies the web address a, and then the embodiment of the present invention may automatically analyze the page content of the web address a to obtain a topic a corresponding to the web address a, where the topic a may relate to the eight trigrams for entertainment, the national citizens, and the like, and automatically give a reply candidate corresponding to the topic a, such as "i also see the web page", or "i also like the content corresponding to the topic a".

In another application example of the present invention, the user I receives the video a sent by the user J, and copies the video a, and then the embodiment of the present invention may automatically identify the video a to obtain a theme B corresponding to the video a, where the theme B may relate to the life of a child in a kindergarten, and automatically give a reply candidate corresponding to the theme B, such as "the child seems to be happy in the kindergarten", and the like.

In another application example of the present invention, the user K receives the picture a sent by the user L and copies the picture a, and then the embodiment of the present invention may automatically identify the picture a to obtain the theme C corresponding to the picture a, where the theme C may relate to a piece of clothes, such as a jacket, a down jacket, a skirt, and the like, and automatically give the reply candidate corresponding to the theme C, such as "the theme C is very beautiful and worthy of purchase", "the theme C is a little old and comfortable", "the theme C is fattened", and the like.

The embodiment of the invention can provide the following determination mode for determining the theme corresponding to the information to be replied:

determining a mode B1, and determining a topic keyword corresponding to the information to be replied by adopting a TF-IDF (term frequency-inverse document frequency algorithm) method.

The main idea of TF-IDF is: if a word or phrase appears frequently in a document or a piece of text with high frequency TF and rarely appears in other documents or texts, the word or phrase is considered to have good classification capability and is suitable for classification.

Determining a mode B2, and determining a topic keyword corresponding to the information to be replied by adopting an LDA (Latent Dirichlet Allocation) model.

The LDA model is a document generation model and is an unsupervised machine learning technology. It considers a document or a piece of text to have multiple topics, and each topic corresponds to a different topic keyword. The process of constructing a document or a text includes firstly selecting a theme with a certain probability, and then selecting a theme keyword with a certain probability under the theme, thereby generating a first theme keyword of the document. Repeating this process generates a document or text. The LDA is used as the inverse process of the document generation process, namely, the topics of a document or a section of text and topic keywords corresponding to the topics are found according to the document or the section of text.

And determining a mode B3, determining a category corresponding to the information to be replied by adopting a classification model, and obtaining the topic keyword according to the information of the category. The classification model may include: a fasttext model. The fastText model may output, for an input sequence of words (a piece of text or a sentence), the probability that the sequence of words belongs to different categories. The fastText model can form a feature vector by words and phrases in a word sequence, the feature vector is mapped to the middle layer through linear transformation, and the middle layer is mapped to the corresponding preset category. Optionally, the fastText may use a non-linear activation function in the process of mapping to the corresponding preset category. The fastText has the advantages of high speed and high accuracy, and the specific classification model is not limited in the embodiment of the invention.

It can be understood that, according to the actual application requirements, a person skilled in the art may adopt any one or a combination of the determination method B1 through the determination method B3, and the embodiment of the present invention does not limit the specific process of determining the topic corresponding to the information to be replied.

According to the embodiment of the invention, the reply candidate corresponding to the information to be replied can be determined according to the theme. Alternatively, the message to be replied is notification type information, in which case, the reply candidate may be "received", "good", and the like. The corresponding theme of the information to be replied "come to the meeting room" may be "place notice", and the corresponding theme of the information to be replied "your planning scheme has a place to be modified" may be "work modification notice".

Alternatively, the information to be replied to may be query type information, in which case, the reply candidate may be a positive type candidate, a negative type candidate, one of a plurality of options, or an answer to a question. For example, if the information to be replied is "go to a site a or a site B to eat tomorrow", the corresponding reply candidate may include: location a, or location B. For another example, if the information to be replied is "do you have left work", the corresponding reply candidate may include: lower, or not lower. For another example, if the information to be replied is "what you are doing", the corresponding reply candidates may include: eating, watching video, etc.

Technical scheme 2,

In technical scheme 2, the step 202 of determining the reply candidate corresponding to the message to be replied may specifically include: according to the information to be replied, searching in the mapping relation between the data to be replied and the reply data to obtain a reply candidate corresponding to the information to be replied; the mapping relationship may be obtained according to historical communication data corresponding to at least one user, where the historical communication data may include: historical data to be replied and historical reply data corresponding to the historical data.

In a specific implementation process, the mapping relationship can be determined in the following manner: obtaining historical communication data of at least one user; the historical communication data may include: historical data to be replied and historical reply data corresponding to the historical data to be replied; extracting corresponding historical reply content of each piece of historical data to be replied; and taking the history reply content which corresponds to the history data to be replied and meets the preset condition as the reply data which corresponds to the history data to be replied, so that the mapping relation can be determined according to the history data to be replied and the reply data corresponding to the history data to be replied.

The user may be a user of the current terminal, or may be at least one sampling user in the whole network, and the obtained historical communication data is also different, for example:

①, at least one group of historical communication data generated by the user of the current terminal can be obtained, for example, reply data of the user for communication content can be obtained, at least one group of question-answer pairs can be extracted from the reply data, each group of question-answer pairs can comprise communication content and reply content for corresponding communication content, and the at least one group of question-answer pairs is the at least one group of historical communication data generated by the user.

For example, the terminal may often receive the short message "several hours of work.

②, acquiring the at least one group of historical communication data generated by the at least one sampling user, such as all users in the system, part of users in the system, etc., based on the scheme, the historical communication data of each user does not need to be analyzed separately, thereby improving the acquisition efficiency of the historical communication data.

After obtaining at least one group of historical communication data, the historical data to be replied in each group of historical communication data may be obtained first, and then the same historical data to be replied is merged to obtain all the historical data to be replied contained in the historical communication data, where the historical data to be replied in one group of historical communication data refers to the communication context and the historical reply data is the reply content generated for the communication context; alternatively, the historical data to be replied in the set of historical communication data refers to the network questioning data, and the historical reply data is an answer generated for the network questioning data, and the like.

After all the historical data to be replied contained in the historical communication data are obtained, the corresponding historical reply data can be obtained for each piece of historical data to be replied, and the occurrence frequency of each piece of historical reply data is obtained.

Further, after obtaining each piece of historical data to be replied and the corresponding historical reply data, historical reply data of which the occurrence times are greater than a preset number (for example, 20, 30, and the like) can be obtained for each piece of historical data to be replied as the corresponding reply data; the historical reply data can also be sorted from high to low according to the occurrence times, and then the historical reply data sorted in the first few bits (for example, 4, 5, etc.) is obtained as the reply data, and the like, so that the mapping relationship between the data to be replied and the reply data can be obtained.

Taking the number of occurrences of the data to be replied is greater than the preset number (for example, 20) as an example, the data to be replied "what is off duty.

Technical scheme 3,

In technical scheme 3, the step 202 of determining the reply candidate corresponding to the message to be replied may specifically include: extracting first characteristic information of the information to be replied; determining a first reply rule corresponding to the first characteristic information based on a corresponding relation between the pre-established characteristic information and the reply rule; determining at least one reply candidate by the first reply rule.

For example, the characteristic information is, for example, a preset sentence format and the like, the preset sentence is, for example, "eat and eat at home", "several sleep", "good and do", and the like, the preset sentence format is, for example, "you go to XX and XX for eating today", "eat and XX today" (XX is a default word) and the like, in the specific implementation process, a corresponding reply rule can be respectively constructed for each kind of characteristic information, for example, a reply rule can be constructed for "eat and do not go to eat" ① has already eaten ② and has not yet eaten ③ to prepare to eat, a reply rule can be constructed for "today go to ten thousand pea meal or go to fragrant eat" to have ① ten thousand state pea meal ② to perfume, and other reply rules can be constructed, and the embodiment of the invention is not limited.

As an alternative embodiment, the determining the at least one reply candidate by the first reply rule includes: extracting at least one specific keyword in the information to be replied; combining the at least one specific keyword with the first reply rule to obtain the at least one reply candidate.

For example, assuming that the preset sentence format is "you intend to go XX to eat or XX to eat today", the reply rule constructed for it is that i go XX to eat today, where XX represents a default item in the information to be replied, e.g., the first data to be replied is "you intend to go home to eat or go chang to eat," then the default word (i.e., the specific keyword) includes going home, chang, and thus the constructed at least one reply candidate includes ① i go a restaurant to eat today, ② i go B restaurant to eat today.

Technical scheme 4,

In technical scheme 4, the step 202 of determining the reply candidate corresponding to the message to be replied may specifically include: determining user state information through an application program in a running state of a terminal; and determining reply candidates corresponding to the information to be replied according to the user state information.

Technical solution 4 uses user state information in the process of generating a reply candidate, and the user state information obtained by the application program in the running state can reflect the use condition of the user for the application program, for example, when the user receives information from the correspondent node through the terminal or when the user replies to the information from the correspondent node through the terminal, the use condition of the user for the application program may specifically include: the user can carry deep information except for judgment reply according to a series of user actions such as setting, browsing, purchasing and watching generated by the APP in the running state, so that the reply candidate can be matched with the accurate reply intention of the user, and the accuracy and the richness of the quick reply candidate are improved. And under the condition that the reply candidate is matched with the accurate reply intention of the user, the user can directly use the reply candidate to reply the information, and the input cost of the user in replying the information can be further reduced, so that the reply efficiency can be improved.

For example, when the user M receives a short message, the user M is watching a video through the video APP, so that corresponding user state information can be acquired through the video APP, and when the content of the short message is a problem such as "on dry", reply candidates such as "watching a video", "watching a tv play", and the like can be generated according to the user state information; alternatively, when the content of the short message is, for example, "has eaten", reply candidates such as "has not watched the video", "has not yet watched the tv play", "has eaten while watching the tv play" and the like may be generated based on the user status information.

The process of determining the reply candidate corresponding to the information to be replied is described in detail in the foregoing technical solutions 1 to 4, and it can be understood that a person skilled in the art may adopt any one or a combination of the technical solutions 1 to 4 or may also adopt other technical solutions according to the actual application requirements, and the embodiment of the present invention does not limit the specific process of determining the reply candidate corresponding to the information to be replied.

Step 203 may present the reply candidates for selection by the user. Optionally, in response to a trigger operation of the user on any reply candidate, a target reply candidate corresponding to the trigger operation may be selected on a screen, where the screen may be: and outputting the target reply candidate to an input box of a communication window.

According to an embodiment, the displaying the reply candidate may specifically include: and displaying the reply candidates above the input method keyboard. After the input method keyboard is turned on, at least one reply candidate may be presented above the input method keyboard without any input string being generated by the user, or with any input string being generated. According to another embodiment, the reply candidates may be presented by means of a pop window or a cover layer. It is to be understood that the embodiment of the present invention does not limit the specific display manner of the reply candidates.

In an optional embodiment of the present invention, the step 203 of displaying the reply candidate may specifically include: sequencing the reply candidates according to the social relationship between the home terminal user and the opposite terminal user; and displaying the plurality of sorted reply candidates.

In practical application, the social relationship between the home terminal user and the opposite terminal user can be determined in the following way: acquiring communication content between the opposite end user and the local end user; extracting a first preset keyword contained in the communication content; and determining the social relationship between the local user and the opposite user based on the first preset keyword.

For example, a database may be preset, where the database includes at least one social relationship and a keyword corresponding to each social relationship. Keywords such as "lovers' relationships" may include: keywords of "Cimida", "Honey", "lovely", "couple" relations may include: keywords for "wife," "husband," and "colleague relationship" may include: "project", "# worker", "Leader", "Madam", and the like.

And then after the communication content between the opposite end user and the home end user is obtained, whether the communication content contains any keyword can be judged, if yes, the keyword is extracted to be used as a first preset keyword, and then the social relationship is determined through the first preset keyword.

Optionally, for each reply candidate, the probability that the reply candidate belongs to the social relationship can be determined, and then a plurality of reply candidates are output after being sorted according to the probability, for example, if the social relationship is a lover relationship, the reply candidates comprise ① late Ann ② Ann ③ late Ann and lovely, and the probabilities that the three reply candidates belong to the lover relationship are respectively 0.1, 0.6 and 0.9, the three reply candidates can be output according to the following sorting modes of ① late Ann and lovely ② Ann ③ late Ann.

In summary, the data processing method according to the embodiment of the present invention supports a user to carry information to be replied through a clipboard, and further determines information to be replied from the clipboard information, and provides reply candidates corresponding to the information to be replied, so that the reply efficiency can be improved. The embodiment of the invention can be applied to the reply scene of the cross-communication window, and particularly, the user can copy the information in the first communication window and jump to the second communication window, so that the embodiment of the invention can automatically determine the information to be replied from the clipboard information and provide reply candidates corresponding to the information to be replied, thereby realizing intelligent reply in the reply scene of the cross-communication window and improving the reply efficiency.

Method embodiment two

Referring to fig. 3, a flowchart illustrating steps of a second embodiment of the data processing method of the present invention is shown, which may specifically include the following steps:

step 301, determining information to be replied from clipboard information; the information to be replied may correspond to all or part of the clipboard information;

step 302, determining reply candidates corresponding to the information to be replied;

step 303, displaying the reply candidate and the clipboard information.

The embodiment of the invention can display the reply candidate and the clipboard information at the same time, thus realizing the contrast display effect between the clipboard information and the reply candidate, and leading a user to know that the reply candidate is replied aiming at the clipboard information.

Referring to fig. 4, a schematic diagram of an interface according to an embodiment of the present invention is shown, which may specifically include: a communication window 401 and an input method interface 402;

among them, the communication window 401 may include: communication content and input boxes. Taking the communication window between the user a and the user B as an example, the communication content may include: communication content 1 sent by user B and communication content 2 sent by user a, etc.

Input method interface 402 may include: an input method keyboard 421, a clipboard information area 422 and a reply candidate area 423, wherein the clipboard information area 422 can be located on the input method keyboard 421, and the clipboard information area 422 can cover a part or all of the input method tools; the reply candidate area 423 may be located in the clipboard information area 423.

Clipboard information area 422 may include: clipboard information, and prompt information corresponding to the clipboard information, such as "from the clipboard".

The reply candidate region 423 may include: n (n is a natural number) reply candidates and corresponding prompt information, such as 'intelligent reply' and the like.

If a click operation of the user on one reply candidate is received, the target reply candidate corresponding to the click operation can be output to the input box.

In an optional embodiment of the present invention, it may be determined whether the communication content of the communication window includes the clipboard information, if so, the clipboard information is not displayed, otherwise, the clipboard information is displayed. The above judgment can avoid the duplication of clipboard information.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Device embodiment

Referring to fig. 5, a block diagram of a data processing apparatus according to an embodiment of the present invention is shown, which may specifically include:

a to-be-replied information determining module 501, configured to determine to-be-replied information from the clipboard information; the information to be replied may correspond to all or part of the clipboard information;

a reply candidate determining module 502, configured to determine a reply candidate corresponding to the message to be replied; and

a reply candidate display module 503, configured to display the reply candidates.

Optionally, the apparatus may further include:

and the clipboard information display module is used for displaying the clipboard information.

Optionally, the reply candidate display module 503 is specifically configured to display the reply candidate above the input method keyboard.

Optionally, the type of clipboard information may include at least one of the following types: text, picture, audio, video, and page address.

Optionally, the reply candidate determination module 502 may include:

the theme determining module is used for determining a theme corresponding to the information to be replied;

and the candidate determining module is used for determining reply candidates corresponding to the information to be replied according to the theme.

Optionally, the topic determination module may include:

the first theme determining module is used for determining a theme corresponding to the page address according to the content of the page corresponding to the page address; and/or

The second theme determining module is used for performing first identification on the video stream and/or the audio stream corresponding to the video and determining the theme corresponding to the video according to the obtained first identification result; and/or

The third theme determining module is used for carrying out second identification on the picture and determining a theme corresponding to the picture according to an obtained second identification result; and/or

And the fourth theme determining module is used for performing voice recognition on the audio and determining a theme corresponding to the information to be replied according to the obtained voice recognition result.

Optionally, the reply candidate determination module 502 may include:

the searching module is used for searching in the mapping relation between the data to be replied and the reply data according to the information to be replied so as to obtain a reply candidate corresponding to the information to be replied;

the mapping relationship is obtained according to historical communication data corresponding to at least one user, and the historical communication data may include: historical data to be replied and historical reply data corresponding to the historical data.

Optionally, the reply candidate presentation module 503 may include:

the sorting module is used for sorting the reply candidates according to the social relationship between the home terminal user and the opposite terminal user;

and the sequencing display module is used for displaying the sequenced reply candidates.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

An embodiment of the present invention provides an apparatus for data processing, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for: determining information to be replied from clipboard information; the information to be replied corresponds to all or part of the clipboard information; determining reply candidates corresponding to the information to be replied; and displaying the reply candidate.

Fig. 6 is a block diagram illustrating an apparatus 800 for data processing in accordance with an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 6, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice data processing mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on radio frequency data processing (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Fig. 7 is a schematic diagram of a server in some embodiments of the invention. The server 1900, which may vary widely in configuration or performance, may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a series of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.

The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform the data processing method shown in fig. 2 or 3.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform a data processing method, the method comprising: determining information to be replied from clipboard information; the information to be replied corresponds to all or part of the clipboard information; determining reply candidates corresponding to the information to be replied; and displaying the reply candidate.

The embodiment of the invention discloses A1 and a data processing method, wherein the method comprises the following steps:

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

A2, the method of A1, the method further comprising:

and displaying the clipboard information.

A3, the method of A1 or A2, the presenting the reply candidates, comprising:

and displaying the reply candidates above the input method keyboard.

A4, the method of A1 or A2, the type of clipboard information comprising at least one of: text, picture, audio, video, and page address.

A5, according to the method of A1 or A2, the determining reply candidates corresponding to the information to be replied includes:

determining a theme corresponding to the information to be replied;

and determining reply candidates corresponding to the information to be replied according to the theme.

A6, according to the method in A5, the determining the topic corresponding to the information to be replied includes:

determining a theme corresponding to a page address according to the content of the page corresponding to the page address; and/or

Performing first identification on a video stream and/or an audio stream corresponding to a video, and determining a theme corresponding to the video according to an obtained first identification result; and/or

Performing second identification on the picture, and determining a theme corresponding to the picture according to an obtained second identification result; and/or

And performing voice recognition on the audio, and determining a theme corresponding to the information to be replied according to the obtained voice recognition result.

A7, according to the method of A1 or A2, the determining reply candidates corresponding to the information to be replied includes:

according to the information to be replied, searching in the mapping relation between the data to be replied and the reply data to obtain a reply candidate corresponding to the information to be replied;

the mapping relation is obtained according to historical communication data corresponding to at least one user, and the historical communication data comprises: historical data to be replied and historical reply data corresponding to the historical data.

A8, the method of A1 or A2, the presenting the reply candidates, comprising:

sequencing the reply candidates according to the social relationship between the home terminal user and the opposite terminal user;

and displaying the plurality of sorted reply candidates.

The embodiment of the invention discloses B9 and a data processing device, which comprises:

B10, the apparatus of B9, the apparatus further comprising:

B11, the device according to B9 or B10, the reply candidate display module is used for displaying the reply candidate above an input method keyboard.

B12, the apparatus of B9 or B10, the type of clipboard information comprising at least one of: text, picture, audio, video, and page address.

B13, the apparatus of B9 or B10, the reply candidate determination module comprising:

B14, the apparatus of B13, the topic determination module comprising:

B15, the apparatus of B9 or B10, the reply candidate determination module comprising:

B16, the device of B9 or B10, the reply candidate show module comprising:

The embodiment of the invention discloses C17, an apparatus for data processing, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors comprise instructions for:

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

C18, the device of C17, the device also configured to execute the one or more programs by one or more processors including instructions for:

and displaying the clipboard information.

C19, the device of C17 or C18, the showing the reply candidates, comprising:

and displaying the reply candidates above the input method keyboard.

C20, the apparatus according to C17 or C18, the type of clipboard information including at least one of the following types: text, picture, audio, video, and page address.

C21, the determining reply candidates corresponding to the information to be replied according to the apparatus of C17 or C18 includes:

determining a theme corresponding to the information to be replied;

C22, according to the device of C21, the determining the theme corresponding to the information to be replied includes:

C23, the determining reply candidates corresponding to the information to be replied according to the apparatus of C17 or C18 includes:

C24, the device of C17 or C18, the showing the reply candidates, comprising:

and displaying the plurality of sorted reply candidates.

Embodiments of the present invention disclose D25, a machine-readable medium having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform a data processing method as described in one or more of a 1-a 8.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

The data processing method, the data processing apparatus and the apparatus for data processing provided by the present invention are described in detail above, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A method of data processing, the method comprising:

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

2. The method of claim 1, further comprising:

and displaying the clipboard information.

3. The method of claim 1 or 2, wherein said presenting the reply candidate comprises:

and displaying the reply candidates above the input method keyboard.

4. The method of claim 1 or 2, wherein the type of clipboard information comprises at least one of the following types: text, picture, audio, video, and page address.

5. The method according to claim 1 or 2, wherein the determining the reply candidate corresponding to the message to be replied includes:

determining a theme corresponding to the information to be replied;

6. The method according to claim 5, wherein the determining the topic corresponding to the message to be replied comprises:

7. The method according to claim 1 or 2, wherein the determining the reply candidate corresponding to the message to be replied includes:

8. A data processing apparatus, comprising:

9. An apparatus for data processing, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein execution of the one or more programs by one or more processors comprises instructions for:

determining reply candidates corresponding to the information to be replied;

and displaying the reply candidate.

10. A machine-readable medium having stored thereon instructions which, when executed by one or more processors, cause an apparatus to perform a data processing method as claimed in one or more of claims 1 to 7.