CN113535015A - Information recommendation method and device and electronic equipment - Google Patents

Abstract

The embodiment of the invention provides an information recommendation method, an information recommendation device and electronic equipment, wherein the method comprises the following steps: acquiring input information, wherein the input information comprises a picture; identifying the picture and determining the associated information of the picture; displaying the associated information of the picture; acquiring input information containing a picture, identifying the picture, determining associated information of the picture and displaying the associated information of the picture; the user can directly select the displayed associated information to be displayed on the screen without searching and manually inputting the associated information of the picture by the user; the input efficiency is improved.

Description

Information recommendation method and device and electronic equipment

Technical Field

The invention relates to the technical field of input methods, in particular to an information recommendation method, an information recommendation device and electronic equipment.

Background

With the development of computer technology, electronic devices such as mobile phones and tablet computers are more and more popular, and great convenience is brought to life, study and work of people. These electronic devices are typically installed with an input method application (abbreviated as input method) so that a user can input information using the input method.

In order to facilitate quick input of a user, a recommendation function is configured in the input method, namely information recommendation is performed based on the above, for example, "do you eat at night? ", the recommended information may include" eaten "and" not eaten ". At present, the input method can only recommend the information related to the text, and the text can also contain the picture; when the picture is included in the above, the input method cannot recommend information related to the picture. When a user needs to input information related to the pictures, the information needs to be manually searched and input word by word, and the input efficiency is low.

Disclosure of Invention

The embodiment of the invention provides an information recommendation method for improving input efficiency.

Correspondingly, the embodiment of the invention also provides an information recommendation device and electronic equipment, which are used for ensuring the realization and application of the method.

In order to solve the above problem, an embodiment of the present invention discloses an information recommendation method, which specifically includes: acquiring input information, wherein the input information comprises a picture; identifying the picture and determining the associated information of the picture; and displaying the associated information of the picture.

Optionally, the associated information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the object in the picture; when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result; and determining attribute information of the object in the picture according to the picture identification result.

Optionally, the identifying the picture to obtain a corresponding picture identification result includes: converting the picture into corresponding picture vectors by adopting a picture identification model, and calculating the similarity between the picture vectors and each preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

Optionally, the determining attribute information of the object in the picture according to the picture recognition result includes: acquiring a pre-established mapping relation, wherein the mapping relation comprises a relation between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; according to the mapping relation, searching attribute information corresponding to the preset picture vector with the highest similarity; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the authenticity of the object in the picture; and when the user is determined to have the intention of identifying the authenticity of the object in the picture, carrying out authenticity identification on the object in the picture, and determining authenticity information corresponding to the object in the picture.

Optionally, the performing the authenticity identification on the object in the picture to determine the authenticity information corresponding to the object in the picture includes: performing authenticity identification on the object in the picture by adopting a classification model, and outputting probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

Optionally, the authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; the generating the authenticity information according to the probability information of the authenticity identification result comprises: using the probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

Optionally, the input information further includes interaction information and input environment information, and the determining whether the user has an intention to identify the authenticity of the object in the picture includes: and judging whether the user has the intention of identifying the authenticity of the object in the picture according to the input environment information and the interaction information.

The embodiment of the invention also discloses a data processing device, which specifically comprises: the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring input information, and the input information comprises pictures; the identification module is used for identifying the picture and determining the associated information of the picture; and the display module is used for displaying the associated information of the picture.

Optionally, the associated information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

Optionally, the identification module comprises: the intention identification submodule is used for judging whether the user has the intention of identifying the object in the picture; the picture result identification submodule is used for identifying the picture to obtain a corresponding picture identification result when the user is determined to have the intention of identifying the object in the picture; and the attribute identification submodule is used for determining the attribute information of the object in the picture according to the picture identification result.

Optionally, the picture result identification sub-module is configured to convert the picture into a corresponding picture vector by using a picture identification module, and calculate a similarity between the picture vector and a preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

Optionally, the attribute identification sub-module is configured to obtain a pre-established mapping relationship, where the mapping relationship includes a relationship between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

Optionally, the identification module comprises: the authenticity identification submodule is used for judging whether the user has the intention of identifying the authenticity of the object in the picture; and the authenticity result determining sub-module is used for identifying the authenticity of the object in the picture and determining the authenticity information corresponding to the object in the picture when determining that the user has the intention of identifying the authenticity of the object in the picture.

Optionally, the authenticity result determining sub-module is configured to perform authenticity identification on the object in the picture by using a classification model, and output probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

Optionally, the authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; the authenticity result determining submodule is used for taking the probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

Optionally, the input information of the obtaining module further includes interaction information and input environment information; and the authenticity identification submodule is used for judging whether the user has the intention of identifying the authenticity of the object in the picture according to the input environment information and the interaction information.

The embodiment of the invention also discloses a readable storage medium, and when instructions in the storage medium are executed by a processor of the electronic equipment, the electronic equipment can execute the information recommendation method in any one of the embodiments of the invention.

An embodiment of the present invention also discloses an electronic device, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by one or more processors, and the one or more programs include instructions for: acquiring input information, wherein the input information comprises a picture; identifying the picture and determining the associated information of the picture; and displaying the associated information of the picture.

Optionally, the associated information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the object in the picture; when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result; and determining attribute information of the object in the picture according to the picture identification result.

Optionally, the identifying the picture to obtain a corresponding picture identification result includes: converting the picture into corresponding picture vectors by adopting a picture identification model, and calculating the similarity between the picture vectors and each preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

Optionally, the determining attribute information of the object in the picture according to the picture recognition result includes: acquiring a pre-established mapping relation, wherein the mapping relation comprises a relation between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; according to the mapping relation, searching attribute information corresponding to the preset picture vector with the highest similarity; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the authenticity of the object in the picture; and when the user is determined to have the intention of identifying the authenticity of the object in the picture, carrying out authenticity identification on the object in the picture, and determining authenticity information corresponding to the object in the picture.

Optionally, the performing the authenticity identification on the object in the picture to determine the authenticity information corresponding to the object in the picture includes: performing authenticity identification on the object in the picture by adopting a classification model, and outputting probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

Optionally, the authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; the generating the authenticity information according to the probability information of the authenticity identification result comprises: using the probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

Optionally, the input information further includes interaction information and input environment information, and the determining whether the user has an intention to identify the authenticity of the object in the picture includes: and judging whether the user has the intention of identifying the authenticity of the object in the picture according to the input environment information and the interaction information.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the input information containing the picture can be acquired, then the picture is identified, the associated information of the picture is determined, and the associated information of the picture is displayed; the user can directly select the displayed associated information to be displayed on the screen without searching and manually inputting the associated information of the picture by the user; the input efficiency is improved.

Drawings

FIG. 1 is a flow chart of the steps of an embodiment of a method for information recommendation of the present invention;

FIG. 2 is a flow chart of the steps of an alternative embodiment of an information recommendation method of the present invention;

FIG. 3 is a flow chart of steps in an alternative embodiment of a method for information recommendation of the present invention;

FIG. 4 is a block diagram of an embodiment of an information recommendation device according to the present invention;

FIG. 5 is a block diagram of an alternative embodiment of an information recommendation device of the present invention;

FIG. 6 illustrates a block diagram of an electronic device for information recommendation, according to an example embodiment;

fig. 7 is a schematic structural diagram of an electronic device for information recommendation according to another exemplary embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

One of the core ideas of the embodiment of the invention is that the associated information of the picture contained in the input information is identified and recommended without the need of searching by a user and manually inputting the associated information of the picture; the input efficiency is improved.

Referring to fig. 1, a flowchart illustrating steps of an embodiment of an information recommendation method according to the present invention is shown, which may specifically include the following steps:

step 102, obtaining input information, wherein the input information comprises a picture.

In the embodiment of the invention, the input information of the user can be acquired in the process of calling the input method by the user for input; and then recommending the user according to the input information of the user so as to improve the input efficiency of the user. The input information may refer to information related to user input, such as interaction information with an opposite terminal, candidate items of a user screen, input environment information, information input by editing operation, and the like. The input information may include a picture, and certainly, may also include other information, such as text information, an expression, and the like, which is not limited in this embodiment of the present invention.

And 104, identifying the picture and determining the associated information of the picture.

And 106, displaying the associated information of the picture.

In the embodiment of the invention, the input method can identify the picture in the input information and determine the associated information of the picture; the related information may refer to information related to the picture, and may include, for example, attribute information of an object in the picture, such as that the object in the picture is a sneaker, and corresponding attribute information such as a brand, a place of origin, a manufacturer, a color matching, a marketing date, and the like. For example, the authenticity information of the object in the picture may be included, for example, the object in the picture is a sneaker, and the corresponding authenticity information may be true, false, or the like. The associated information may include a plurality of items, and then part or all of the associated information may be displayed; the user can display one or more items of associated information on the screen as required, and therefore the input efficiency of the user is improved.

In summary, in the embodiment of the present invention, input information including a picture may be acquired, the picture is identified, the associated information of the picture is determined, and the associated information of the picture is displayed; the user can directly select the displayed associated information to be displayed on the screen without searching and manually inputting the associated information of the picture by the user; the input efficiency is improved.

In the embodiment of the invention, the user may need to identify the object in the picture, and may also need to identify the authenticity of the object in the picture; therefore, in the process of identifying the picture, the intention of the user can be judged firstly; then determining corresponding associated information based on the intention of the user; the associated information may include attribute information of the object in the picture and/or authenticity information of the object in the picture.

The following describes how to identify a picture and determine attribute information corresponding to an object in the picture.

Referring to fig. 2, a flowchart illustrating steps of an alternative embodiment of an information recommendation method according to an embodiment of the present invention is shown.

Step 202, obtaining input information, wherein the input information comprises a picture.

In the embodiment of the invention, after the input information is acquired, the input information can be detected, and whether the input information contains the picture or not is judged; when the input information includes a picture, the picture may be identified, the associated information of the picture may be determined, and step 204 to step 208 may be referred to.

Of course, when the input information does not include a picture, or the input information further includes other information, recommendation of other types of information, such as recommendation association information, recommendation expression, and the like, may be performed based on the other information included in the input information, such as text information; the embodiments of the present invention are not limited in this regard.

And step 204, judging whether the user has the intention of identifying the object in the picture.

In the embodiment of the invention, in the process of identifying the picture, whether the user has the intention of identifying the object in the picture can be judged firstly, and when the user is determined to have the intention of identifying the object in the picture, the object in the picture is identified, and the attribute information corresponding to the object in the picture is determined. Of course, when it is determined that the user does not have the intention to identify the object in the picture, recommendation of other types of information, such as recommendation association information, recommendation expression, and the like, may be performed based on the input information; the embodiments of the present invention are not limited in this regard.

In the embodiment of the invention, when the input environments are different, the mode of judging whether the user has the intention of identifying the object in the picture is different. For example, when the input environment is a comment-type interface, it may be determined that the user invokes the input method to comment on the input information, and at this time, it may be directly determined that the user has an intention to recognize an object in a picture. When the input environment is a chat interface, semantic analysis can be performed according to text information in the input information, and whether the user has the intention of identifying the object in the picture is judged. For example, the text message sent by the opposite end user in the input message includes "do you guess what model of shoes are in the picture? ", it may be determined that the end user has an intent to identify the object in the picture.

And step 206, when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result.

This step may include the following substeps:

and a substep 22 of converting the picture into corresponding picture vectors by using a picture identification model when the user is determined to have the intention of identifying the object in the picture, and calculating the similarity between the picture vectors and each preset picture vector.

And a substep 24, determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

In the embodiment of the invention, pictures of various objects can be collected in advance, and then the pictures of the various objects are respectively converted into corresponding picture vectors (which can be called as preset picture vectors subsequently) by adopting the picture identification model; and stores each preset picture vector. When it is determined that the user has an intention to identify the object in the picture, the determined picture can be identified by adopting a picture identification model according to a pre-stored preset picture vector, and a corresponding picture identification result is determined. The picture can be input into a picture identification model, and the picture identification model converts the picture to generate a picture vector corresponding to the picture. Then comparing the picture vector corresponding to the picture with each preset picture vector, and calculating the similarity of the picture vector and each preset picture vector; and selecting a preset picture vector with the highest similarity to the picture vector from the picture, and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the picture vector.

And 208, determining the attribute information of the object in the picture according to the picture identification result.

This step may include the following substeps:

and a substep 42 of obtaining a pre-established mapping relationship, wherein the mapping relationship comprises a relationship between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture.

And a substep 44 of searching the attribute information corresponding to the preset picture vector with the highest similarity according to the mapping relation.

And a substep 46 of determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

In the embodiment of the invention, the images of various objects are collected, and simultaneously, the attribute information corresponding to each object can be collected. After the preset picture vector of the picture corresponding to each object is determined by adopting the picture identification model, aiming at each picture, the mapping relation between the preset picture vector corresponding to the picture and the attribute information corresponding to the object in the picture can be established; and stores the established mapping association.

Then, according to the mapping relation, attribute information corresponding to a preset picture vector with the highest picture vector similarity of the picture can be searched; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

And step 210, showing the attribute information of the object in the picture.

Then, the associated information of the picture may be displayed in the input method keyboard, or the associated information may be displayed in a designated area of an application program where the input method is currently located. When the associated information of the picture is displayed in the input method keyboard, the associated information may be displayed in a candidate area of the input method keyboard or may be displayed in a cloud associated area, which is not limited in this embodiment of the present invention. The attribute information may include multiple items, one of which may be shown, and multiple items of which may be shown; when multiple items in the attribute information are presented, the items can be presented in sequence according to the use frequency of each item of attribute information.

As an example of the present invention, a user a in forum publishes a picture X of a new mobile phone of a certain brand TTT; when a user wants to comment on the picture, an input method can be called up in the comment edit box for inputting, and at the moment, the input method can acquire input information, namely the picture X published by the user A. Since the current input environment is a comment interface, the input method may determine that the user has an intention to recognize an object in the picture. Then, converting the picture into corresponding picture vectors by adopting a picture identification model, calculating the similarity between the picture vectors and each preset picture vector, and determining a picture identification result corresponding to the picture by using the preset picture vector with the highest similarity with the picture vectors; if the preset picture vector with the highest similarity to the image vector is the preset picture vector 10. Then acquiring a pre-established mapping relation, and searching attribute information corresponding to the preset picture vector with the highest similarity according to the mapping relation; determining attribute information corresponding to the preset picture vector with the highest similarity as attribute information of an object in the picture; if the attribute information corresponding to the preset picture vector 10 includes: "time to market for branded TTT model T-12 designer DD 2019 months days". The attribute information comprises four items, and the four items of attribute information can be displayed; the user can select several items of attribute information to be displayed on the screen, such as two items of attribute information "brand TTT" and "model T-12". Then, the user can continuously input the information such as 'if the mobile phone is exploded, and the user buys the mobile phone just after the mobile phone is out' and sends the information; namely, the comment information sent by the user is that the mobile phone with the brand TTT model T-12 is exploded and bought just after coming out.

In summary, in the embodiments of the present invention, after the input information including the picture is obtained, it may be determined whether the user has an intention to identify the object in the picture, and when it is determined that the user has the intention to identify the object in the picture, the picture is identified to obtain a corresponding picture identification result, and then the attribute information of the object in the picture is determined according to the picture identification result; then displaying the attribute information of the object in the picture, so that a user can directly select the attribute information of the object in the picture to be displayed on a screen without searching and manually inputting the attribute information of the object in the picture by the user; the input efficiency is improved.

Secondly, in the embodiment of the invention, a picture recognition model can be adopted to convert the picture into corresponding picture vectors, the similarity between the picture vectors and each preset picture vector is calculated, and the preset picture vector with the highest similarity with the picture vectors is used for determining the picture recognition result corresponding to the picture; and then determining the attribute information of the object in the picture according to the picture identification result, so that the accuracy of determining the attribute information of the object in the picture can be improved, and the accuracy of recommending the attribute information corresponding to the object in the picture for the user is improved. And user experience can also be improved.

The following describes how to identify a picture and determine authenticity information corresponding to an object in the picture.

Referring to fig. 3, a flowchart illustrating steps of yet another alternative embodiment of an information recommendation method according to an embodiment of the present invention is shown.

Step 302, obtaining input information, wherein the input information comprises a picture.

This step 302 is similar to the step 202 described above and will not be described herein again.

In the above step 104, the picture is identified, and the related information of the picture is determined, which may refer to steps 304 to 308.

And step 304, judging whether the user has the intention of identifying the authenticity of the object in the picture.

In the embodiment of the invention, in the process of identifying the picture, whether the user has the intention of identifying the authenticity of the object in the picture can be judged firstly, and when the user is determined to have the intention of identifying the authenticity of the object in the picture, the authenticity of the object in the picture is identified, and the authenticity information corresponding to the object in the picture is determined. Of course, when it is determined that the user does not have the intention of identifying the authenticity of the object in the picture, recommendation of other types of information, such as recommendation association information, recommendation expression and the like, can be performed based on the input information; the embodiments of the present invention are not limited in this regard.

In an optional embodiment of the present invention, the input information may further include input environment information and interaction information; one way to determine whether the user has an intention to identify the authenticity of the object in the picture may be to determine whether the user has an intention to identify the authenticity of the object in the picture based on the input environment information and the interaction information. Semantic analysis can be carried out on the interaction information according to the input environment information, and the intention of a user is determined; and then judging whether the user intention determined by semantic analysis is the intention for identifying the authenticity of the object in the picture. When the user intention determined through semantic analysis is an intention to identify the authenticity of the object in the picture, it may be determined that the user has an intention to identify the authenticity of the object in the picture; when the user's intention determined through the semantic analysis is not an intention to recognize the authenticity of the object in the picture, it may be determined that the user does not have an intention to recognize the authenticity of the object in the picture.

In the embodiment of the invention, when the user is determined to have the intention of identifying the authenticity of the object in the picture, the authenticity of the object in the picture can be identified, and the authenticity information corresponding to the object in the picture is determined; see step 306-308:

and 306, identifying the authenticity of the object in the picture by adopting a classification model when the user is determined to have the intention of identifying the authenticity of the object in the picture, and outputting probability information of a corresponding authenticity identification result.

And 308, generating the authenticity information according to the probability information of the authenticity identification result.

In the embodiment of the invention, after the collected pictures of the objects are collected, the authenticity of the objects in the pictures can be respectively determined; and then, training the classification model according to the authenticity of the picture and the corresponding object, so that the trained classification model can identify the authenticity of the object in the picture.

The picture can be input into the trained classification model, the trained classification module is used for identifying the authenticity of the object in the picture, and probability information of a corresponding authenticity identification result is output. The authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; one of the first true and false recognition result and the second true and false recognition result may be true, and the other may be false; and the sum of the probability information of the first genuine recognition result and the probability information of the second genuine recognition result may be 1.

Then, the authenticity information can be generated according to the probability information of the authenticity identification result; one of the ways may be to directly use the probability information of the authenticity identification result as the authenticity information. For example, the first authenticity identification result is true, the second authenticity identification result is false, and the probability information of the authenticity identification result is: true (75%) false (25%); the authenticity information may be: true (75%) false (25%).

In an example of the present invention, another way of generating the authenticity information according to the probability information of the authenticity identification result may be: when the probability information of the first true and false recognition result is larger than that of the second true and false recognition result and is larger than a preset threshold value, taking the first true and false recognition result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information. Judging the probability information of the first true and false recognition result and the probability information of the first true and false recognition result, and taking the true and false recognition result with the probability greater than a preset threshold value as the true and false information; the preset threshold may be set as required, which is not limited in this embodiment of the present invention. For example, the first authenticity identification result is true, the second authenticity identification result is false, and the probability information of the authenticity identification result is: true (75%) false (25%); the authenticity information may be: true.

And 310, displaying the authenticity information of the object in the picture.

As another example of the present invention, during a chat between the home user and the peer user, the peer user sends a picture of a sneaker, and the text message "do you see the shoes of the picture as true". The input method of the terminal corresponding to the home terminal user may obtain input information, where the input information may include: the interactive information and the input environment information of the home terminal user and the opposite terminal user. Then, according to the input environment information and the interaction information, the user can be determined to have the intention of identifying the authenticity of the object in the picture; and then, performing authenticity identification on the object in the picture, determining authenticity information corresponding to the object in the picture, such as 'true (75%) false (25%)', and displaying the authenticity information. The home terminal user can directly select the authenticity information to be displayed on a screen and send the opposite terminal user so as to be convenient for the opposite terminal user to refer.

In summary, in the embodiments of the present invention, after the input information including the picture is obtained, it may be determined whether the user has an intention to identify the authenticity of the object in the picture, and when it is determined that the user has the intention to identify the authenticity of the object in the picture, the authenticity identification is performed on the object in the picture, and the authenticity information corresponding to the object in the picture is determined; then displaying the authenticity information of the object in the picture, so that a user can directly select the authenticity information of the object in the picture to be displayed on a screen without searching and manually inputting the authenticity information of the object in the picture by the user; the input efficiency is improved.

Secondly, in the embodiment of the invention, a classification model can be adopted to perform authenticity identification on the object in the picture, corresponding probability information of an authenticity identification result is output, and the authenticity information is generated according to the probability information of the authenticity identification result; and the accuracy of determining the authenticity information of the object in the picture can be improved, so that the accuracy of recommending the authenticity information corresponding to the object in the picture for the user is improved. And user experience can also be improved.

Of course, in an alternative embodiment of the present invention, after the step 210 is executed, the step 304 may be executed; after the attribute information of the object in the picture is displayed, whether the user has the intention of identifying the authenticity of the object in the picture is further judged, and when the intention of identifying the authenticity of the object in the picture is determined, the authenticity of the object in the picture is identified; and then recommending the authenticity information of the object in the picture for the user.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 4, a block diagram of an embodiment of an information recommendation apparatus according to the present invention is shown, which may specifically include the following modules:

an obtaining module 402, configured to obtain input information, where the input information includes a picture;

an identifying module 404, configured to identify the picture and determine associated information of the picture;

and a display module 406, configured to display the associated information of the picture.

Referring to fig. 5, a block diagram of an alternative embodiment of an information recommendation device of the present invention is shown.

In an optional embodiment of the present invention, the related information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

In an optional embodiment of the present invention, the identifying module 404 includes:

an intention identification sub-module 4042, configured to determine whether the user has an intention to identify an object in the picture;

a picture result identification sub-module 4044, configured to identify the picture to obtain a corresponding picture identification result when it is determined that the user has an intention to identify an object in the picture;

the attribute identification submodule 4046 is configured to determine attribute information of an object in the picture according to the picture identification result.

In an optional embodiment of the present invention, the picture result identification submodule 4044 is configured to convert the picture into a corresponding picture vector by using a picture identification module, and calculate a similarity between the picture vector and a preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

In an optional embodiment of the present invention, the attribute identification submodule 4046 is configured to obtain a pre-established mapping relationship, where the mapping relationship includes a relationship between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

In an optional embodiment of the present invention, the identifying module 404 includes:

the authenticity identification sub-module 4048 is used for judging whether the user has the intention of identifying the authenticity of the object in the picture;

the authenticity result determining sub-module 40410 is configured to perform authenticity identification on the object in the picture to determine authenticity information corresponding to the object in the picture when it is determined that the user has an intention to identify authenticity of the object in the picture.

In an optional embodiment of the present invention, the authenticity result determining sub-module 40410 is configured to perform authenticity identification on the object in the picture by using a classification model, and output probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

In an optional embodiment of the present invention, the authenticity identification result includes a first authenticity identification result and a second authenticity identification result; the authenticity result determining sub-module 40410 is configured to use probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

In an optional embodiment of the present invention, the input information of the obtaining module further includes interaction information and input environment information; the authenticity identification sub-module 4048 is configured to determine whether the user has an intention to identify authenticity of the object in the picture according to the input environment information and the interaction information.

In summary, in the embodiment of the present invention, input information including a picture may be acquired, the picture is identified, the associated information of the picture is determined, and the associated information of the picture is displayed; the user can directly select the displayed associated information to be displayed on the screen without searching and manually inputting the associated information of the picture by the user; the input efficiency is improved.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

Fig. 6 is a block diagram illustrating an electronic device 600 for information recommendation according to an example embodiment. For example, the electronic device 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 6, electronic device 600 may include one or more of the following components: a processing component 602, a memory 604, a power component 606, a multimedia component 608, an audio component 610, an interface to input/output (I/O) 612, a sensor component 614, and a communication component 616.

The processing component 602 generally controls overall operation of the electronic device 600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 602 may include one or more processors 620 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 602 can include one or more modules that facilitate interaction between the processing component 602 and other components. For example, the processing component 602 can include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.

The memory 604 is configured to store various types of data to support operation at the device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 604 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

Power component 606 provides power to the various components of electronic device 600. Power components 606 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for electronic device 600.

The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 600 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 610 is configured to output and/or input audio signals. For example, the audio component 610 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 600 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 604 or transmitted via the communication component 616. In some embodiments, audio component 610 further includes a speaker for outputting audio signals.

The I/O interface 612 provides an interface between the processing component 602 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor component 614 includes one or more sensors for providing status assessment of various aspects of the electronic device 600. For example, the sensor component 614 may detect an open/closed state of the device 600, the relative positioning of components, such as a display and keypad of the electronic device 600, the sensor component 614 may also detect a change in the position of the electronic device 600 or a component of the electronic device 600, the presence or absence of user contact with the electronic device 600, orientation or acceleration/deceleration of the electronic device 600, and a change in the temperature of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 616 is configured to facilitate communications between the electronic device 600 and other devices in a wired or wireless manner. The electronic device 600 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 614 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 614 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 600 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 604 comprising instructions, executable by the processor 620 of the electronic device 600 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a method of information recommendation, the method comprising: acquiring input information, wherein the input information comprises a picture; identifying the picture and determining the associated information of the picture; and displaying the associated information of the picture.

Optionally, the associated information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the object in the picture; when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result; and determining attribute information of the object in the picture according to the picture identification result.

Optionally, the identifying the picture to obtain a corresponding picture identification result includes: converting the picture into corresponding picture vectors by adopting a picture identification model, and calculating the similarity between the picture vectors and each preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

Optionally, the determining attribute information of the object in the picture according to the picture recognition result includes: acquiring a pre-established mapping relation, wherein the mapping relation comprises a relation between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; according to the mapping relation, searching attribute information corresponding to the preset picture vector with the highest similarity; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the authenticity of the object in the picture; and when the user is determined to have the intention of identifying the authenticity of the object in the picture, carrying out authenticity identification on the object in the picture, and determining authenticity information corresponding to the object in the picture.

Optionally, the performing the authenticity identification on the object in the picture to determine the authenticity information corresponding to the object in the picture includes: performing authenticity identification on the object in the picture by adopting a classification model, and outputting probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

Optionally, the authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; the generating the authenticity information according to the probability information of the authenticity identification result comprises: using the probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

Optionally, the input information further includes interaction information and input environment information, and the determining whether the user has an intention to identify the authenticity of the object in the picture includes: and judging whether the user has the intention of identifying the authenticity of the object in the picture according to the input environment information and the interaction information.

Fig. 7 is a schematic structural diagram of an electronic device 700 for information recommendation according to another exemplary embodiment of the present invention. The electronic device 700 may be a server, which may vary significantly depending on configuration or performance, and may include one or more Central Processing Units (CPUs) 722 (e.g., one or more processors) and memory 732, one or more storage media 730 (e.g., one or more mass storage devices) storing applications 742 or data 744. Memory 732 and storage medium 730 may be, among other things, transient storage or persistent storage. The program stored in the storage medium 730 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Further, the central processor 722 may be configured to communicate with the storage medium 730, and execute a series of instruction operations in the storage medium 730 on the server.

The server may also include one or more power supplies 726, one or more wired or wireless network interfaces 750, one or more input-output interfaces 758, one or more keyboards 756, and/or one or more operating systems 741, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

An electronic device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for: acquiring input information, wherein the input information comprises a picture; identifying the picture and determining the associated information of the picture; and displaying the associated information of the picture.

Optionally, the associated information of the picture includes attribute information of an object in the picture and/or authenticity information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the object in the picture; when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result; and determining attribute information of the object in the picture according to the picture identification result.

Optionally, the identifying the picture to obtain a corresponding picture identification result includes: converting the picture into corresponding picture vectors by adopting a picture identification model, and calculating the similarity between the picture vectors and each preset picture vector; and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

Optionally, the determining attribute information of the object in the picture according to the picture recognition result includes: acquiring a pre-established mapping relation, wherein the mapping relation comprises a relation between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture; according to the mapping relation, searching attribute information corresponding to the preset picture vector with the highest similarity; and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

Optionally, the identifying the picture and determining the associated information of the picture include: judging whether the user has the intention of identifying the authenticity of the object in the picture; and when the user is determined to have the intention of identifying the authenticity of the object in the picture, carrying out authenticity identification on the object in the picture, and determining authenticity information corresponding to the object in the picture.

Optionally, the performing the authenticity identification on the object in the picture to determine the authenticity information corresponding to the object in the picture includes: performing authenticity identification on the object in the picture by adopting a classification model, and outputting probability information of a corresponding authenticity identification result; and generating the authenticity information according to the probability information of the authenticity identification result.

Optionally, the authenticity identification result comprises a first authenticity identification result and a second authenticity identification result; the generating the authenticity information according to the probability information of the authenticity identification result comprises: using the probability information of the authenticity identification result as the authenticity information; or when the probability information of the first true and false identification result is larger than the probability information of the second true and false identification result and larger than a preset threshold value, taking the first true and false identification result as true and false information; and when the probability information of the second authenticity identification result is larger than that of the first authenticity identification result and is larger than a preset threshold value, taking the second authenticity identification result as authenticity information.

Optionally, the input information further includes interaction information and input environment information, and the determining whether the user has an intention to identify the authenticity of the object in the picture includes: and judging whether the user has the intention of identifying the authenticity of the object in the picture according to the input environment information and the interaction information.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The information recommendation method, the information recommendation device and the electronic device provided by the invention are described in detail, and specific examples are applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiments is only used to help understanding the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. An information recommendation method, comprising:

acquiring input information, wherein the input information comprises a picture;

identifying the picture and determining the associated information of the picture;

and displaying the associated information of the picture.

2. The method according to claim 1, wherein the associated information of the picture comprises attribute information of an object in the picture and/or authenticity information of the object in the picture.

3. The method according to claim 2, wherein the identifying the picture and determining the associated information of the picture comprise:

judging whether the user has the intention of identifying the object in the picture;

when the user is determined to have the intention of identifying the object in the picture, identifying the picture to obtain a corresponding picture identification result;

and determining attribute information of the object in the picture according to the picture identification result.

4. The method according to claim 3, wherein the identifying the picture to obtain a corresponding picture identification result comprises:

converting the picture into corresponding picture vectors by adopting a picture identification model, and calculating the similarity between the picture vectors and each preset picture vector;

and determining a picture identification result corresponding to the picture according to the preset picture vector with the highest similarity to the image vector.

5. The method according to claim 4, wherein the determining attribute information of the object in the picture according to the picture recognition result comprises:

acquiring a pre-established mapping relation, wherein the mapping relation comprises a relation between a preset picture vector corresponding to a picture and attribute information corresponding to an object in the picture;

according to the mapping relation, searching attribute information corresponding to the preset picture vector with the highest similarity;

and determining the attribute information corresponding to the preset picture vector with the highest similarity as the attribute information of the object in the picture.

6. The method according to claim 2, wherein the identifying the picture and determining the associated information of the picture comprise:

judging whether the user has the intention of identifying the authenticity of the object in the picture;

and when the user is determined to have the intention of identifying the authenticity of the object in the picture, carrying out authenticity identification on the object in the picture, and determining authenticity information corresponding to the object in the picture.

7. The method according to claim 6, wherein the identifying the authenticity of the object in the picture and determining the authenticity information corresponding to the object in the picture comprises:

performing authenticity identification on the object in the picture by adopting a classification model, and outputting probability information of a corresponding authenticity identification result;

and generating the authenticity information according to the probability information of the authenticity identification result.

8. An information recommendation apparatus, comprising:

the device comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring input information, and the input information comprises pictures;

the identification module is used for identifying the picture and determining the associated information of the picture;

and the display module is used for displaying the associated information of the picture.

9. A readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the information recommendation method of any of method claims 1-7.

10. An electronic device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for:

acquiring input information, wherein the input information comprises a picture;

identifying the picture and determining the associated information of the picture;

and displaying the associated information of the picture.

Images