CN110866796A

CN110866796A - Information display method, information acquisition method, system and equipment

Info

Publication number: CN110866796A
Application number: CN201810990027.8A
Authority: CN
Inventors: 张能
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2018-08-28
Filing date: 2018-08-28
Publication date: 2020-03-06

Abstract

The embodiment of the application provides a method, a system and equipment for information display and information acquisition. The method comprises the following steps: when a picture obtained based on first multimedia information is stored in the associated space in response to an opening event of the first application, performing character and image recognition on the picture to obtain at least one recognition result to be selected; displaying the at least one identification result to be selected on an open page of the first application; and responding to a selection event triggered by aiming at the at least one candidate identification result, and displaying service information related to the at least one selected identification result. According to the technical scheme, at least one identification result to be selected obtained by character and image identification is displayed to the user for selection, the user can accurately know the real acquisition intention of the user through selection of the identification result to be selected by the user, the service information finally provided for the user can better meet the real requirements of the user, and the information acquisition accuracy is improved.

Description

Information display method, information acquisition method, system and equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method, a system, and a device for displaying and acquiring information.

Background

At present, the information search technology based on pictures is widely applied to software such as e-commerce and browsers. After the user inputs the picture to be searched, the search engine searches according to the picture to be searched input by the user to obtain a search result, and the search result is directly displayed to the user.

Typically, the pictures will contain multiple aspects of information, and the user is likely to be interested in only a few of these aspects of information. For example, in the e-commerce application field, a user only wants to search for shoes in a picture, and the picture contains other articles besides the shoes, such as clothes, bags and the like. In this case, if a search is performed according to a picture, the search result may include a search result that is not needed by the user. Therefore, in the information searching method based on the picture in the prior art, the accuracy rate of the searching result is low.

Disclosure of Invention

In view of the above, the present application is proposed to provide an information display, information acquisition method, system, and apparatus that solve the above problems or at least partially solve the above problems.

Thus, in one embodiment of the present application, an information display method is provided. The method comprises the following steps:

when a picture obtained based on first multimedia information is stored in the associated space in response to an opening event of the first application, performing character and image recognition on the picture to obtain at least one recognition result to be selected;

displaying the at least one identification result to be selected on an open page of the first application;

and responding to a selection event triggered by aiming at the at least one candidate identification result, and displaying service information related to the at least one selected identification result.

In another embodiment of the present application, an information acquisition system is provided. The system comprises:

the client is used for recognizing characters and images of the pictures obtained based on the first multimedia information to obtain at least one recognition result to be selected; acquiring at least one selected recognition result selected by a user from the at least one to-be-selected recognition result; sending the at least one selected identification result to a server so as to acquire service information related to the at least one selected identification result from the server;

and the server is used for searching service information related to the target candidate identification result according to the target candidate identification result and feeding the searched service information back to the client.

In yet another embodiment of the present application, an information acquisition method is provided. The method comprises the following steps:

performing character and image recognition on the picture to obtain at least one recognition result to be selected;

acquiring at least one selected recognition result selected by a user from the at least one to-be-selected recognition result;

and sending the at least one selected identification result to a server so as to acquire service information related to the at least one selected identification result from the server.

In yet another embodiment of the present application, an electronic device is provided. The electronic device includes: a first memory, a first processor, and a first display, wherein,

the first memory is used for storing programs;

the first display is coupled with the first processor;

the first processor, coupled with the first memory, to execute the program stored in the first memory to:

controlling the first display to display the at least one identification result to be selected on an open page of the first application;

and controlling the first display to display service information related to at least one selected identification result in response to a selection event triggered by the at least one candidate identification result.

In yet another embodiment of the present application, an electronic device is provided. The electronic device includes: a second memory, a second processor, and a second communication component, wherein,

the second memory is used for storing programs;

the second processor, coupled to the second memory, is configured to execute the program stored in the second memory to:

the second communication component is coupled with the second processor and used for sending the at least one selected identification result to a server so as to obtain service information related to the at least one selected identification result from the server.

In the technical scheme provided by the embodiment of the application, at least one identification result to be selected obtained by identifying the characters and the images is displayed to a user for the user to select; and acquiring the related service information according to at least one selected identification result selected by the user. The user can accurately know the real acquisition intention of the user through the selection of the identification result to be selected, so that the service information finally provided for the user is more in line with the real requirement of the user, and the information acquisition accuracy is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is a schematic flowchart of an information display method according to an embodiment of the present application;

fig. 2 is second multimedia information corresponding to a product according to an embodiment of the present application;

fig. 3 is a second multimedia message corresponding to an article provided in an embodiment of the present application;

fig. 4 is second multimedia information corresponding to a video provided in an embodiment of the present application;

fig. 5 is a block diagram of an information acquisition system according to an embodiment of the present application;

fig. 6 is a schematic flowchart of an information obtaining method according to an embodiment of the present application;

fig. 7 is a block diagram of an information display device according to an embodiment of the present application;

fig. 8 is a block diagram of an information acquisition apparatus according to an embodiment of the present application;

fig. 9 is a block diagram of an electronic device according to an embodiment of the present application;

fig. 10 is a block diagram of an electronic device according to another embodiment of the present application;

fig. 11 is a diagram illustrating a pop-up window according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

In some of the flows described in the specification, claims, and above-described figures of the present application, a number of operations are included that occur in a particular order, which operations may be performed out of order or in parallel as they occur herein. The sequence numbers of the operations, e.g., 101, 102, etc., are used merely to distinguish between the various operations, and do not represent any order of execution per se. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel. It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.

In the prior art, when a user wants to share a certain commodity in a first application to a second application, some second applications can only display a string of characters, and when the user copies the string of characters in the second application and opens the first application, the user can see what the specific content of the string of characters is. The existing method has the defects that the text plate shares information, the visual experience is poor, the effect of attracting the attention of human eyes is poor, and the backflow conversion rate is low. In addition, in the prior art, the picture-based information searching mode is difficult to accurately grasp the technical problems of low accuracy of the searching result and the like caused by the real intention of the user.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Fig. 1 shows a schematic flow chart of an information display method according to an embodiment of the present application. The method provided by the embodiment is suitable for the client. The client may be hardware integrated on the terminal and having an embedded program, may also be application software installed in the terminal, and may also be tool software embedded in an operating system of the terminal, which is not limited in this embodiment of the present application. The terminal can be any terminal equipment including a mobile phone, a tablet personal computer, intelligent wearable equipment and the like. As shown in fig. 1, the method includes:

101. and when the picture obtained based on the first multimedia information is stored in the associated space in response to the opening event of the first application, performing character and image recognition on the picture to obtain at least one recognition result to be selected.

102. And displaying the at least one identification result to be selected on the open page of the first application.

103. And responding to a selection event triggered by aiming at the at least one candidate identification result, and displaying service information related to the at least one selected identification result.

In the foregoing 101, the open event of the first application may include a start event of the first application and/or a switching event that the first application is switched from a background to a foreground.

The association space may be a temporary storage provided by the operating system and provide a shared storage area, for example: and (4) shearing the plate. Generally, the association space only stores one copy of data, and the data stored later overwrites the data stored earlier. In specific implementation, a storage duration threshold value can be set, and when the storage duration of the picture exceeds the storage duration threshold value, the picture is deleted from the associated space; and/or deleting the picture stored in the associated space from the associated space after the picture is read and identified.

When the first application is opened, whether a picture exists in the associated space or not is automatically detected, and if the picture exists in the associated space, character and image recognition is performed on the picture to obtain at least one recognition result to be selected.

Wherein, the first multimedia information can be pictures, videos and the like; in practical application, a user can store the intercepted or stored picture into the associated space by performing operations such as screen capturing or storing on the first multimedia information.

For example: the user sees a first multimedia message in the second application, the first multimedia message can be a picture and a video, the user is interested in a certain object in the first multimedia message, and if the user wants to know the detailed condition of the object, the user can perform screen capture operation on the first multimedia message, and the picture obtained by screen capture can be stored in the associated space; when the first multimedia information is a picture, the user can also perform a storage operation on the picture, and the picture can be automatically stored in the associated space.

Of course, the computing power of the current client is increasingly enhanced, and character and image recognition on the video can be realized. Therefore, when the first multimedia information is a video, the user can store the video into the associated space by storing the video; and subsequently, the client identifies the video by characters and images to obtain at least one identification result to be selected.

In the above 102, the open page may be an open page (i.e. a home page) of the first application or a display page when the first application is last switched from a foreground to a background. Of course, the open page may also be generated based on at least one candidate recognition result.

When the open page is an open page of the first application or a display page when the first application is switched from the foreground to the background for the last time, in order to not affect the display style of the open page or the display page, a popup window can be popped out from the open page, and the at least one identification result to be selected is displayed in the popup window. Specifically, a control corresponding to each of the at least one recognition result to be selected may be displayed in the popup window for selection by the user.

In 103, the user selects the to-be-selected recognition result meeting the actual requirement of the user from the at least one to-be-selected recognition result displayed on the open page. And the to-be-selected recognition result selected by the user is the selected recognition result. The selected identification result may be one, two or more, and the like, and this is not particularly limited in this embodiment of the application. After the user finishes the selection, the client side sends the at least one selected identification result to the server side so as to obtain the service information related to the at least one selected identification result from the server side.

Wherein, the service information related to at least one selected recognition result can be displayed in a new page or can be displayed in a popup window; the examples of the present application are not particularly limited.

In the technical scheme provided by the embodiment of the application, at least one identification result to be selected obtained by identifying the characters and the images is displayed to a user for the user to select; and subsequently, acquiring related service information according to the to-be-selected identification result selected by the user. The user can accurately know the real acquisition intention of the user through the selection of the identification result to be selected, so that the service information finally provided for the user is more in line with the real requirement of the user, and the information acquisition accuracy is improved. And the reflux efficiency can be improved by adopting a mode of combining character recognition and image recognition. In addition, according to the technical scheme provided by the embodiment of the application, cross-application information searching and sharing can be achieved.

In an achievable technical solution, "perform text and image recognition on the picture to obtain at least one recognition result to be selected" in the step 101 may specifically be implemented by the following steps:

1011. carrying out image recognition on the picture;

1012. if the image is identified to be on the picture, determining an identification result to be selected based on the image;

1013. performing character recognition on the picture;

1014. and if the characters are identified on the picture, determining the identification result to be selected according to the characters.

In 1012, the "determining the candidate recognition result based on the image" may specifically include:

and taking the image as a candidate identification result, and/or performing semantic analysis on the image to obtain at least one candidate identification result which can be used as a search keyword.

The semantic analysis is performed on the image, that is, the image is subjected to visual features such as texture, contour, shape, color and the like, so as to identify the real object information (for example, the real object name or the real object type) of each object in the image. The identified physical information of each object can be used as a search keyword. For example: as shown in fig. 11, if a cutting board is shown in the image, the to-be-selected recognition result obtained by performing semantic analysis on the image is the cutting board, and the cutting board is used as a search keyword. It should be noted that, the specific implementation of semantic analysis on the image can be referred to in the prior art, and is not described in detail here.

In 1013, the Character extraction may be performed by using an OCR (Optical Character Recognition) technique. The concrete implementation of the character extraction by using the OCR technology can be referred to in the prior art, and is not described in detail herein.

And if the picture is identified to contain characters which comprise the network resource password, taking the network resource password as the identification result to be selected, and/or taking the participle as the identification result to be selected when the characters have the participle which is in line with the search keyword.

The network resource password is mainly used for identifying network resources (namely service information), the network resource passwords corresponding to different network resources are generally different, namely one network resource password corresponds to one network resource, the network resource password can be a character string identification code or a two-dimensional code, the two-dimensional code can be a two-dimensional plane array code, for example, a password-panning password is a common network resource password, the password-panning password is a character string identification code, and as shown in fig. 2, the password-panning 201 is '￥ 5MPD0oWef0 ￥'.

Correspondingly, the displaying 102 of the at least one recognition result to be selected on the open page of the first application may specifically include:

1021. displaying a popup window on an open page of the first application;

1022. and displaying a control corresponding to each to-be-selected recognition result in the at least one to-be-selected recognition result in the popup window.

The 1022 may specifically include: and in the popup window, displaying each identification result to be selected and the control corresponding to each identification result to be selected in an associated manner. For example: when the recognition result to be selected is the search keyword, the search keyword is displayed on the corresponding control as the control label of the corresponding control, such as the control 1 with the control label of "chopping board", the control 2 with the control label of "Joseph chopping board", and the control 3 with the control label of "plate rack" in fig. 11; when the identification result to be selected is the network resource password, the network resource password can also be displayed on the corresponding control as the control label of the corresponding control, or the "network resource password identification" is displayed on the corresponding control as the control label of the corresponding control, such as the control 4 with the control label of "pan password identification" in fig. 11; when the candidate recognition result is an image, the image recognition may be displayed on the corresponding control as a control label of the corresponding control, and optionally, the image 7 may also be displayed on a pop-up window, and the image recognition control 5 may be displayed on the image 7 in an overlapping manner, as shown in fig. 11.

Optionally, a control 6 with a control label of "keyword recognition" may be displayed on the popup, and the control is arranged and displayed with the control corresponding to each search keyword.

Accordingly, the step of "displaying the service information associated with the at least one selected recognition result" in 103 may be implemented by the following steps:

1031. and when the at least one selected identification result contains the network resource password, displaying the network resource corresponding to the network resource password.

1032. And when the at least one selected identification result contains a search keyword, sending the search keyword to a server, and displaying a search result which is fed back by the server and searched according to the search keyword.

1033. And when the at least one selected identification result contains an image, sending the image to a server, and displaying a search result which is fed back by the server and is the same as or similar to the image.

1031, when the user selects the network resource password, it indicates that the user wants to know the network resource corresponding to the network resource password, the client can send the network resource password to the server, the server finds the network resource identified by the network resource password according to the network resource password, and returns the found network resource to the client for display to the user by the client. For example: and the network resource password identifies a commodity detail page, and the client displays the commodity detail page to the user.

1032, when the search keyword is "chopping board", the search result obtained by the server search may include chopping boards of all brands in the whole network; when the search keyword is 'XX chopping board', the search result obtained by the server side search only comprises the XX brand chopping board.

In 1033, when the user selects the image, the server may obtain a search result that is the same as or similar to the image through an image matching technique. Taking a search for a commodity as an example, each commodity information in a commodity library at present comprises a commodity image, and a server side can obtain the commodity information corresponding to the commodity image which is the same as or similar to the identified image in the commodity library through an image matching technology so as to obtain a search result.

Further, the method may further include:

104. responding to a sharing operation that a user shares content to be shared to a second application, and generating to-be-processed multimedia information which corresponds to the content to be shared and is used for being displayed in the second application.

105. And adding a network resource password generated based on the identifier corresponding to the content to be shared and the identifier corresponding to the user into the multimedia information to be processed to obtain second multimedia information.

106. And sharing the second multimedia information to the second application.

In the foregoing 104, in order to implement the in-application sharing function and the cross-application sharing function of the first application at the same time, a sharing control may be set on a display page of each service information in the first application, and when the user triggers the sharing control, an application selection popup is popped up, where application controls corresponding to the first application and the second application are displayed in the application selection popup. If the user clicks the first application, the sharing function in the application can be realized; if the user clicks on the second application, a cross-application sharing function can be implemented.

Correspondingly, the sharing operation is a clicking operation of the user on the application control corresponding to the second application in the application selection popup. Responding to the sharing operation, the to-be-processed multimedia information can be automatically generated, wherein the to-be-processed multimedia information can comprise: pictures and videos.

In the above 105, the identifier corresponding to the content to be shared is a unique identifier corresponding to the content to be shared, for example: the article has article ID (identity) number, video has video ID number, and the product has product ID number. The identifier corresponding to the user refers to a unique identifier of the sharing user who performs the sharing operation, for example: the user ID number. And generating a network resource password based on the identifier corresponding to the content to be shared and the identifier corresponding to the sharing user, wherein the network resource password can be a character string identification code or a two-dimensional code.

Specifically, the generated network resource password may be added to the multimedia information to be processed in the form of a watermark.

For example, when the content to be shared is a commodity, a commodity introduction diagram, a title, a price, and the like on a display page of the commodity (i.e., a commodity detail page of the commodity) may be combined into a picture, the picture is used as the to-be-processed multimedia information corresponding to the commodity, and the network resource password corresponding to the commodity is added to the to-be-processed multimedia information in the form of a watermark, so as to obtain the second multimedia information corresponding to the commodity, as shown in fig. 2. When the content to be shared is an article, the content of the article may be subjected to screen capture, an image obtained by the screen capture is used as the to-be-processed multimedia information corresponding to the article, and the network resource password corresponding to the article is added to the to-be-processed multimedia information in the form of a watermark, so as to obtain second multimedia information corresponding to the article, as shown in fig. 3. When the content to be shared is a video, the whole video may be used as the to-be-processed multimedia information corresponding to the video, or the playing picture of the video is captured and used as the to-be-processed multimedia information corresponding to the video, and the network resource password corresponding to the video is added to the to-be-processed multimedia information in the form of a watermark, so as to obtain the second multimedia information corresponding to the video, as shown in fig. 4. It should be noted that the content to be shared may not only be the video, the article, and the commodity mentioned above, but also include other network resource information such as activities and channels.

In 106, the second multimedia information may be stored in the local storage after being generated, for example: and the user opens a chat interface with the friend in the second application and sends the second multimedia information to the friend.

In this embodiment, the second multimedia information shared to the second application includes a picture or a video, which can improve the viewing experience of the shared content and the reflow conversion rate.

It should be noted that, in an embodiment, the first multimedia information refers to a picture or a video to which a network resource password is added. The generation process of the first multimedia information may refer to the generation process of the second multimedia information, and is not described herein again.

The technical scheme provided by the application will be described in detail below by taking cross-application commodity sharing as an example:

the first application is an e-commerce application A and the second application is an instant messaging application B. When a first user browses a certain commodity in the e-commerce application A, the first user wants to share the commodity with friends on the instant messaging application B. The first user clicks a sharing button on the commodity detail page in the E-commerce application A, the E-commerce application A pops up an application selection popup window, the first user clicks an application control B corresponding to the instant messaging application B on the application selection popup window, the E-commerce application A automatically synthesizes a picture according to an introduction picture, a title, a price and the like of the commodity, and adding the network resource password generated based on the identification of the commodity and the identification of the first user to the picture in a watermark mode, automatically storing the picture added with the network resource password in a local memory after the picture added with the network resource password is generated, and automatically jumping to the instant messaging application B, the first user finds the chat interface with the friend in the instant messaging application B, and sending the picture added with the network resource password to the friend through a chat interface with the friend.

After receiving the picture added with the network resource password shared by the first user through the instant messaging application B, the friend can capture a screen of the chat interface of the first user or store the picture displayed on the chat interface of the first user, and a screenshot obtained by screen capture or the picture obtained by storage can be automatically stored in the associated space. The friend quits the instant messaging application B, the E-commerce application A is opened locally, the E-commerce application A is opened, the intercepted screenshot or the stored picture is automatically read from the associated space, character and image recognition is carried out on the picture to obtain a network resource password, a search keyword, an image and other to-be-selected recognition results, the network resource password, the search keyword and the image to-be-selected recognition results are displayed in a pop-up window for a user to select, and commodity information related to the target to-be-selected recognition results is displayed in response to selection operation of the user on the target to-be-selected recognition results, so that the cross-application information sharing function is achieved.

The information acquisition system provided by the embodiment of the application can be realized based on the following system architecture. As shown in fig. 5, a schematic structural diagram of an information acquisition system according to an embodiment of the present application is provided. As shown in fig. 5, the system provided in this embodiment includes: a client 501 and a server 502. Wherein the content of the first and second substances,

the client 501 is used for performing character and image recognition on the picture obtained based on the first multimedia information to obtain at least one recognition result to be selected; acquiring at least one selected recognition result selected by a user from the at least one to-be-selected recognition result; sending the at least one selected identification result to a server so as to acquire service information related to the at least one selected identification result from the server;

and the server 502 is configured to search service information related to the target candidate identification result according to the target candidate identification result, and feed back the searched service information to the client.

In the technical scheme provided by the embodiment of the application, at least one identification result to be selected obtained by identifying the characters and the images is displayed to a user for the user to select; and subsequently, acquiring related service information according to the to-be-selected identification result selected by the user. The user can accurately know the real acquisition intention of the user through the selection of the identification result to be selected, so that the service information finally provided for the user is more in line with the real requirement of the user, and the information acquisition accuracy is improved.

When the at least one selected identification result contains the network resource password, the server 502 is specifically configured to obtain the network resource corresponding to the network resource password and feed back the network resource password to the client 501; when the at least one selected recognition result contains a search keyword, the server 502 is specifically configured to perform a search according to the search keyword, and feed back a search result obtained by the search to the client 501; when the at least one selected recognition result contains an image, the server 502 performs a search according to the image to obtain a search result that is the same as or similar to the image, and feeds the search result back to the client 501.

The server side can adopt the prior art to realize the process of acquiring the network resource corresponding to the network resource password; the existing searching technology based on searching keyword searching information can be adopted for searching, and the existing image matching technology can be adopted for realizing image searching.

It should be noted that, for specific work flows of each constituent unit, such as a server and a client, in the information acquisition system provided in the embodiment of the present application, reference may be made to corresponding contents in each embodiment described above, and details are not described herein again.

Fig. 6 shows a flowchart of an information obtaining method according to an embodiment of the present application. The method provided by the embodiment is suitable for the client. The client may be hardware integrated on the terminal and having an embedded program, may also be application software installed in the terminal, and may also be tool software embedded in an operating system of the terminal, which is not limited in this embodiment of the present application. The terminal can be any terminal equipment including a mobile phone, a tablet personal computer, intelligent wearable equipment and the like. As shown in fig. 6, the method includes:

601. and performing character and image recognition on the picture to obtain at least one recognition result to be selected.

602. And acquiring at least one selected recognition result selected by the user from the at least one to-be-selected recognition result.

603. And sending the at least one selected identification result to a server so as to acquire service information related to the at least one selected identification result from the server.

In 601, when the user sees the interested network resource or the first multimedia information mentioned in the above embodiment in the social media or the shopping platform, the user may obtain the picture to be searched through operations such as screenshot or saving. After opening the first application, the user may click on the picture search button on the search page. And responding to the clicking operation of the user on the picture search button, and jumping the page to the picture selection page. The user selects the picture to be searched in the picture selection page and submits the picture, and the client can identify characters and images of the selected picture.

In the above 602, at least one candidate recognition result may be displayed by page jumping, for example: skipping from the search page to a to-be-selected identification result page, and displaying a control corresponding to the at least one to-be-selected identification result on the to-be-selected identification result page; or, at least one candidate recognition result is displayed through a popup window, for example: and popping up a popup window, and displaying a control corresponding to each to-be-selected identification result in the at least one to-be-selected identification result in the popup window.

In 603, the user selects, as the selected recognition result, the recognition result to be selected that meets the actual requirement of the user from the at least one recognition result to be selected. Specifically, in response to a selection operation of the user on at least one to-be-selected recognition result, the client sends the at least one selected recognition result selected by the user to the server, and receives and displays service information related to the at least one selected recognition result returned by the server.

In specific implementation, in the above 601, "performing character and image recognition on the picture to obtain at least one recognition result to be selected" may specifically be implemented by the following steps:

6011. carrying out image recognition on the picture;

6012. and if the image is identified to exist on the picture, determining an identification result to be selected according to the image.

6013. Performing character recognition on the picture;

6014. and if the characters are identified on the picture, determining the identification result to be selected according to the characters.

In 6011, if an image is recognized on the picture, the image is captured from the picture, and the image is used as a candidate recognition result, and/or semantic analysis is performed on the image to obtain at least one candidate recognition result that can be used as a search keyword.

In 6012, the picture is subjected to character recognition, and character extraction may be performed by using an OCR (Optical character recognition) technology. The concrete implementation of the character extraction by using the OCR technology can be referred to in the prior art, and is not described in detail herein.

Further, the method may further include one of the following steps:

604. and responding to an opening event of the first application, detecting whether a picture obtained based on the first multimedia information exists in the associated space, and if so, obtaining the picture from the associated space.

605. And responding to the picture importing operation of the user on the application page of the first application, and acquiring the imported picture.

606. And acquiring the acquired picture in response to the picture acquisition operation triggered by the user on the application page of the first application.

Here, it should be noted that: for specific implementation of each step in the embodiments of the present application, parts that are not elaborated in this embodiment may refer to relevant contents in the above embodiments, and details are not described here. The method provided in the embodiment of the present application may include all or part of the steps in the embodiments in addition to the steps described above, and specific reference may be made to corresponding contents in the embodiments above, which are not described herein again.

Fig. 7 is a schematic structural diagram illustrating an information display device according to an embodiment of the present application. As shown in fig. 7, the apparatus includes: a first recognition module 701 and a first display module 702. Wherein the content of the first and second substances,

the first identification module 701 is used for responding to an opening event of a first application, and when a picture obtained based on first multimedia information is stored in an associated space, performing character and image identification on the picture to obtain at least one identification result to be selected;

a first display module 702, configured to display the at least one to-be-selected recognition result on an open page of the first application;

the first display module 702 is further configured to display service information related to at least one selected recognition result in response to a selection event triggered for the at least one to-be-selected recognition result.

In the technical scheme provided by the embodiment of the application, at least one identification result to be selected obtained by identifying the characters and the images is displayed to a user for the user to select; and subsequently, acquiring related service information according to the to-be-selected identification result selected by the user. The user can accurately know the real acquisition intention of the user through the selection of the identification result to be selected, so that the service information finally provided for the user is more in line with the real requirement of the user, and the information acquisition accuracy is improved. In addition, according to the technical scheme provided by the embodiment of the application, cross-application network resource sharing can be realized.

Further, the first display module 702 is specifically configured to:

displaying a popup window on an open page of the first application;

and displaying a control corresponding to each to-be-selected recognition result in the at least one to-be-selected recognition result in the popup window.

Further, the first identifying module 701 is specifically configured to:

carrying out image recognition on the picture;

if the image is identified to be on the picture, determining an identification result to be selected based on the image;

performing character recognition on the picture;

and if the picture is identified to contain characters, determining an identification result to be selected according to the characters.

Still further, the first identifying module 701 is further configured to: taking the image as a recognition result to be selected; and/or performing semantic analysis on the image to obtain at least one to-be-selected identification result which can be used as a search keyword.

Still further, the first identifying module 701 is further configured to: if the characters are network resource passwords, taking the network resource passwords as identification results to be selected; and if the characters contain the participles which are in line with the search keyword, taking the participles as the recognition result to be selected.

Further, the first display module 702 is specifically configured to:

when the at least one selected identification result contains a network resource password, displaying the network resource corresponding to the network resource password;

when the at least one selected identification result contains a search keyword, the search keyword is sent to a server, and a search result which is fed back by the server and searched according to the search keyword is displayed;

and when the at least one selected identification result contains an image, sending the image to a server, and displaying a search result which is fed back by the server and is the same as or similar to the image.

Further, the above apparatus may further include:

the first generation module is used for responding to a sharing operation that a user shares content to be shared to a second application, and generating to-be-processed multimedia information which corresponds to the content to be shared and is used for being displayed in the second application;

a first adding module, configured to add a network resource password, generated based on an identifier corresponding to the content to be shared and an identifier corresponding to the user, to the to-be-processed multimedia information to obtain second multimedia information;

and the first sharing module is used for sharing the second multimedia information to the second application.

Further, the device further comprises a storage module, wherein the storage module is used for responding to the screen capturing or saving operation of the user on the first multimedia information and storing the captured or saved picture into the associated space.

Here, it should be noted that: the information display device provided in the above embodiments may implement the technical solutions described in the above method embodiments, and the specific implementation principle of each module or unit may refer to the corresponding content in the above method embodiments, and is not described herein again.

Fig. 8 is a schematic structural diagram of an information acquisition apparatus according to still another embodiment of the present application. As shown in fig. 8, the apparatus includes: a second identification module 801, a first acquisition module 802 and a sending module 803. Wherein the content of the first and second substances,

the second identification module 801 is used for performing character and image identification on the picture to obtain at least one identification result to be selected;

a first obtaining module 802, configured to obtain at least one selected recognition result selected by a user from the at least one to-be-selected recognition result;

a sending module 803, configured to send the at least one selected identification result to a server, so as to obtain service information related to the at least one selected identification result from the server.

Further, the apparatus further includes a second obtaining module, where the second obtaining module is configured to:

responding to an opening event of a first application, detecting whether a picture obtained based on first multimedia information exists in an associated space, and if so, obtaining the picture from the associated space; or

Responding to picture importing operation of a user on an application page of a first application, and acquiring the imported picture; or

And acquiring the acquired picture in response to the picture acquisition operation triggered by the user on the application page of the first application.

Here, it should be noted that: the information obtaining apparatus provided in the foregoing embodiments may implement the technical solutions described in the foregoing method embodiments, and the specific implementation principle of each module or unit may refer to the corresponding content in the foregoing method embodiments, which is not described herein again.

Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device includes: a first memory 1101, a first processor 1102, and a first display 1104. The first memory 1101 may be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device. The first memory 1101 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The first display 1104 coupled to the first processor 1102;

the first processor 1102, coupled to the first memory 1101, is configured to execute the program stored in the first memory 1101 to:

controlling the first display 1104 to display the at least one recognition result to be selected on an open page of the first application;

in response to a selection event triggered for the at least one candidate recognition result, controlling the first display 1104 to display service information related to the at least one selected recognition result.

When executing the program in the first memory 1101, the first processor 1102 may also implement other functions in addition to the above functions, which may be specifically referred to in the description of the foregoing embodiments.

Further, as shown in fig. 9, the electronic device further includes: a first communication component 1103, a first power component 1105, a first audio component 1106, and the like. Only some of the components are schematically shown in fig. 9, and the electronic device is not meant to include only the components shown in fig. 9.

Accordingly, embodiments of the present application also provide a computer-readable storage medium storing a computer program, where the computer program can implement the steps or functions of the information display method provided in the foregoing embodiments when executed by a computer.

Fig. 10 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application. As shown in fig. 10, the electronic device comprises a second memory 1201, a second processor 1202 and a second communication component 1203. The second memory 1201 may be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device. The second memory 1201 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The second processor 1202, coupled to the second memory 1201, is configured to execute the program stored in the second memory 1201, so as to:

the second communication component, coupled to the second processor 1202, is configured to send the at least one selected recognition result to a server, so as to obtain service information related to the at least one selected recognition result from the server. .

When executing the program in the second memory 1201, the second processor 1202 may also implement other functions in addition to the above functions, which may be specifically referred to the description of the foregoing embodiments.

Further, as shown in fig. 10, the electronic device may further include: a second display 1204, a second power component 1205, a second audio component 1206, and the like. Only some of the components are schematically shown in fig. 10, and the electronic device is not meant to include only the components shown in fig. 10.

Accordingly, embodiments of the present application also provide a computer-readable storage medium storing a computer program, where the computer program can implement the steps or functions of the information acquisition method provided in the foregoing embodiments when executed by a computer.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. An information display method, comprising:

2. The method of claim 1, wherein displaying the at least one candidate recognition result on an open page of the first application comprises:

displaying a popup window on an open page of the first application;

3. The method according to claim 1 or 2, wherein the recognizing the picture by characters and images to obtain at least one recognition result to be selected comprises:

carrying out image recognition on the picture;

performing character recognition on the picture;

4. The method of claim 3, wherein determining a candidate recognition result based on the image comprises:

taking the image as a recognition result to be selected; and/or

And performing semantic analysis on the image to obtain at least one to-be-selected identification result which can be used as a search keyword.

5. The method of claim 3, wherein determining the recognition result to be selected according to the text comprises:

if the characters are network resource passwords, taking the network resource passwords as identification results to be selected;

and if the characters contain the participles which are in line with the search keyword, taking the participles as the recognition result to be selected.

6. The method of claim 1 or 2, wherein displaying service information associated with at least one selected recognition result comprises:

7. The method of claim 1 or 2, further comprising:

responding to a sharing operation that a user shares content to be shared to a second application, and generating to-be-processed multimedia information which corresponds to the content to be shared and is used for being displayed in the second application;

adding a network resource password generated based on the identifier corresponding to the content to be shared and the identifier corresponding to the user to the multimedia information to be processed to obtain second multimedia information;

and sharing the second multimedia information to the second application.

8. The method of claim 1 or 2, further comprising:

and responding to the screen capture or saving operation of the user on the first multimedia information, and storing the captured or saved picture into the associated space.

9. An information acquisition system, comprising:

10. An information acquisition method suitable for a client, comprising:

11. The method of claim 10, further comprising:

12. An electronic device, comprising: a first memory, a first processor, and a first display, wherein,

the first memory is used for storing programs;

the first display coupled with the first processor;

13. An electronic device, comprising: a second memory, a second processor, and a second communication component, wherein,

the second memory is used for storing programs;