WO2021164151A1

WO2021164151A1 - Image gallery search method, terminal, and computer storage medium

Info

Publication number: WO2021164151A1
Application number: PCT/CN2020/094769
Authority: WO
Inventors: 陈蓉; 刘丽
Original assignee: 深圳传音控股股份有限公司
Priority date: 2020-02-18
Filing date: 2020-06-05
Publication date: 2021-08-26

Abstract

An image gallery search method, a terminal (10), and a computer storage medium. The image gallery search method is applicable in the terminal (10) and comprises: receiving a search term; performing image recognition with respect to images of which the image content and type match the search term in the image gallery; searching for images for which the recognition results are related to the search term; and displaying, on the basis of a preset rule, the images found; or, receiving an input content of a chat interface (510); searching in the image gallery for images of which the image contents are related to the input content (520); and displaying, on the basis of the images found, a chat content to be transmitted (530). Such means allows the images to be searched directly on the basis of the contents of the images and the search results to be displayed on the basis of the preset rule, or, can be used in searching for images in the image gallery directly on the basis of the contents of the images during a chat process, and is convenient and efficient.

Description

Gallery search method, terminal and computer storage medium

This patent application requires the priority of the Chinese patent application number 202010100420.2 filed on February 18, 2020, the applicant is Shenzhen Transsion Holdings Co., Ltd., and the invention title is "Gallery search method, terminal and computer storage medium", and requires 2020 The Chinese Patent Application No. 202010100435.9 filed on February 18, 2010. The applicant is Shenzhen Transsion Holdings Co., Ltd., and the title of the invention is the priority of "Gallery Search Method, Terminal and Computer Storage Medium". The full text of these two applications is quoted The method is incorporated into this application.

Technical field

This application relates to the field of terminal technology, and in particular to a method for searching a gallery, a terminal, and a computer storage medium.

Background technique

With the rapid development of terminal technology, the functions of mobile terminals such as mobile phones and tablet computers have also been continuously improved, and have gradually become one of the commonly used tools in people's daily life and work.

Generally, the terminal is equipped with a gallery for storing pictures and videos. Users can view the pictures and videos in the gallery by browsing or searching. When the amount of gallery storage is large, users are more inclined to quickly find what they want by searching. However, the current search method is limited to searching under the original classification such as time, person, thing, etc. The classification is limited and the accuracy rate is not high, resulting in users often unable to search for the desired content and can only browse manually The search process is cumbersome and the user experience is poor.

The foregoing description is to provide general background information, and does not necessarily constitute prior art.

technical problem

Technical solutions

In response to the above technical problems, this application provides a method, terminal, and computer storage medium for searching a gallery, which can directly search for pictures based on the content of the pictures, which is faster and more efficient.

In order to solve the above technical problems, this application provides a method for searching a gallery, which is applied to a terminal, and includes:

Receive search terms;

Performing image recognition on pictures whose types of picture content in the gallery match the search term;

Search for a picture associated with the search term as a result of the recognition;

Display the searched pictures according to preset rules.

Wherein, said performing image recognition on a picture whose type of picture content in the gallery matches the search term includes at least one of the following:

When the type of the image content matching the search term is text, image recognition is performed on the image whose type of the image content is text in the gallery to obtain the text content in the image;

When the type of the picture content matching the search term is a graphic, image recognition is performed on the picture whose picture content type is a graphic in the gallery, so as to obtain the graphic content in the picture.

Wherein, the method further includes:

Find a first-level picture classification according to the search term;

Search for a picture whose picture content is associated with the search term in a lower-level picture category of the first-level picture category.

Wherein, the method further includes:

Classify the pictures in the gallery according to the picture content of the pictures in the gallery;

Establishing at least one of the first-level picture classifications according to the classification results;

Classify the pictures in each of the first-level picture categories according to the picture content of the pictures in each of the first-level picture categories, and establish at least a lower-level picture category corresponding to each of the first-level picture categories.

Wherein, displaying the searched pictures according to preset rules includes:

Arrange and display the searched pictures according to the display characteristics of the picture content associated with the search term in each searched picture; and/or,

A preset identifier is displayed at the image content associated with the search term in the searched image.

Wherein, the image content includes text content and/or graphic content, and the display feature includes at least one of the display position, display size, display quantity, display ratio, and color depth of the image content.

Wherein, said displaying the searched pictures according to preset rules further includes:

When the searched pictures include at least one picture from the same video, display the at least one picture and the source video, or display one of the at least one picture and the source video.

This application also provides a second method for searching the gallery, which is applied to a terminal, including:

Receive input from the chat interface;

Searching for pictures in the gallery for pictures whose content is associated with the input content;

Display the chat content to be sent according to the searched pictures.

In the second gallery search method, the search for pictures related to the input content in the gallery includes:

Performing image recognition on the picture whose type of picture content in the gallery matches the input content;

Search for a picture associated with the input content as a result of the recognition.

In the second gallery search method, said performing image recognition on pictures whose type of picture content matches said input content in the gallery includes at least one of the following:

When the type of the image content matching the input content is text, image recognition is performed on the image whose type of the image content is text in the gallery, to obtain the text content in the image as a recognition result;

When the type of the picture content matching the input content is a graphic, image recognition is performed on the picture whose picture content type is a graphic in the gallery, so as to obtain the graphic content in the picture as a recognition result.

Searching for a first-level picture classification according to the input content;

Search for a picture whose picture content is associated with the input content in a lower-level picture category of the first-level picture category.

The second gallery search method also includes:

In the second gallery search method, the displaying the chat content to be sent according to the searched pictures includes:

Selecting at least one related picture from all the searched pictures according to the chat scene corresponding to the input content;

The at least one related picture is displayed as the chat content to be sent, and/or the picture content information derived from the at least one related picture is displayed as the chat content to be sent.

Display the marquee used to capture the picture on the searched picture;

According to the operation of adjusting the marquee box, the part of the picture located in the marquee box is displayed as the chat content to be sent.

Display the picture content information derived from the searched pictures to get the chat content to be sent.

In the second gallery search method, the displaying the image content information derived from the searched image to obtain the chat content to be sent includes:

Display a marquee box for selecting picture content information on the searched pictures, and export the picture content information in the marquee box according to the operation of adjusting the marquee box to obtain the chat content to be sent; and/or,

Display the picture content information associated with the input content derived from the searched pictures to obtain the chat content to be sent.

The present application also provides a terminal, including a memory and a processor, the memory is configured to store at least one program instruction, and the processor is configured to load and execute the at least one program instruction to implement the library search method described above.

The present application also provides a computer storage medium on which computer program instructions are stored; when the computer program instructions are executed by a processor, the above-mentioned gallery search method is implemented.

Beneficial effect

The gallery search method, terminal and computer storage medium of the present application, by receiving search words, perform image recognition on pictures whose type of picture content in the gallery matches the search word, search for pictures associated with the recognition result and the search word, and then according to preset rules Displaying the searched pictures, users can directly search for pictures based on the content of the pictures, and view the search results displayed according to preset rules, which is faster and more efficient. And in the process of chatting, by receiving the input content of the chat interface, searching for pictures related to the image content and the input content in the gallery, and then displaying the chat content to be sent according to the searched pictures, the user can directly according to the picture in the instant communication Content Search for pictures in the gallery, so that you can quickly use the picture information as chat content, which is faster and more efficient.

Description of the drawings

FIG. 1 is a schematic flowchart of a method for searching a gallery according to a first embodiment;

Fig. 2 is a schematic diagram showing a search result according to the first embodiment;

Fig. 3 is a schematic diagram showing another search result according to the first embodiment;

Fig. 4 is a schematic diagram showing still another search result according to the first embodiment;

FIG. 5 is a schematic flowchart of a method for searching a gallery according to a second embodiment;

6 is a schematic flowchart of a method for searching a gallery according to a third embodiment;

FIG. 7 is a schematic flowchart of a method for searching a gallery according to a fourth embodiment;

Fig. 8 is a schematic diagram of a chat interface according to a fourth embodiment;

FIG. 9 is a schematic flowchart of a method for searching a gallery according to a fifth embodiment;

FIG. 10 is a schematic flowchart of a method for searching a gallery according to a sixth embodiment;

Fig. 11 is one of the schematic structural diagrams of a terminal according to a seventh embodiment;

Fig. 12 is a second structural diagram of the terminal shown in Fig. 11.

Implementation of this application

The following specific examples illustrate the implementation of this application. Those familiar with this technology can easily understand the other advantages and effects of this application from the content disclosed in this specification.

In the following description, with reference to the accompanying drawings, the accompanying drawings describe several embodiments of the present application. It should be understood that other embodiments can also be used, and mechanical, structural, electrical, and operational changes can be made without departing from the spirit and scope of the present application. The following detailed description should not be considered as restrictive, and the terms used here are only for describing specific embodiments and are not intended to limit the application.

The first embodiment

Fig. 1 is a schematic flowchart of a gallery search method according to a first embodiment. Please refer to Figure 1. The gallery search method of this embodiment is applied to a terminal and includes:

Step 110: Receive a search term.

Wherein, the search term is, for example, content entered in the search bar of the gallery or any other input bar that can be used to search the gallery, and the search term can be a word, a phrase, a symbol, a word, etc.

Step 120: Search the image gallery for the image associated with the image content and the search term.

Among them, the image content is the constituent content of the image, including text content and/or graphic content. The text content is the content composed of characters, which can be any recognizable characters such as Chinese characters, Pinyin or English. Graphic content is also content composed of graphics with shapes and colors, such as a red area, a red circle, a square, and so on.

When searching for pictures, the search terms are first analyzed to narrow or determine the search scope, for example, to know the type of picture content that the user enters the current search term to search for, or to determine the picture category to be searched based on the content of the search term.

In one embodiment, the process of searching for pictures related to the content of the pictures and the search terms in the gallery includes:

Perform image recognition on pictures whose type of picture content in the gallery matches the search term;

Search for the picture associated with the search term and the recognition result.

Among them, the type of the picture content of each picture in the gallery can be automatically identified and marked when the picture is added, and the type of the picture content is text, graphics, or a combination of text and graphics. Different search terms can match different types of image content. A search term can match at least one type of image content. For example, when the search term is "red", it can match text and graphic image content, and the search term "Score", only match the content of the image whose type is text.

When the type of the image content matching the search term is text, image recognition is performed on the image whose type of the image content is text in the gallery, so as to obtain the text content in the image as a recognition result. Taking the search term as "score" as an example, perform image recognition on pictures in the gallery whose content type is text. After the recognition results are obtained, the recognition results are filtered. The recognition results associated with the search terms can include "scores", Contents such as "score", "fenshu", and "number of copies", that is to say, content with the same search term, similar meaning, and same pronunciation are all related content.

When the type of the picture content that matches the search term is a graphic, image recognition is performed on the picture whose type of the picture content is a graphic in the gallery to obtain the graphic content in the picture. Taking the search term as "red" as an example, perform image recognition on the picture whose content type is graphics in the gallery. After the recognition result is obtained, the recognition result is filtered. The recognition result associated with the search term only needs to contain red in the picture. Or the red graphics area. For search terms whose content is "red", image recognition can also be performed on pictures whose content type is text in the gallery at the same time, so as to obtain the text content in the picture as the recognition result, which will not be repeated here.

In another embodiment, the search for pictures associated with the image content and the search term in the gallery includes:

Find the first-level picture classification according to the search term;

Search for pictures associated with the image content and the search term in the lower-level picture categories of the first-level picture category.

Among them, the pictures in the gallery are classified in advance according to the picture content of the pictures in the gallery, at least one first-level picture classification is established according to the classification results, and then each first-level picture is classified according to the picture content of the pictures in each first-level picture classification The pictures in the classification are classified, and at least a lower-level picture classification corresponding to each first-level picture classification is established. For example, if the same keyword appears more than the set number of times in multiple pictures at the same time, a first-level picture classification is automatically set up. Take the keyword "score" as an example, for multiple pictures that contain more than 5 keywords "score" Set up a first-level picture classification "score", and then create a lower-level picture classification based on the content related to the keyword "score" in the multiple pictures, for example, the lower-level picture classification can be "exam score", "game score", etc., in the classification In the process, the names of locations and contacts associated with photos that contain "scores" are also included in the classification.

After the picture classification is established, the first-level picture classification is searched according to the search words, and then the pictures related to the picture content and the search word are searched in the lower-level picture classifications of the first-level picture classification. Take the search term "admission score" as an example, first find the first-level picture category "score", and then find the related category "exam score" in its lower-level picture categories "exam category" and "game score", and then in the "exam category" Search for pictures related to the search term in the picture. When searching, you can perform image recognition on pictures in the gallery whose type of picture content matches the search term, and search for pictures related to the search term in the recognition result. The process will not be repeated.

By establishing classification or identifying the type of picture content, the search process can be made faster. In actual implementation, it is also preferable to use picture compression to search.

Step 130: Display the searched pictures according to preset rules.

Wherein, after the search results are obtained, the searched pictures are displayed according to preset rules, and the preset rules include preset sorting rules and/or preset identification rules.

In one embodiment, displaying the searched pictures according to preset rules includes:

According to the display characteristics of the image content associated with the search term in each searched image, the searched images are arranged and displayed.

Wherein, the image content includes text content and/or graphic content, and the display characteristics include at least one of the display position, display size, display quantity, display ratio, and color depth of the image content.

When the picture content includes text content, the display characteristics of the picture content include the display position of the characters in the picture, the size of the characters, the number of characters, etc., and the arrangement order of the pictures is determined according to the combination evaluation of the display characteristics. Taking the associated picture content as the text content "A" as an example, in Figure 2(a), the text content contains 3 characters "A", and one of the characters "A" is located in the center of the picture and the font is larger. In 2(b), the text content contains 3 characters "A", none of the characters "A" are located in the center of the picture and the font is small. When setting the sorting rules, the closer the picture content is to the center or focus of the picture, the association The higher the degree, the larger the display size of the picture content, the higher the degree of relevance, the greater the number of picture contents displayed, the higher the degree of relevance, and so on, but it is not limited to this. In this way, according to the display position, character size, number of characters, etc. of the character "A" in the two figures, it can be evaluated that the correlation degree of the picture in Figure 2 (a) is greater than the correlation degree of the picture in Figure 2 (b), and then the picture The relevance of the picture in 2(a) is greater than the front of the picture in Fig. 2(b).

When the picture content includes graphic content, the display characteristics of the picture content include the display position, area size, area proportion, color depth, etc. of the graphic in the picture, and the arrangement order of the pictures is determined according to the combination evaluation of the display characteristics. Taking the associated picture content as the graphic content "shadow" as an example, in Figure 3(a), the graphic content contains a circle with a shadow, and the circle is located at the center of the picture. In Figure 3(b), the graphic content The content contains 2 shaded circles, one of which is located in the center of the picture. The area of the circle in Figure 3(a) is larger than the area of the circle in Figure 3(b). When the sorting rules are set, the picture The closer the content is to the center or focus of the picture, the higher the degree of relevance and the larger the proportion of picture content. The higher the degree of relevance, the greater the number of picture contents displayed, the higher the degree of relevance, and so on, but not limited to this. In this way, according to the display position, area size, area ratio, color depth, etc. of the circles in the two pictures, it can be evaluated that the correlation degree of the picture in Fig. 3(a) is greater than that of the picture in Fig. 3(b) , And then make the picture in Fig. 3(a) more relevant than the front of the picture in Fig. 3(b).

In another embodiment, displaying the searched pictures according to preset rules includes:

The preset identifier is displayed at the image content associated with the search term in the searched image.

Wherein, the preset mark includes at least one of a preset color mark, a preset border mark, and a preset deformation mark. The preset color mark refers to changing the color of the image content to a preset color to highlight the corresponding content, for example, To red, the color change can be maintained or disappear after a period of time. The preset frame line identification refers to using a preset frame or line to indicate to highlight the corresponding content. For example, as shown in FIG. 4, an underline 190 is used for identification in the associated picture content "SCORE A: 123". The preset deformation flag refers to performing preset deformation processing on the image content to highlight the corresponding content, for example, processing the image content to tilt or enlarge. By displaying the preset logo, it is helpful for users to find key information quickly and accurately.

In actual implementation, the pictures can be pre-identified while sorting the pictures. The pictures to be pre-identified can be the first preset number of pictures, that is, the pictures with the degree of relevance higher than a certain value are preset Identification processing, thereby reducing the computational process of image search.

In addition, the video is composed of multiple frames of pictures, so the search can also be performed on the video, that is, the combined picture of the video is searched. When the searched picture includes at least one picture from the same video, at least one picture and The source video, or one of at least one of the pictures and the source video, the pictures from the video are displayed together with other independent pictures, the sorting rules and the processing method of the preset identification are the same as above, and will not be repeated.

In the gallery search method of this embodiment, by receiving a search term, the image content and the image associated with the search term are searched in the gallery, and the searched image is displayed according to preset rules. The user can directly search for the image based on the content of the image, and View the search results displayed according to preset rules, which is faster and more efficient.

Second embodiment

Fig. 5 is a schematic flowchart of a method for searching a gallery according to a second embodiment. Please refer to FIG. 5, the gallery search method of this embodiment, applied to a terminal, includes:

Step 210: Receive a search term.

Step 220: Search the gallery for pictures whose content is associated with the search term.

For the specific implementation process of this step, reference may be made to the related description of step 120 in the first embodiment, which will not be repeated here.

In step 230, the searched pictures are arranged and displayed according to the display characteristics of the picture content associated with the search term in each searched picture.

Further, while arranging and displaying the searched pictures according to the display characteristics of the picture content associated with the search term in each searched picture, the preview is displayed at the picture content associated with the search term of the searched picture. Set logo.

Wherein, the preset mark includes at least one of a preset color mark, a preset border mark, and a preset deformation mark. The preset color mark refers to changing the color of the image content to a preset color to highlight the corresponding content, for example, To red, the color change can be maintained or disappear after a period of time. The preset frame line identification refers to the use of a preset frame or line to indicate to highlight the corresponding content. For example, as shown in FIG. 4, an underline is used for identification in the associated picture content "SCORE A: 123". The preset deformation flag refers to performing preset deformation processing on the image content to highlight the corresponding content, for example, processing the image content to tilt or enlarge. By displaying the preset logo, it is helpful for users to find key information quickly and accurately.

In the gallery search method of this embodiment, by receiving a search term, the image content of the image associated with the search term is searched in the gallery, and then according to the display characteristics of the image content associated with the search term in each searched image, The searched pictures are arranged and displayed, and users can directly search for pictures based on the content of the pictures, and view the search results sorted according to the degree of relevance, which is faster and more efficient.

The third embodiment

Fig. 6 is a schematic flowchart of a method for searching a gallery according to a third embodiment. Please refer to FIG. 6, the gallery search method of this embodiment, applied to a terminal, includes:

Step 310: Receive a search term.

Step 320: Search the gallery for pictures whose content is associated with the search term.

Step 330: Display a preset identifier at the image content associated with the search term of the searched image.

Further, while displaying the preset identifier at the image content associated with the search term of the searched image, the searched images are arranged according to the display characteristics of the image content associated with the search term in each searched image exhibit.

In actual implementation, the video is composed of multiple frames of pictures, so the search can also be performed on the video, that is, the combined picture of the video is searched. When the searched picture includes at least one picture from the same video, at least one picture is displayed Picture and source video, or display one of at least one picture and the source video, the picture from the video is displayed together with other independent pictures, the sorting rules and the identification rules of the picture content are the same as above.

In addition, when identifying the content of a picture, only the pre-set number of pictures in the front may be identified, that is, pictures with a correlation degree higher than a certain value may be pre-identified, thereby reducing the calculation process of the picture search.

In the gallery search method of this embodiment, by receiving a search term, the image content in the gallery is searched for a picture associated with the search term, and then a preset identifier is displayed at the image content associated with the search term of the searched image, and the user can Find pictures directly based on the content of the pictures, and find key information quickly and accurately, which is faster and more efficient.

Fourth embodiment

Fig. 7 is a schematic flowchart of a method for searching a gallery according to a fourth embodiment. Please refer to FIG. 7, the gallery search method of this embodiment, applied to a terminal, includes:

Step 510: Receive input content of the chat interface.

Please refer to Figure 8, a chat interface 60 can display contact information 610, contact chat content 620, user chat content 630, input field 640, etc., in the input field 640, the input content input by the user operation is displayed 670, and the gallery search result displayed according to the input content 670 according to the embodiment of the present application, such as a picture 660. Among them, the input content can be a word, a phrase, a symbol, a word, etc. In this embodiment, the input content received by the chat interface is also the search term.

Step 520: Search the gallery for a picture associated with the picture content and the input content.

When searching for pictures, the input content is first analyzed to narrow or determine the search scope, for example, to know the type of picture content that the user wants to search for inputting the current input content, or to determine the picture category to be searched according to the content of the input content.

In one embodiment, the process of searching for pictures related to the input content and the picture content in the gallery includes:

Perform image recognition on pictures whose type of picture content in the gallery matches the input content;

Search for pictures associated with the recognition result and the input content.

Among them, the type of the picture content of each picture in the gallery can be automatically identified and marked when the picture is added, and the type of the picture content is text, graphics, or a combination of text and graphics. Different input content can match different types of image content, and one input content can match at least one type of image content. For example, when the input content is "red", it can match the image content of text and graphics, and the input content "Score", only match the content of the image whose type is text.

When the type of the picture content that matches the input content is text, image recognition is performed on the picture whose picture content type is text in the gallery, so as to obtain the text content in the picture as a recognition result. Taking the input content as "score" as an example, perform image recognition on pictures in the gallery whose image content is text. After the recognition results are obtained, the recognition results are filtered. The recognition results associated with the input content can include "scores", "Score", "fenshu", "number of copies" and other content, that is, content with the same input content, similar meaning, and same pronunciation are all related content.

When the type of the picture content matching the input content is a graphic, image recognition is performed on the picture whose picture content type is a graphic in the gallery, so as to obtain the graphic content in the picture. Taking the input content as "red" as an example, perform image recognition on the picture whose content type is graphics in the gallery. After the recognition result is obtained, the recognition result is filtered. The recognition result associated with the input content only needs to contain red in the picture. Or the red graphics area. For the input content whose content is "red", it is also possible to perform image recognition on the picture whose content type is text in the gallery at the same time, so as to obtain the text content in the picture as the recognition result, which will not be repeated here.

In another embodiment, searching for pictures associated with the picture content and the input content in the gallery includes:

Find the first-level picture classification according to the input content;

Search for pictures associated with the picture content and the input content in the lower-level picture categories of the first-level picture category.

After the picture classification is established, the first-level picture classification is searched according to the input content, and then the pictures related to the input content are searched in the lower-level picture classification of the first-level picture classification. Take the input content "admission score" as an example, first find the first-level picture category "score", and then find the related category "examination score" in the subordinate image categories "exam category" and "game score", and then in the "examination category" Search for pictures related to the input content in the picture. When searching, you can perform image recognition on pictures in the gallery whose type of picture content matches the input content, and search for pictures related to the input content. The process will not be repeated.

Step 530: Display the chat content to be sent according to the searched picture.

Among them, after the search results are obtained, the searched pictures are displayed according to preset rules. In this embodiment, certain processing is performed on the search results to obtain the corresponding chat content to be sent. The chat content to be sent means that the user can operate The content to be sent includes, but is not limited to, the input content 670 located in the input field 640. For example, the image 660 can also be sent directly by clicking on the image 660. At this time, the image 660 is also the chat content to be sent.

In an embodiment, displaying the chat content to be sent according to the searched pictures may include:

Select at least one related picture from all the searched pictures according to the chat scene corresponding to the input content;

At least one associated picture is displayed as the chat content to be sent, and/or the picture content information associated with the input content in the at least one associated picture is displayed as the chat content to be sent.

The searched picture is a picture associated with the input content 670, and then at least one related picture is selected from all the searched pictures according to the chat scene corresponding to the input content 670, and the related picture is, for example, the picture 660. The chat scene can be analyzed based on the contact information 610, the contact chat content 620, and the user chat content 630. For example, the input content 670 is "SCORE", and according to the contact information 610, the contact chat content 620, and the user The chat content 630 is analyzed and it is found that what the user wants to send is the score of the subject "A", so from all the pictures found, they choose to include "SCORE A" at least one picture, such as picture 660. In actual implementation, the video is composed of multiple frames of pictures, so the search can also be performed on the video, that is, the combined picture of the video is searched, when the searched for at least one related picture When including at least two pictures from the same video, select one picture from at least two pictures as the associated picture.

Further, when there is more than one related picture, the pictures can be sorted according to the degree of relevance between the related picture and the chat scene.

Or, when there is more than one related picture, the related pictures can also be arranged and displayed according to the display characteristics of the picture content related to the input content in each related picture.

In another embodiment, a preset identifier may also be displayed at the image content associated with the search term of the associated image.

After at least one related picture is filtered out, the at least one filtered out related picture can be directly displayed as the chat content to be sent, and/or the picture content information related to the input content in the filtered out at least one related picture can be displayed as the to-be sent Chat content. Wherein, as shown in FIG. 8, when at least one related picture selected is directly displayed as the chat content to be sent, it is displayed in the chat interface 60 in the form of a picture 660, and the position is not limited to the picture, or may not be displayed. In the current chat interface 60, another interface display is used to facilitate the user to browse or select. At the same time, the picture content information associated with the input content in the picture can also be displayed as the chat content to be sent, for example, the picture 660 The picture content information associated with the input content 670 is "SCORE A: 123" or "123". When the picture content information is used as the chat content to be sent, it can be directly inserted into the current input content 670 or replace the current input content 670, thereby Get the new input content as the chat content to be sent.

In another embodiment, when displaying the chat content to be sent according to the searched picture, it may further include:

Display the marquee used to capture the picture on the searched picture;

According to the operation of adjusting the marquee, the part of the picture in the marquee is displayed as the chat content to be sent.

The searched picture may be at least one related picture selected from all the searched pictures according to the chat scene corresponding to the input content 670, and the related picture is, for example, the picture 660. Please refer to FIG. 8, a marquee 650 for capturing the picture is displayed on the picture 660. The user can capture the desired part from the picture 660 to obtain another picture by adjusting the position and size of the marquee 650, which serves as a waiting The chat content sent. In this way, when the user is unwilling to make public or because of traffic or other information of the picture, some of the information in the picture can be sent by means of screenshots. The initial position of the marquee 650 can be located at the image content associated with the input content of the searched picture, for example, displayed at the position of "SCORE A: 123", which can reduce user operations. Of course, the marquee 650 can also be indirect It is displayed on the picture 660, and can be displayed on the picture 660 by triggering operations such as double-clicking the picture 660.

In still another embodiment, displaying the chat content to be sent according to the searched pictures may also include:

Wherein, the process of exporting the picture content information can be manually selecting the export, for example, displaying the picture content information derived from the searched pictures to obtain the chat content to be sent, and may also include:

Display a selection box for selecting the content information of the picture on the searched picture;

According to the operation of adjusting the marquee, the picture content information in the marquee is exported to obtain the chat content to be sent.

The searched picture may be at least one related picture selected from all the searched pictures according to the chat scene corresponding to the input content 670, and the related picture is, for example, the picture 660. Please refer to FIG. 8. The marquee used to select the content information of the picture displayed on the picture 660 can be displayed in the form of the marquee 650 used to capture the picture or displayed in other convenient ways. The user adjusts the position and size of the marquee , You can select the desired picture content information from the picture 660, and then export the picture content information in the marquee as the chat content to be sent. When exporting the picture content information in the marquee as the chat content to be sent, The picture content information in the selection box is added to the input content 670 as the chat content to be sent, or the input content 670 is replaced with the picture content information in the selection box to obtain the chat content to be sent. In this way, when the user is unwilling to make the public due to traffic or other information of the picture, the key content information in the picture can be sent in the way of export. The initial position of the marquee used to select the image content information can be located at the image content associated with the input content of the searched image, for example, displayed in "SCORE A: 123”, which can reduce user operations. Of course, the marquee used to select picture content information may not be directly displayed on the picture 660, but can be displayed on the picture 660 by long-pressing the picture 660 and other trigger operations. .

In actual implementation, when exporting the picture content information in the marquee as the chat content to be sent, it can also automatically export the picture content information from the picture according to the preset number of characters, and the part that exceeds the preset number of characters will not be exported. That is, the exported picture content information is less than or equal to the preset number.

In addition, the process of exporting picture content information can also be automatic export. For example, displaying the picture content information derived from the searched pictures to obtain the chat content to be sent, which may include:

Among them, the picture content information associated with the input content in the picture is exported to the input column by means of automatic recognition and extraction. For example, in FIG. 8, the picture content information associated with the input content 670 in the picture 660 is "SCORE A: 123 "Or "123", when the picture content information is used as the chat content to be sent, it can be directly inserted into the current input content 670 or replace the current input content 670, thereby obtaining new input content as the chat content to be sent, that is, "SCORE A: 123" or "123" as the chat content to be sent. When automatically exporting the picture content information associated with the input content, the exported picture content information is less than or equal to a preset number.

The image content includes text content and/or graphic content. Therefore, in addition to exporting the text content in the image, you can also export the corresponding graphics from the associated image and insert it into the input content 670, for example, when the input content is "red circle" , The red circle can be derived from the associated picture and inserted into the input content 670, thereby enriching the style of the input content 670.

In the gallery search method of this embodiment, by receiving the input content of the chat interface, searching for pictures related to the image content and the input content in the gallery, and then displaying the chat content to be sent according to the searched pictures, the user can directly follow The content of the picture searches for the picture, so that the information of the picture can be quickly used as the chat content, which is faster and more efficient.

Fifth embodiment

Fig. 9 is a schematic flowchart of a method for searching a gallery according to a fifth embodiment. Please refer to FIG. 9, the gallery search method of this embodiment, applied to a terminal, includes:

Step 710: Receive input content of the chat interface.

Please refer to Figure 8, a chat interface 60 can display contact information 610, contact chat content 620, user chat content 630, input field 640, etc., in the input field 640, the input content input by the user operation is displayed 670, and the gallery search result displayed according to the input content 670 according to the embodiment of the present application, such as a picture 660. Among them, the input content can be a word, a phrase, a symbol, a word, etc.

Step 720: Search the gallery for a picture associated with the picture content and the input content.

For the specific implementation process of this step, reference may be made to the related description of step 520 in the fourth embodiment, which will not be repeated here.

In step 730, a marquee for capturing the picture is displayed on the searched picture.

When the marquee used to capture the picture is displayed on the searched picture, the marquee is displayed at the picture content associated with the input content of the searched picture. The searched picture is, for example, from the search to the chat scene corresponding to the input content. Select at least one associated picture from all pictures in, such as picture 660. Referring to FIG. 8, a marquee 650 for capturing the picture is displayed on the picture 660. The initial position of the marquee 650 can be located at the image content associated with the input content of the searched picture, for example, displayed in "SCORE A: 123" Therefore, the user's operations can be reduced. Of course, the selection box 650 may not be directly displayed on the picture 660, but may be displayed on the picture 660 by a trigger operation such as double-clicking the picture 660.

Step 740: According to the operation of adjusting the marquee, the part of the picture located in the marquee is displayed as the chat content to be sent.

Among them, the chat content to be sent refers to the content that the user can manipulate to send, including but not limited to the input content 670 and pictures located in the input field 640. In this embodiment, as shown in FIG. 8, the user adjusts the selection box 650 The position and size of, you can intercept the desired part from the picture 660 to obtain another picture, which is used as the chat content to be sent. When there are multiple pictures, multiple chat contents can be obtained. In this way, when the user is unwilling to make public or because of traffic or other information of the picture, some of the information in the picture can be sent by means of screenshots.

In the gallery search method of this embodiment, by receiving the input content of the chat interface, after searching the image related to the input content in the gallery, a marquee for capturing the image is displayed on the searched image, and the marquee is adjusted according to the The operation of displaying the part of the picture in the selection box as the chat content to be sent, the user can directly search for pictures in the gallery according to the content of the picture during instant messaging, so as to quickly intercept part of the picture as the chat content, which is faster and more efficient .

Sixth embodiment

Fig. 10 is a schematic flowchart of a method for searching a gallery according to a sixth embodiment. Please refer to FIG. 10, the gallery search method of this embodiment, applied to a terminal, includes:

Step 810: Receive input content of the chat interface.

Step 820: Search the gallery for pictures related to the picture content and the input content.

Step 830: Display the picture content information derived from the searched pictures to obtain the chat content to be sent.

In an embodiment, displaying the image content information derived from the searched image to obtain the chat content to be sent may include:

In another embodiment, the process of exporting the image content information may also be automatic export. For example, displaying the image content information derived from the searched image to obtain the chat content to be sent may include:

In the gallery search method of this embodiment, by receiving the input content of the chat interface, the image content is searched in the gallery for pictures associated with the input content, and then the image content information derived from the searched pictures is displayed to obtain the chat content to be sent. The user can directly search for pictures in the gallery according to the content of the pictures during instant messaging, so as to obtain the information derived from the pictures as the chat content, which is faster and more efficient.

Seventh embodiment

Fig. 11 is one of the schematic structural diagrams of the terminal according to the seventh embodiment. Referring to FIG. 11, the terminal 10 of this embodiment includes a memory 102 and a processor 106. The memory 102 is used to store at least one program instruction, and the processor 106 is used to load and execute at least one program instruction to implement the first embodiment to the first embodiment. The gallery search method described in the sixth embodiment.

12, in actual implementation, the terminal 10 includes a memory 102, a storage controller 104, one or more (only one is shown in the figure) processor 106, a peripheral interface 108, a radio frequency module 150, a positioning module 112, and a camera Module 114, audio module 116, screen 118, and button module 160. These components communicate with each other through one or more communication buses/signal lines 122.

It can be understood that the structure shown in FIG. 12 is only for illustration, and the terminal 102 may also include more or fewer components than those shown in FIG. 12, or have a different configuration from that shown in FIG. The components shown in FIG. 12 can be implemented by hardware, software, or a combination thereof.

The memory 102 can be used to store software programs and modules, such as program instructions/modules corresponding to the library search method in the embodiment of the present application. The processor 106 executes various functions by running the software programs and modules stored in the storage controller 104 Application and data processing realize the above-mentioned gallery search method.

The memory 102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 102 may further include a memory remotely provided with respect to the processor 106, and these remote memories may be connected to the terminal 10 through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. The processor 106 and other possible components may access the memory 102 under the control of the memory controller 104.

The peripheral interface 108 couples various input/input devices to the CPU and the memory 102. The processor 106 runs various software and instructions in the memory 102 to perform various functions of the terminal 10 and perform data processing.

In some embodiments, the peripheral interface 108, the processor 106, and the storage controller 104 may be implemented in a single chip. In some other instances, they can be implemented by independent chips.

The radio frequency module 150 is used to receive and send electromagnetic waves, realize mutual conversion between electromagnetic waves and electrical signals, and communicate with a communication network or other devices. The radio frequency module 150 may include various existing circuit elements for performing these functions, for example, an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a subscriber identity module (SIM) card, a memory, and so on. The radio frequency module 150 can communicate with various networks such as the Internet, an intranet, and a wireless network, or communicate with other devices through a wireless network. The aforementioned wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. The above-mentioned wireless network can use various communication standards, protocols and technologies, including but not limited to the Global System for Mobile Communications (Global System for Mobile Communication, GSM), enhanced mobile communication technology (Enhanced Data GSM Environment, EDGE), wideband code division multiple access technology (wideband code division multiple access (W-CDMA), code division multiple access (Code division access, CDMA), time division multiple access (TDMA), Bluetooth, wireless fidelity technology (Wireless Fidelity, WiFi) (such as the American Institute of Electrical and Electronics Engineers standard IEEE 802.11a, IEEE 802.11b, IEEE802.11g and/or IEEE 802.11n), Internet phone (Voice over Internet Protocol, VoIP), Worldwide Interoperability for Microwave Access (Wi-Max), other protocols used for mail, instant messaging and short messages, and any other suitable communication protocols, including those currently available A protocol that has not yet been developed.

The positioning module 112 is used to obtain the current position of the terminal 10. Examples of the positioning module 112 include, but are not limited to, a global satellite positioning system (GPS), a positioning technology based on a wireless local area network or a mobile communication network.

The camera module 114 is used to take photos or videos. The captured photos or videos can be stored in the memory 102 and can be sent through the radio frequency module 150.

The audio module 116 provides an audio interface to the user, which may include one or more microphones, one or more speakers, and an audio circuit. The audio circuit receives sound data from the peripheral interface 108, converts the sound data into electrical information, and transmits the electrical information to the speaker. The speaker converts electrical information into sound waves that can be heard by the human ear. The audio circuit also receives electrical information from the microphone, converts the electrical signal into sound data, and transmits the sound data to the peripheral interface 108 for further processing. The audio data may be obtained from the memory 102 or through the radio frequency module 150. In addition, the audio data may also be stored in the memory 102 or sent through the radio frequency module 150. In some examples, the audio module 116 may also include a headphone jack for providing an audio interface to headphones or other devices.

The screen 118 provides an output interface between the terminal 10 and the user. Specifically, the screen 118 displays video output to the user, and the content of the video output may include text, graphics, video, and any combination thereof. Some output results correspond to some user interface objects. It is understandable that the screen 118 may also include a touch screen. The touch screen provides an output and input interface between the terminal 10 and the user at the same time. In addition to displaying video output to the user, the touch screen also receives user input, such as gesture operations such as the user's click and slide, so that user interface objects can respond to these user inputs. The technology for detecting user input may be based on resistive, capacitive, or any other possible touch detection technology. Specific examples of the touch screen display unit include, but are not limited to, a liquid crystal display or a light-emitting polymer display.

The button module 160 also provides an interface for the user to input to the terminal 10, and the user can press different buttons to make the terminal 10 perform different functions.

The present application also provides a computer storage medium on which computer program instructions are stored; when the computer program instructions are executed by a processor, the library search method as described in the first to sixth embodiments is implemented.

In actual implementation, the computer storage medium is applied to the terminal shown in FIG. 11 or FIG. 12, so that the picture can be directly searched for and used according to the content of the picture, which is faster and more efficient.

The embodiments of the present application also provide a computer program product. The computer program product includes computer program code. When the computer program code runs on a computer, the computer executes the methods described in the various possible implementation manners above.

The embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the chip is installed The device executes the methods described in the various possible implementation manners above.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or device. Without more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other same elements in the process, method, article or device that includes the element. In addition, the application is implemented differently. Components, features, and elements with the same name in the examples may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this document, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information. Depending on the context, the word "if" as used herein can be interpreted as "when" or "when" or "in response to determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to also include the plural forms, unless the context dictates to the contrary. It should be further understood that the terms "comprising" and "including" indicate the presence of the described features, steps, operations, elements, components, items, types, and/or groups, but do not exclude one or more other features, steps, operations, The existence, appearance or addition of elements, components, items, categories, and/or groups. The terms "or" and "and/or" used herein are interpreted as inclusive or mean any one or any combination. Therefore, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C" . An exception to this definition will only occur when the combination of elements, functions, steps or operations is inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowchart in the foregoing embodiment are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least part of the steps in the figure may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is not necessarily sequential. Instead, it may be performed alternately or alternately with other steps or at least a part of other steps or sub-steps or stages.

The above-mentioned embodiments only exemplarily illustrate the principles and effects of the present application, and are not used to limit the present application. Anyone familiar with this technology can modify or change the above-mentioned embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or changes made by persons with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed in this application should still be covered by the claims of this application.

Industrial applicability

Claims

A gallery search method, applied to a terminal, including:

Receive search terms;

Performing image recognition on pictures whose types of picture content in the gallery match the search term;

Search for a picture associated with the search term as a result of the recognition;

Display the searched pictures according to preset rules.
The method for searching a gallery according to claim 1, wherein said performing image recognition on a picture whose type of picture content in the gallery matches the search term includes at least one of the following:

When the type of the image content matching the search term is text, image recognition is performed on the image whose type of the image content is text in the gallery to obtain the text content in the image;

When the type of the picture content matching the search term is a graphic, image recognition is performed on the picture whose picture content type is a graphic in the gallery, so as to obtain the graphic content in the picture.
The gallery search method according to claim 1, wherein the method further comprises:

Find a first-level picture classification according to the search term;

Search for a picture whose picture content is associated with the search term in a lower-level picture category of the first-level picture category.
The method for searching the gallery according to claim 3, wherein the method further comprises:

Classify the pictures in the gallery according to the picture content of the pictures in the gallery;

Establishing at least one of the first-level picture classifications according to the classification results;

Classify the pictures in each of the first-level picture categories according to the picture content of the pictures in each of the first-level picture categories, and establish at least a lower-level picture category corresponding to each of the first-level picture categories.
The gallery search method according to claim 1, wherein said displaying the searched pictures according to preset rules comprises:

Arrange and display the searched pictures according to the display characteristics of the picture content associated with the search term in each searched picture; and/or,

A preset identifier is displayed at the image content associated with the search term in the searched image.
The gallery search method according to claim 5, wherein the image content includes text content and/or graphic content, and the display characteristics include the display position, display size, display quantity, display ratio, and color depth of the image content. At least one of.
The gallery search method according to claim 1 or 5, wherein said displaying the searched pictures according to preset rules further comprises:

When the searched pictures include at least one picture from the same video, display the at least one picture and the source video, or display one of the at least one picture and the source video.
A gallery search method, applied to a terminal, including:

Receive input from the chat interface;

Searching for pictures in the gallery for pictures whose content is associated with the input content;

Display the chat content to be sent according to the searched pictures.
8. The gallery search method according to claim 8, wherein said searching the gallery for a picture whose picture content is associated with the input content comprises:

Performing image recognition on the picture whose type of picture content in the gallery matches the input content;

Search for a picture associated with the input content as a result of the recognition.
The method for searching a gallery according to claim 9, wherein said performing image recognition on a picture whose type of picture content in the gallery matches the input content includes at least one of the following:

When the type of the image content matching the input content is text, image recognition is performed on the image whose type of the image content is text in the gallery, to obtain the text content in the image as a recognition result;

When the type of the picture content matching the input content is a graphic, image recognition is performed on the picture whose picture content type is a graphic in the gallery, so as to obtain the graphic content in the picture as a recognition result.
8. The gallery search method according to claim 8, wherein said searching the gallery for a picture whose picture content is associated with the input content comprises:

Searching for a first-level picture classification according to the input content;

Search for a picture whose picture content is associated with the input content in a lower-level picture category of the first-level picture category.
The method for searching a gallery according to claim 11, wherein the method further comprises:

Classify the pictures in the gallery according to the picture content of the pictures in the gallery;

Establishing at least one of the first-level picture classifications according to the classification results;

Classify the pictures in each of the first-level picture categories according to the picture content of the pictures in each of the first-level picture categories, and establish at least a lower-level picture category corresponding to each of the first-level picture categories.
8. The gallery search method according to claim 8, wherein said displaying the chat content to be sent according to the searched pictures comprises:

Selecting at least one related picture from all the searched pictures according to the chat scene corresponding to the input content;

The at least one related picture is displayed as the chat content to be sent, and/or the picture content information derived from the at least one related picture is displayed as the chat content to be sent.
8. The gallery search method according to claim 8, wherein said displaying the chat content to be sent according to the searched pictures comprises:

Display the marquee used to capture the picture on the searched picture;

According to the operation of adjusting the marquee box, the part of the picture located in the marquee box is displayed as the chat content to be sent.
8. The gallery search method according to claim 8, wherein said displaying the chat content to be sent according to the searched pictures comprises:

Display the picture content information derived from the searched pictures to get the chat content to be sent.
15. The gallery search method according to claim 15, wherein said displaying the image content information derived from the searched image to obtain the chat content to be sent comprises:

Display a marquee box for selecting picture content information on the searched pictures, and export the picture content information in the marquee box according to the operation of adjusting the marquee box to obtain the chat content to be sent; and/or,

Display the picture content information associated with the input content derived from the searched pictures to obtain the chat content to be sent.
A terminal, comprising a memory and a processor, the memory is used to store at least one program instruction, and the processor is used to load and execute the at least one program instruction to implement any one of claims 1 to 16 The described gallery search method.
A computer storage medium, wherein computer program instructions are stored on the computer storage medium; when the computer program instructions are executed by a processor, the library search method according to any one of claims 1 to 16 is realized.