CN111143599A

CN111143599A - Image fast searching method, system, electronic device and storage medium

Info

Publication number: CN111143599A
Application number: CN201911370128.6A
Authority: CN
Inventors: 时红仁
Original assignee: Shanghai Qinggan Intelligent Technology Co Ltd
Current assignee: Shanghai Qinggan Intelligent Technology Co Ltd
Priority date: 2019-12-26
Filing date: 2019-12-26
Publication date: 2020-05-12

Abstract

The invention provides a method, a system, an electronic device and a storage medium for fast searching images, wherein the method for fast searching images comprises the following steps: creating an index tag for each image in the image search library; when a search instruction is received, analyzing and acquiring index elements in the search instruction; and traversing and searching all images in the image search library according to the index elements, and taking the images corresponding to the index tags consistent with the index elements as search results. The invention establishes the index for the photos according to the photo characteristics, such as photo shooting time, shooting location, landscape photos, people photos and the like in advance, and quickly searches the needed photos according to the index through the instructions input by the user, thereby effectively solving the trouble that the user needs to manually search the needed photos in the photo library in the prior art.

Description

Image fast searching method, system, electronic device and storage medium

Technical Field

The invention relates to the technical field of intelligent life, in particular to a method, a system, an electronic device and a storage medium for fast searching images.

Background

The birth of smart phones is evolved from a handheld computer (PocketPC). The earliest palmtop computers do not have the function of mobile phone communication, but are not used to carry two devices, namely a mobile phone and a PPC (personal data center) at any time with the improvement of the dependence of users on the function of processing personal information of the palmtop computers, so that manufacturers transplant the system of the palmtop computers into the mobile phones, and then the concept of smart phones appears. Smartphones have more comprehensive processing capability than traditional phones, such as Symbian operating system S60 series, Symbian S60, Symbian3, and some MeeGo operating system smartphones. However, with recent developments, there is a trend towards a convergence of these smartphone types.

In a broad sense, the smart phone has most functions of the PDA, especially personal information management and a browser based on wireless data communication, GPS and e-mail functions, in addition to the call function of the phone. The smart phone provides enough screen size and bandwidth for users, is convenient to carry about, and provides a wide stage for software operation and content service, and a plurality of value added services can be developed at the same time, such as: stock, news, weather, traffic, merchandise, application downloads, music picture downloads, and the like. The development trend of the smart phone is bound to become a comprehensive personal handheld terminal device with powerful functions and integrating conversation, short message, network access and movie and television entertainment.

At present, a plurality of photos in a common user mobile phone are searched, the user usually looks over the photos manually when searching for the related photos, time and labor are wasted when searching for a plurality of needed photos in a large quantity of photos, omission easily occurs, and searching is not comprehensive.

Therefore, it is desirable to solve the problem of how to quickly search for a desired photo among a large number of photos.

Disclosure of Invention

In view of the above-mentioned shortcomings of the prior art, it is an object of the present invention to provide a method, a system, an electronic device and a storage medium for fast searching images, which can solve the problem that the prior art cannot automatically and fast search for a desired photo among a large number of photos.

To achieve the above and other related objects, the present invention provides a method for fast searching an image, including: creating an index tag for each image in the image search library; when a search instruction is received, analyzing and acquiring index elements in the search instruction; and traversing and searching all images in the image search library according to the index elements, and taking the images corresponding to the index tags consistent with the index elements as search results.

In an embodiment of the invention, the search instruction is a voice instruction or a text instruction.

In an embodiment of the present invention, an implementation manner of creating an index tag for each image in the image search library includes: analyzing image characteristics; determining at least one index element according to the image features; and creating an index label for the image in the image library according to the index element.

In an embodiment of the invention, the index element includes an image capturing time, an image capturing location, an image containing content attribute, or a user defined element.

In an embodiment of the invention, the image feature includes one or more of an image time feature, an image location feature, a person feature, a landscape feature or an article feature.

In order to achieve the above object, the present invention also provides an image quick search system, including: the index creating module is used for creating an index tag for each image in the image search library; the instruction receiving module is used for receiving a search instruction; the analysis module is used for analyzing and acquiring index elements in the search instruction when the search instruction is received; and the searching module is used for searching all images in the image searching library according to the traversal of the index elements and taking the image corresponding to the index tag consistent with the index elements as a searching result.

In an embodiment of the present invention, the index creating module includes: a feature analysis unit for analyzing image features; an element determination unit for determining at least one index element according to the image features; and the creating unit is used for creating an index label for the image in the image library according to the index element.

In an embodiment of the present invention, the index element includes an image capturing time, an image capturing location, an image containing content attribute, or a user defined element; the image features comprise one or more of image time features, image location features, people features, landscape features or article features.

To achieve the above object, the present invention also provides a computer-readable storage medium having a computer program stored thereon, the computer program being executed by a processor to implement the image fast search method.

To achieve the above object, the present invention also provides an electronic device, including: at least one memory for storing a computer program; at least one processor, coupled to the camera and the memory, for executing the computer program to implement the image fast search method.

As described above, the image fast search method, system, electronic device and storage medium of the present invention have the following advantages:

1. the invention establishes the index for the photos according to the photo characteristics, such as photo shooting time, shooting location, landscape photos, people photos and the like in advance, and quickly searches the needed photos according to the index through the instructions input by the user, thereby effectively solving the trouble that the user needs to manually search the needed photos in the photo library in the prior art.

2. The invention has simple operation and high practicability.

Drawings

FIG. 1 is a schematic diagram illustrating an application scenario architecture of a method for fast image search according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating an image fast search method according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating an embodiment of an image fast search method for creating index tags according to the present invention;

FIG. 4 is a flowchart illustrating an example of an implementation of the image fast search method of the present invention in yet another embodiment;

FIG. 5 is a schematic diagram of an embodiment of a fast image search system according to the present invention;

FIG. 6 is a schematic diagram illustrating an index creation module of the image fast search system according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the invention.

Description of the element reference numerals

100 image quick searching system

110 index creation module

111 feature analysis unit

112 element determination unit

113 creating unit

120 instruction receiving module

130 analysis module

140 search module

S100 to S300

S110 to S130

101 electronic device

1101 processor

1102 memory

Detailed Description

The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.

It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, so that the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, the type, quantity and proportion of the components in actual implementation can be changed freely, and the layout of the components can be more complicated.

The invention discloses a method, a system, an electronic device and a storage medium for quickly searching images, which are used for solving the problem that the required photos cannot be automatically and quickly searched in a large number of photos in the prior art.

The principles and embodiments of the image fast search method, system, electronic device and storage medium according to the present embodiment will be described in detail below, so that those skilled in the art can understand the image fast search method, system, electronic device and storage medium according to the present embodiment without creative labor.

As shown in fig. 1, the image fast search method, system, electronic device and storage medium of the present invention are applied in an application scenario of searching images in an image library in an electronic device 101. The electronic device 101 may be a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), and so on, which may take or store photos, and the electronic device 101 has at least one camera for taking photos, for example, the electronic device 101 includes two cameras (main camera + depth of field sub-camera, main camera + black and white sub-camera, main camera + telephoto/wide angle sub-camera, and so on), four cameras (e.g., wide camera +2 times long focus camera + main camera + depth of field camera), and so on. The electronic device 101 and the electronic device 102 communicate with each other via a network, which may be a wireless or wired network such as an Intranet (Intranet), the Internet (Internet), a Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth (Bluetooth), Wi-Fi, or a telephone network.

As shown in fig. 2, the present embodiment provides an image fast search method, which includes the following steps:

step S110, creating an index tag for each image in the image search library;

step S120, when a search instruction is received, analyzing and acquiring index elements in the search instruction;

step S300, searching all images in the image search library according to the index elements in a traversing manner, and taking the image corresponding to the index tag consistent with the index elements as a search result.

The following describes steps S100 to S300 of the image fast search method according to the present embodiment in detail.

In step S110, an index tag is created for each image in the image search library.

That is, in this embodiment, images in the image library need to be indexed in advance.

Specifically, in this embodiment, as shown in fig. 3, one implementation manner of creating an index tag for each image in the image search library includes:

step S111, analyzing image characteristics.

In this embodiment, the image feature includes one or more of an image time feature, an image location feature, a person feature, a landscape feature, or an article feature.

For example, if the image is captured in 2019 on 8/2, north river and the image is a human, the image features include image time features, image location features and human features.

Step S112, determining at least one index element according to the image characteristics.

For example, if the image is captured in 2019 on 8/2, north river and the image is a human, the image features include image time features, image location features and human features. The index elements are one or more combinations of BeiDaihe, 2019, 8 months, Xiaoming (character name) and the like.

And step S113, creating an index label for the image in the image library according to the index element.

In this embodiment, the index tag includes, but is not limited to, an address tag, a time tag, a type tag, a user-defined tag, and the like.

For example, landscape photographs, portrait photographs, items, etc., such as 2019, 8-month photographs, Guilin play photographs, little lighting, etc.

Step S200, when a search instruction is received, analyzing and acquiring the index elements in the search instruction.

In this embodiment, the search instruction is, but not limited to, a voice instruction or a text instruction. The search instruction may also be generated by selection from a list menu containing a number of sets of search instructions.

In this embodiment, a search trigger button is configured on the image library display page or a function menu option is added, and a voice input page or a text input page pops up by triggering the search trigger button or selecting the function menu option.

For example, clicking a search trigger button on an image library display page pops up a voice input page and prompts: please input a search instruction.

The input search instruction should include an index element, otherwise, the index element in the search instruction is difficult to obtain subsequently, and subsequent image search cannot be performed.

The search instruction contains specific elements such as time, place, task or article name and the like.

In this embodiment, preferably, the search instruction is a voice instruction, for example, the search instruction is "find a photo of going to kunming golf course in the previous year", "find a photo of going to laugh in the last two months", "find a photo of xu hui park", and the like.

In this embodiment, the corresponding search instruction is parsed according to the type of the search instruction.

If the search instruction is a voice instruction, receiving the voice instruction through a microphone of the mobile phone, converting the voice instruction, analyzing voice semantics, and extracting keywords as corresponding index elements.

And if the search instruction is a text instruction, providing a text input box, acquiring text contents in the text input box, analyzing the text contents, and taking keywords in advance as corresponding index elements.

In this embodiment, the index elements include, but are not limited to, image capturing time, image capturing location, image containing content attribute, or user defined element.

If the extracted keyword is time, the extracted keyword can be a time period or a specific time date or time. If the keyword is a place, the keyword may be a specific place name, building name, sight spot name, cell name or place name, etc. Such as Kunming, Xujiahui parks, golf courses, etc.

In this embodiment, the index tags in the image library can be quickly searched according to the index elements such as time, address, article, and scenery, and then the image corresponding to the index is obtained.

The protection scope of the image fast search method described in this embodiment is not limited to the execution sequence of the steps listed in this embodiment, and all the schemes of increasing, decreasing, and replacing the steps in the prior art according to the principle of this embodiment are included in the protection scope of the present invention.

In order to further understand the principle and the embodiment mode of the image fast searching method of the present embodiment, as shown in fig. 4, the overall flow of the image fast searching method of the present embodiment is as follows:

and after the user takes a picture, acquiring the picture, determining an index element for the picture according to the picture characteristic, and establishing an index for the picture according to the index element. Then, when the user wants to search the photo, for example, the user inputs a search command through voice, analyzes the index element in the search command, searches the index in the mobile phone photo library according to the index element, and then calls the photo corresponding to the searched index.

Therefore, the image fast searching method of the embodiment can build an index for the photos according to the photo characteristics, such as photo shooting time, shooting location, landscape photos, people photos and the like in advance, and can fast search the needed photos according to the index through the instructions input by the user, thereby effectively solving the problem that the user needs to manually search the needed photos in the photo library in the prior art.

As shown in fig. 5, the present embodiment further provides an image quick search system 100, where the image quick search system 100 includes: an index creation module 110, an instruction receiving module 120, a parsing module 130, and a search module 140.

In this embodiment, the index creating module 110 is configured to create an index tag for each image in the image search library.

Specifically, in this embodiment, as shown in fig. 6, the index creating module 110 includes: a feature analysis unit 111, an element determination unit 112, and a creation unit 113.

In this embodiment, the feature analysis unit 111 is used for analyzing image features.

Specifically, in this embodiment, the image feature includes one or more combinations of an image time feature, an image location feature, a person feature, a landscape feature or an article feature.

In this embodiment, the element determining unit 112 is configured to determine at least one index element according to the image feature.

In this embodiment, the creating unit 113 is configured to create an index tag for the image in the image library according to the index element.

In this embodiment, the index tag includes, but is not limited to, an address tag, a time tag, a type tag, a user-defined tag, and the like. For example, landscape photographs, portrait photographs, items, etc., such as 2019, 8-month photographs, Guilin play photographs, little lighting, etc.

In this embodiment, the instruction receiving module 120 is configured to receive a search instruction; the parsing module 130 is configured to, when a search instruction is received, parse and acquire an index element in the search instruction; the searching module 140 is configured to search all images in the image search library according to traversal of the index elements, and use an image corresponding to an index tag that is consistent with the index element as a search result.

In this embodiment, the search instruction is, but not limited to, a voice instruction or a text instruction. A search instruction may also be generated by selecting from a list menu containing a number of sets of search instructions.

In this embodiment, the index in the image library may be quickly searched according to the index elements such as time, address, article, and scenery, and then the image corresponding to the index may be acquired.

It should be noted that the structures and principles of the index creating module 110, the instruction receiving module 120, the parsing module 130 and the searching module 140 correspond to the steps in the image fast searching method one to one, and therefore, the description is omitted here.

It should be noted that the division of the modules of the above system is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the index creating module 110 may be a processing element separately set up, or may be implemented by being integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a processing element of the apparatus calls and executes the function of the index creating module 110. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

As shown in fig. 1 and 7, in an embodiment, an electronic device 101 is further provided, including: at least one memory 1102 for storing computer programs; at least one processor 1101, coupled to the memory 1102, is configured to run the computer program to implement the image fast search method described above.

The memory 1102 is connected to the processor 1101 through a system bus to complete communication between the processor 1102 and the memory 1101, the memory 1102 is used for storing computer programs, and the processor 1101 is used for operating the computer programs, so that the electronic device executes the image fast searching method. The above-mentioned image fast search method has been described in detail, and is not described herein again.

It should be noted that the above-mentioned system bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The communication interface is used for realizing communication between the database access device and other equipment (such as a client, a read-write library and a read-only library). The Memory 1102 may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.

The Processor 1101 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

Furthermore, the present embodiment also provides a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the image fast search method. The above-mentioned image fast search method has been described in detail, and is not described herein again.

In summary, the index is established for the photos according to the photo characteristics in advance, such as the photo shooting time, the shooting location, the landscape photos, the people photos and the like, the needed photos are quickly searched according to the index through the instructions input by the user, and the trouble that the user needs to manually search the needed photos in the photo library in the prior art is effectively solved; the invention has simple operation and high practicability. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.

The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims

1. A quick image searching method is characterized by comprising the following steps:

creating an index tag for each image in the image search library;

when a search instruction is received, analyzing and acquiring index elements in the search instruction;

and traversing and searching all images in the image search library according to the index elements, and taking the images corresponding to the index tags consistent with the index elements as search results.

2. The image fast searching method according to claim 1, wherein the searching instruction is a voice instruction or a text instruction.

3. The method for rapidly searching images according to claim 1, wherein one implementation manner of creating an index tag for each image in the image search library comprises:

analyzing image characteristics;

determining at least one index element according to the image features;

and creating an index label for the image in the image library according to the index element.

4. The method of any one of claims 1 to 3, wherein the index element comprises an image capturing time, an image capturing place, an image containing content attribute, or a user-defined element.

5. The image fast searching method according to claim 3, wherein the image features comprise one or more combinations of image time features, image location features, people features, landscape features or article features.

6. An image rapid search system, comprising:

the index creating module is used for creating an index tag for each image in the image search library;

the instruction receiving module is used for receiving a search instruction;

the analysis module is used for analyzing and acquiring index elements in the search instruction when the search instruction is received;

and the searching module is used for searching all images in the image searching library according to the traversal of the index elements and taking the image corresponding to the index tag consistent with the index elements as a searching result.

7. The image rapid search system according to claim 6, wherein the index creation module comprises:

a feature analysis unit for analyzing image features;

an element determination unit for determining at least one index element according to the image features;

and the creating unit is used for creating an index label for the image in the image library according to the index element.

8. The image rapid search system according to claim 6, wherein the index element comprises an image capturing time, an image capturing place, an image containing content attribute or a user-defined element; the image features comprise one or more of image time features, image location features, people features, landscape features or article features.

9. A computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the image fast search method according to any one of claims 1 to 5.

10. An electronic device, comprising:

at least one memory for storing a computer program;

at least one processor, coupled to the camera and the memory, for executing the computer program to implement the image fast search method according to any one of claims 1 to 5.