CN113032609A - Picture retrieval method and device, electronic equipment and storage medium - Google Patents
Picture retrieval method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113032609A CN113032609A CN202110312546.0A CN202110312546A CN113032609A CN 113032609 A CN113032609 A CN 113032609A CN 202110312546 A CN202110312546 A CN 202110312546A CN 113032609 A CN113032609 A CN 113032609A
- Authority
- CN
- China
- Prior art keywords
- picture
- retrieved
- user
- keyword
- retrieval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a picture retrieval method, a picture retrieval device, electronic equipment and a storage medium; relates to the technical field of artificial intelligence. The method comprises the following steps: receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises a keyword of a picture to be retrieved, retrieving the picture corresponding to the keyword of the picture to be retrieved in a picture tag database in response to the picture retrieval instruction, wherein the picture tag database at least comprises a file name named in advance by the user and a character word library identified based on picture information, and if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved in the picture tag database, feeding back at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system. The embodiment of the application can improve the accuracy and efficiency of retrieving the picture by the instant messaging user, thereby improving the picture retrieval effect of the instant messaging system and meeting the retrieval requirement of the user.
Description
Technical Field
The embodiment of the invention relates to the technical field of artificial intelligence, in particular to a picture retrieval method and device, electronic equipment and a storage medium.
Background
Pictures, which are commonly used multimedia information, can efficiently, intuitively and vividly convey information due to visual characteristics such as color, texture and shape, and are widely used for internet information exchange. Because the pictures contain too much information, when the pictures are searched by using a search tool in an instant messaging system, the characters and the pictures are difficult to be directly matched, and generally, the pictures can be searched only through information such as a sender, a sending date, a file name and the like.
However, semantic understanding of pictures is generally affected by factors such as cognitive ability and knowledge systems, different users have different understandings of the same picture, and description of picture contents is often simplified when a user names a picture manually, so that picture retrieval effects of an instant messaging system are poor, and retrieval requirements of the users cannot be met.
Disclosure of Invention
The invention provides a picture retrieval method, a picture retrieval device, electronic equipment and a storage medium, which can improve the accuracy and efficiency of retrieving pictures by instant messaging users, thereby improving the picture retrieval effect of an instant messaging system and meeting the retrieval requirements of the users.
In a first aspect, an embodiment of the present application provides an image retrieval method, where the method includes:
receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises a keyword of a picture to be retrieved;
searching a picture corresponding to the keyword of the picture to be searched in a picture tag database in response to the picture searching instruction, wherein the picture tag database at least comprises a file name named in advance by the user and a word bank identified based on picture information;
and if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system.
In a second aspect, an embodiment of the present application further provides an image retrieving apparatus, which includes a receiving module, a retrieving module, and a feedback module, wherein,
the receiving module is used for receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises keywords of a picture to be retrieved;
the retrieval module is used for responding to the picture retrieval instruction to retrieve a picture corresponding to the keyword of the picture to be retrieved in a picture tag database, wherein the picture tag database at least comprises a file name named by the user in advance and a character word bank identified based on picture information;
and if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, the feedback module feeds back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system.
In a third aspect, an embodiment of the present application provides an electronic device, including:
one or more processors for interpreting computer instructions and processing data in a program;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the picture retrieval method according to any embodiment of the present invention.
In a fourth aspect, the present application provides a storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the picture retrieval method according to any embodiment of the present invention.
In a fifth aspect, the present application provides a computer program product, which when executed by a computer device, implements the image retrieval method according to any embodiment of the present application.
The embodiment of the invention provides a picture retrieval method, a picture retrieval device, electronic equipment and a storage medium, wherein a picture retrieval instruction sent by a user is received in an instant messaging system; then, searching a picture corresponding to the keyword of the picture to be searched in a picture tag database in response to the picture searching instruction; and if at least one picture corresponding to the keywords of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keywords of the picture to be retrieved to the user in the instant messaging system. That is to say, in the technical solution of the present invention, based on the file names of the two types of information in the picture tag database named in advance by the user and the word stock identified based on the picture information, the picture corresponding to the keyword of the picture to be retrieved is retrieved in the picture tag database. However, in the prior art, generally, only information such as a sender, a transmission date, a file name, and the like can be searched. Therefore, compared with the prior art, the picture retrieval method, the picture retrieval device, the electronic equipment and the storage medium provided by the embodiment of the invention can improve the accuracy and efficiency of retrieving pictures by instant messaging users, thereby improving the picture retrieval effect of an instant messaging system and meeting the retrieval requirements of the users.
Drawings
Fig. 1 is a first flowchart of a picture retrieval method according to an embodiment of the present invention;
fig. 2 is a second flowchart of the image retrieval method according to the embodiment of the present invention;
fig. 3 is a third flow chart of the picture retrieval method according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an image retrieval apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a feedback module according to an embodiment of the present invention;
fig. 6 is a block diagram of an electronic device for implementing a picture retrieval method according to an embodiment of the present application.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a first flowchart of a picture retrieval method according to an embodiment of the present invention. As shown in fig. 1, the picture retrieval method may include the steps of:
step 101, receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises a keyword of a picture to be retrieved.
In this step, the electronic device may receive an image retrieval instruction sent by a user in the instant messaging system, where the image retrieval instruction at least includes a keyword of an image to be retrieved. Specifically, the user can input a keyword in an image retrieval page of the instant messaging system, and then an image retrieval instruction is generated based on the keyword input by the user, so that the electronic device can receive the image retrieval instruction sent by the user in the instant messaging system.
And step 102, retrieving a picture corresponding to the keyword of the picture to be retrieved in a picture tag database in response to the picture retrieval instruction, wherein the picture tag database at least comprises a file name named by a user in advance and a word bank identified based on picture information.
In this step, the electronic device may retrieve, in response to the picture retrieval instruction, a picture corresponding to the keyword of the picture to be retrieved in the picture tag database, where the picture tag database at least includes a file name named in advance by the user and a word bank identified based on the picture information. Specifically, the electronic device may retrieve, in the picture tag database, a picture corresponding to a keyword of the picture to be retrieved according to two types of information, namely, a file name named in advance by the user in the picture tag data and a word bank identified based on the picture information. Further, the electronic device may retrieve, in the picture tag database, a picture corresponding to a keyword of the picture to be retrieved based on a file name named in advance by the user; if at least one picture is retrieved from the picture tag database based on the file name named in advance by the user, the electronic device can take the retrieved picture as at least one picture corresponding to the keyword of the picture to be retrieved. If any picture is not retrieved in the picture tag database based on the file name named in advance by the user, the electronic equipment can retrieve the picture corresponding to the keyword of the picture to be retrieved in the picture tag database based on the character word bank identified by the picture information; if at least one picture is retrieved from the picture tag database based on the word stock identified by the picture information, the electronic device can take the retrieved picture as at least one picture corresponding to the keyword of the picture to be retrieved.
And 103, if at least one picture corresponding to the keywords of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keywords of the picture to be retrieved to the user in the instant messaging system.
In this step, if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, the electronic device may feed back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system. Specifically, the electronic device may calculate, through a pre-trained correlation model, a magnitude of a correlation between each picture corresponding to the keyword of the picture to be retrieved and the keyword of the picture to be retrieved; then, according to the correlation between each picture corresponding to the keywords of the picture to be retrieved and the keywords of the picture to be retrieved, ordering the pictures corresponding to the keywords of all the pictures to be retrieved; and feeding back each picture corresponding to the keyword of the picture to be retrieved to the user in the instant communication system according to the sequence of the relevance from large to small.
The picture retrieval method provided by the embodiment of the invention comprises the steps of firstly receiving a picture retrieval instruction sent by a user in an instant messaging system; then, searching a picture corresponding to the keyword of the picture to be searched in a picture tag database in response to the picture searching instruction; and if at least one picture corresponding to the keywords of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keywords of the picture to be retrieved to the user in the instant messaging system. That is to say, in the technical solution of the present invention, based on two types of information in the picture tag database: and searching the picture corresponding to the keyword of the picture to be searched in the picture label database by using the file name named in advance by the user and the character word library identified based on the picture information. However, in the prior art, generally, only information such as a sender, a transmission date, a file name, and the like can be searched. Therefore, compared with the prior art, the picture retrieval method provided by the embodiment of the invention can improve the accuracy and efficiency of retrieving pictures by the instant messaging user, thereby improving the picture retrieval effect of the instant messaging system and meeting the retrieval requirements of the user.
Example two
Fig. 2 is a second flowchart of the image retrieval method according to the embodiment of the present invention. As shown in fig. 2, the picture retrieval method may include the steps of:
step 201, receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises a keyword of a picture to be retrieved.
Step 202, retrieving a picture corresponding to a keyword of a picture to be retrieved in a picture tag database in response to a picture retrieval instruction, wherein the picture tag database at least comprises a file name named by a user in advance and a word bank identified based on picture information.
Step 203, if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database.
And 204, calculating the correlation between each picture corresponding to the keywords of the picture to be retrieved and the keywords of the picture to be retrieved through a pre-trained correlation model.
In this step, the electronic device may calculate, through a pre-trained correlation model, the correlation between each picture corresponding to the keyword of the picture to be retrieved and the keyword of the picture to be retrieved. Specifically, the electronic device may input each picture corresponding to the keyword of the picture to be retrieved into a pre-trained correlation model, so as to obtain the correlation size between each picture corresponding to the keyword of the picture to be retrieved and the keyword of the picture to be retrieved, which is output by the correlation model.
In a specific embodiment of the present application, before the electronic device receives a picture retrieval instruction sent by a user in an instant messaging system, the electronic device may also train a relevance model in advance. Specifically, if the correlation model does not satisfy the preset convergence condition, the electronic device may extract a sample picture from the pre-acquired sample pictures as a current training sample, then train the correlation model using the current training sample, and repeatedly execute the above operations until the correlation model satisfies the preset convergence condition.
And step 205, sequencing all pictures corresponding to the keywords of the pictures to be retrieved according to the relevance between the pictures corresponding to the keywords of the pictures to be retrieved and the keywords of the pictures to be retrieved.
In this step, the electronic device may sort the pictures corresponding to the keywords of all the pictures to be retrieved according to the relevance between the pictures corresponding to the keywords of the pictures to be retrieved and the keywords of the pictures to be retrieved. Specifically, the electronic device may sort the pictures corresponding to the keywords of all the pictures to be retrieved according to a descending order of the relevance.
And step 206, feeding back the pictures corresponding to the keywords of the pictures to be retrieved to the user in the instant communication system according to the sequence of the relevance from large to small.
In this step, the electronic device may feed back each picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system according to the sequence of the relevance from large to small. Specifically, the electronic device may sort the images according to the relevance calculated by the relevance model, feed back the retrieved image information to the user interface, and feed back the user evaluation page.
The picture retrieval method provided by the embodiment of the invention comprises the steps of firstly receiving a picture retrieval instruction sent by a user in an instant messaging system; then, searching a picture corresponding to the keyword of the picture to be searched in a picture tag database in response to the picture searching instruction; and if at least one picture corresponding to the keywords of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keywords of the picture to be retrieved to the user in the instant messaging system. That is to say, in the technical scheme of the present invention, based on two types of information, namely, a file name named in advance by a user in the picture tag database and a word bank identified based on picture information, a picture corresponding to a keyword of a picture to be retrieved is retrieved in the picture tag database. However, in the prior art, generally, only information such as a sender, a transmission date, a file name, and the like can be searched. Therefore, compared with the prior art, the picture retrieval method provided by the embodiment of the invention can improve the accuracy and efficiency of retrieving pictures by the instant messaging user, thereby improving the picture retrieval effect of the instant messaging system and meeting the retrieval requirements of the user.
EXAMPLE III
Fig. 3 is a schematic third flow chart of the picture retrieval method according to the embodiment of the present invention. As shown in fig. 3, the picture retrieval method may include the steps of:
step 301, receiving an alternative picture sent by a user, and identifying content in the alternative picture by adopting an identification algorithm of a deep learning framework.
In this step, the electronic device may receive an alternative picture sent by a user, and identify content in the alternative picture by using an identification algorithm of a deep learning framework, where the identified content in the alternative picture may include a file address and N tags, and N is a natural number greater than or equal to 1. Specifically, before receiving a picture retrieval instruction sent by a user in an instant messaging system, the electronic device may first establish a database model describing picture contents, where the picture tag database at least includes a file name named in advance by the user and a word library identified based on picture information. Further, the picture information identification may include the steps of: 1) and judging the file type. And when the system receives the picture, automatically calling a picture identification algorithm. 2) And identifying the picture content. Recognizing the picture content by adopting a deep learning frame mobilene-ssd recognition algorithm, describing the recognized picture content by using character information, and automatically calling a storage algorithm; when a plurality of labels appear in the identification content, the identification content is stored in the database in a distinguishing way according to the weight of each label. 3) The identification content is stored. Establishing a database model specially storing the picture label content, recording each picture address, the file name and the identified content, and storing the content in the database without circulating along with the document entity.
And 302, describing the content in the identified alternative picture by using the text information, and storing the text information into a picture label database.
In this step, the electronic device may describe the content in the identified candidate picture with text information, and store the text information in the picture tag database. Specifically, the electronic device may convert content identified in the alternative picture into text information, and then store the text information in the picture tag database.
Step 303, receiving an image retrieval instruction sent by a user in the instant messaging system, wherein the image retrieval instruction at least comprises a keyword of an image to be retrieved.
And 304, retrieving the picture corresponding to the keyword of the picture to be retrieved in a picture tag database in response to the picture retrieval instruction, wherein the picture tag database at least comprises a file name named by a user in advance and a word bank identified based on picture information.
In a specific embodiment of the application, the electronic device may further receive a picture evaluation result sent by the user and corresponding to at least one keyword of the picture to be retrieved; and then adjusting parameters of the correlation model according to a picture evaluation result which is sent by the user and corresponds to at least one keyword of the picture to be retrieved.
According to the technical scheme, firstly, based on a deep learning framework, image features are extracted, objects contained in the images are identified, and the objects are stored in a database in an image attached tag mode; and secondly, evaluating the correlation between the retrieval result and the keyword to be retrieved by using a preset correlation model, and improving the retrieval precision and efficiency of the picture information.
The picture retrieval method provided by the embodiment of the invention comprises the steps of firstly receiving a picture retrieval instruction sent by a user in an instant messaging system; then, searching a picture corresponding to the keyword of the picture to be searched in a picture tag database in response to the picture searching instruction; and if at least one picture corresponding to the keywords of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keywords of the picture to be retrieved to the user in the instant messaging system. That is to say, in the technical scheme of the present invention, based on two types of information, namely, a file name named in advance by a user in the picture tag database and a word bank identified based on picture information, a picture corresponding to a keyword of a picture to be retrieved is retrieved in the picture tag database. However, in the prior art, generally, only information such as a sender, a transmission date, a file name, and the like can be searched. Therefore, compared with the prior art, the picture retrieval method provided by the embodiment of the invention can improve the accuracy and efficiency of retrieving pictures by the instant messaging user, thereby improving the picture retrieval effect of the instant messaging system and meeting the retrieval requirements of the user.
Example four
Fig. 4 is a schematic structural diagram of an image retrieval device according to an embodiment of the present invention. As shown in fig. 4, the picture retrieval apparatus includes a receiving module 401, a retrieving module 402 and a feedback module 403, wherein,
the receiving module 401 receives a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises keywords of a picture to be retrieved;
the retrieval module 402 is configured to retrieve, in response to the picture retrieval instruction, a picture corresponding to the keyword of the picture to be retrieved from a picture tag database, where the picture tag database at least includes a file name named in advance by the user and a word bank identified based on picture information;
the feedback module 403, if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, feeds back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system.
Fig. 5 is a schematic structural diagram of a feedback module according to an embodiment of the present invention. As shown in fig. 5, the feedback module 403 includes a calculation sub-module 4031, a ranking sub-module 4032, and a feedback sub-module 4033, wherein,
the calculation submodule 4031 calculates the correlation between each picture corresponding to the keyword of the picture to be retrieved and the keyword of the picture to be retrieved through a pre-trained correlation model;
the sorting submodule 4032 sorts all the pictures corresponding to the keywords of the picture to be retrieved according to the relevance between the pictures corresponding to the keywords of the picture to be retrieved and the keywords of the picture to be retrieved;
the feedback sub-module 4033 feeds back each picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system according to the sequence of the relevance from large to small.
Further, the apparatus further includes an adjusting module 404 (not shown in the figure), configured to receive an evaluation result sent by the user for the at least one picture corresponding to the keyword of the picture to be retrieved, and adjust a parameter of the correlation model according to the evaluation result sent by the user.
Further, the apparatus further includes a storage module 405 (not shown in the figure), configured to receive the candidate picture sent by the user, identify content in the candidate picture by using an identification algorithm of a deep learning framework, where the identified content is described by text information, and store the text information in the picture tag database.
The image retrieval device can execute the method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. For details of the technology that are not described in detail in this embodiment, reference may be made to the picture retrieval method provided in any embodiment of the present invention.
EXAMPLE five
According to an embodiment of the present disclosure, there is also provided an electronic device, a readable storage medium, and a computer program product.
FIG. 6 illustrates a schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 6, the apparatus 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)602 or a computer program loaded from a storage unit 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the device 600 can also be stored. The calculation unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
A number of components in the device 600 are connected to the I/O interface 605, including an input unit 606, such as a keyboard, mouse, etc.; an output unit 607 such as various types of displays, speakers, and the like; a storage unit 608, such as a magnetic disk, optical disk, or the like; and a communication unit 609 such as a network card, modem, wireless communication transceiver, etc. The communication unit 609 allows the device 600 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 601 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various dedicated Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 601 performs the respective methods and processes described above, such as the applet page rendering method. For example, in some embodiments, the picture retrieval method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded into the RAM 603 and executed by the computing unit 601, one or more steps of the picture retrieval method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform the picture retrieval method by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device, such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user; and a keyboard and a pointing device, such as a mouse or a trackball, by which a user can provide input to the computer. Other kinds of devices may also be used to provide interaction with the user, for example, feedback provided to the user may be any form of sensory feedback, such as visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. Examples of communication networks include a Local Area Network (LAN), a Wide Area Network (WAN), a blockchain network, and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (15)
1. A picture retrieval method, the method comprising:
receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises a keyword of a picture to be retrieved;
responding to the picture retrieval instruction to retrieve the picture corresponding to the keyword of the picture to be retrieved in a picture tag database, wherein the picture tag database at least comprises: the file name named by the user in advance and a word bank identified based on the picture information;
and if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, feeding back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system.
2. The method according to claim 1, wherein feeding back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system comprises:
calculating the correlation between each picture corresponding to the keywords of the picture to be retrieved and the keywords of the picture to be retrieved through a pre-trained correlation model;
ordering all pictures corresponding to the keywords of the pictures to be retrieved according to the correlation between the pictures corresponding to the keywords of the pictures to be retrieved and the keywords of the pictures to be retrieved;
and feeding back each picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system according to the sequence of the relevance from large to small.
3. The method of claim 2, further comprising:
receiving an evaluation result which is sent by the user and aims at the at least one picture corresponding to the keyword of the picture to be retrieved;
and adjusting parameters of the correlation model according to the evaluation result sent by the user and aiming at the at least one picture corresponding to the keyword of the picture to be retrieved.
4. The method of claim 1, wherein before receiving the picture retrieval command sent by the user in the instant messaging system, the method further comprises:
and receiving the alternative pictures sent by the user, identifying the contents in the alternative pictures by adopting an identification algorithm of a deep learning framework, describing the identified contents by using text information, and storing the text information into the picture label database.
5. The method of claim 4, the identifying content in the alternative picture comprising: file addresses and N tags; wherein N is a natural number greater than or equal to 1.
6. The method of claim 2, wherein before receiving the picture retrieval command sent by the user in the instant messaging system, the method further comprises:
if the correlation model does not meet the preset convergence condition, extracting a sample picture from the pre-acquired sample pictures as a current training sample, training the correlation model by using the current training sample, and repeatedly executing the operations until the correlation model meets the preset convergence condition.
7. The method of claim 1, wherein retrieving pictures corresponding to the keywords of the picture to be retrieved in a picture tag database in response to the picture retrieval instruction comprises:
retrieving pictures corresponding to the keywords of the pictures to be retrieved in the picture tag database based on the file names named in advance by the user;
and if at least one picture is retrieved from the picture tag database based on the file name named in advance by the user, taking the retrieved picture as the at least one picture corresponding to the keyword of the picture to be retrieved.
8. The method of claim 6, further comprising:
if any picture is not retrieved in the picture tag database based on the file name named in advance by the user, retrieving a picture corresponding to the keyword of the picture to be retrieved in the picture tag database based on a character word bank identified by picture information;
and if at least one picture is retrieved from the picture tag database based on the character word stock identified by the picture information, taking the retrieved picture as the at least one picture corresponding to the keyword of the picture to be retrieved.
9. A picture retrieval device is characterized by comprising a receiving module, a retrieval module and a feedback module, wherein,
the receiving module is used for receiving a picture retrieval instruction sent by a user in an instant messaging system, wherein the picture retrieval instruction at least comprises keywords of a picture to be retrieved;
the retrieval module is used for responding to the picture retrieval instruction to retrieve a picture corresponding to the keyword of the picture to be retrieved in a picture tag database, wherein the picture tag database at least comprises a file name named by the user in advance and a character word bank identified based on picture information;
and if at least one picture corresponding to the keyword of the picture to be retrieved is retrieved from the picture tag database, the feedback module feeds back the at least one picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system.
10. The apparatus of claim 9, wherein the feedback module comprises a computation sub-module, a ranking sub-module, and a feedback sub-module, wherein,
the calculation submodule calculates the correlation between each picture corresponding to the keywords of the picture to be retrieved and the keywords of the picture to be retrieved through a pre-trained correlation model;
the sorting submodule sorts all the pictures corresponding to the keywords of the pictures to be retrieved according to the relevance between the pictures corresponding to the keywords of the pictures to be retrieved and the keywords of the pictures to be retrieved;
and the feedback sub-module feeds back each picture corresponding to the keyword of the picture to be retrieved to the user in the instant messaging system according to the sequence of the relevance from large to small.
11. The apparatus according to claim 10, further comprising an adjusting module, configured to receive an evaluation result sent by the user for the at least one picture corresponding to the keyword of the picture to be retrieved, and adjust a parameter of the relevance model according to the evaluation result sent by the user.
12. The device of claim 9, further comprising a storage module, configured to receive an alternative picture sent by the user, identify content in the alternative picture by using an identification algorithm of a deep learning framework, describe the identified content with text information, and store the text information in the picture tag database.
13. An electronic device, comprising
One or more processors for interpreting computer instructions and processing data in a program;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the picture retrieval method of any one of claims 1-8.
14. A storage medium on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out a picture retrieval method as claimed in any one of claims 1 to 8.
15. A computer program product comprising a computer program, characterized in that the computer program realizes the method according to any of claims 1-8 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110312546.0A CN113032609A (en) | 2021-03-24 | 2021-03-24 | Picture retrieval method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110312546.0A CN113032609A (en) | 2021-03-24 | 2021-03-24 | Picture retrieval method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113032609A true CN113032609A (en) | 2021-06-25 |
Family
ID=76473246
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110312546.0A Pending CN113032609A (en) | 2021-03-24 | 2021-03-24 | Picture retrieval method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113032609A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064903A (en) * | 2012-12-18 | 2013-04-24 | 厦门市美亚柏科信息股份有限公司 | Method and device for searching images |
| CN109871460A (en) * | 2019-01-23 | 2019-06-11 | 深圳市酷开网络科技有限公司 | A kind of picture searching method, intelligent terminal and storage medium |
| CN110209858A (en) * | 2018-02-28 | 2019-09-06 | 阿里巴巴集团控股有限公司 | Exhibiting pictures determination, object search, methods of exhibiting, device, equipment and medium |
| CN112052332A (en) * | 2020-07-30 | 2020-12-08 | 中国建设银行股份有限公司 | Retrieval method, retrieval device, electronic equipment and readable storage medium |
-
2021
- 2021-03-24 CN CN202110312546.0A patent/CN113032609A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064903A (en) * | 2012-12-18 | 2013-04-24 | 厦门市美亚柏科信息股份有限公司 | Method and device for searching images |
| CN110209858A (en) * | 2018-02-28 | 2019-09-06 | 阿里巴巴集团控股有限公司 | Exhibiting pictures determination, object search, methods of exhibiting, device, equipment and medium |
| CN109871460A (en) * | 2019-01-23 | 2019-06-11 | 深圳市酷开网络科技有限公司 | A kind of picture searching method, intelligent terminal and storage medium |
| CN112052332A (en) * | 2020-07-30 | 2020-12-08 | 中国建设银行股份有限公司 | Retrieval method, retrieval device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4053802A1 (en) | Video classification method and apparatus, device and storage medium | |
| CN113836314B (en) | Knowledge graph construction method, device, equipment and storage medium | |
| CN112560461A (en) | News clue generation method and device, electronic equipment and storage medium | |
| CN114429633A (en) | Text recognition method, model training method, device, electronic equipment and medium | |
| CN110909768B (en) | Method and device for acquiring marked data | |
| CN115099239A (en) | Resource identification method, device, equipment and storage medium | |
| CN112699237B (en) | Label determination method, device and storage medium | |
| CN112528146B (en) | Content resource recommendation method and device, electronic equipment and storage medium | |
| CN113360685A (en) | Method, device, equipment and medium for processing note content | |
| CN115248890A (en) | User interest portrait generation method and device, electronic equipment and storage medium | |
| CN114036397B (en) | Data recommendation method, device, electronic equipment and medium | |
| CN114048315A (en) | Method and device for determining document tag, electronic equipment and storage medium | |
| CN114969371A (en) | Heat sorting method and device of combined knowledge graph | |
| CN112784600A (en) | Information sorting method and device, electronic equipment and storage medium | |
| CN113032609A (en) | Picture retrieval method and device, electronic equipment and storage medium | |
| CN114417862A (en) | Text matching method, and training method and device of text matching model | |
| CN113239273A (en) | Method, device, equipment and storage medium for generating text | |
| CN112528644A (en) | Entity mounting method, device, equipment and storage medium | |
| CN116644724B (en) | Method, device, equipment and storage medium for generating bid | |
| CN113032540B (en) | Man-machine interaction method, device, equipment and storage medium | |
| CN113051472B (en) | Modeling method, device, equipment and storage medium of click through rate estimation model | |
| CN116610782B (en) | Text retrieval method, device, electronic equipment and medium | |
| CN113377921B (en) | Method, device, electronic equipment and medium for matching information | |
| CN117851546A (en) | Resource retrieval method, training method, device, electronic equipment, storage medium and program product | |
| CN116257690A (en) | Resource recommendation method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |