CN108875080B - Image searching method, device, server and storage medium - Google Patents

Image searching method, device, server and storage medium Download PDF

Info

Publication number
CN108875080B
CN108875080B CN201810765693.1A CN201810765693A CN108875080B CN 108875080 B CN108875080 B CN 108875080B CN 201810765693 A CN201810765693 A CN 201810765693A CN 108875080 B CN108875080 B CN 108875080B
Authority
CN
China
Prior art keywords
dimensional image
image
initial
target
candidate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810765693.1A
Other languages
Chinese (zh)
Other versions
CN108875080A (en
Inventor
王园
马春洋
董维山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201810765693.1A priority Critical patent/CN108875080B/en
Publication of CN108875080A publication Critical patent/CN108875080A/en
Application granted granted Critical
Publication of CN108875080B publication Critical patent/CN108875080B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the invention discloses an image searching method, an image searching device, a server and a storage medium. The method comprises the following steps: receiving an initial two-dimensional image input by a current user; searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image; and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. The method and the device can support the user to search the three-dimensional image, so that the search experience of the user can be improved.

Description

Image searching method, device, server and storage medium
Technical Field
The embodiment of the invention relates to the technical field of internet, in particular to an image searching method, an image searching device, a server and a storage medium.
Background
With the development of computing technology, panoramic images, three-dimensional animations, and their presentations and interactions in Virtual Reality (VR) and Augmented Reality (AR) scenes represent the forms and trends of next-generation information presentations and have received increasing attention. Compared with the traditional type of images, the emerging type of images have the advantages of continuity, multi-linearity, multi-angle, presence, large space, high interaction, instantaneity, online linkage, offline and the like, can provide richer visual effects, have more immersive, authentic and interesting visual experiences, and are particularly suitable for supporting information display and user interaction in scenes such as complex environments, virtual outdoors, immersive exploration and operation guidance.
The traditional internet search technology mainly utilizes text information to index massive webpage contents, and with the mass appearance of pictures and videos and the development of a deep neural network technology, picture search is also rapidly developed, so that the technology becomes one of the standard matching capabilities of a contemporary search engine. In addition, voice search and music search have been developed.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art:
because the three-dimensional image exceeds the expression space of the two-dimensional image, the current search engine technology lacks a corresponding search technology, so that a user cannot intuitively and quickly search the related three-dimensional image. There is therefore a need to overcome this problem in some way as far as possible, but there is no effective solution in the prior art.
Disclosure of Invention
In view of this, embodiments of the present invention provide an image searching method, an image searching device, a server, and a storage medium, which can support a user to search for a three-dimensional image, so as to improve the searching experience of the user.
In a first aspect, an embodiment of the present invention provides an image searching method, where the method includes:
receiving an initial two-dimensional image input by a current user;
searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image;
and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
In the above embodiment, the searching, according to the initial two-dimensional image, for at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library includes:
acquiring image labels corresponding to all candidate three-dimensional images in the content resource library and image labels corresponding to the initial two-dimensional images;
and searching at least one target three-dimensional image corresponding to the initial two-dimensional image in the content resource library according to the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image.
In the above embodiment, the obtaining of the image tag corresponding to each candidate three-dimensional image in the content resource library includes:
dividing each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1;
acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image;
and selecting the image label corresponding to each candidate three-dimensional image from the image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image.
In the above embodiment, the searching, according to the image tag corresponding to each candidate three-dimensional image and the image tag corresponding to the initial two-dimensional image, for at least one target three-dimensional image corresponding to the initial two-dimensional image in the content resource library includes:
calculating the label similarity of the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image;
and determining the candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image.
In the above embodiment, the feeding back, to the current user, at least one target three-dimensional image corresponding to the initial two-dimensional image includes:
acquiring visual characteristic information corresponding to each target two-dimensional image in each target three-dimensional image and visual characteristic information corresponding to the initial two-dimensional image;
calculating the image similarity of each target two-dimensional image and each initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image;
and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image.
In a second aspect, an embodiment of the present invention provides an image search apparatus, including: the device comprises a receiving module, a searching module and a feedback module; wherein the content of the first and second substances,
the receiving module is used for receiving an initial two-dimensional image input by a current user;
the searching module is used for searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image;
the feedback module is used for feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
In the above embodiment, the search module includes: obtaining a submodule and a searching submodule; wherein the content of the first and second substances,
the obtaining submodule is used for obtaining image tags corresponding to the candidate three-dimensional images and image tags corresponding to the initial two-dimensional images in the content resource library;
and the searching submodule is used for searching at least one target three-dimensional image corresponding to the initial two-dimensional image in the content resource library according to the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image.
In the above embodiment, the obtaining sub-module is specifically configured to divide each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1; acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; and selecting the image label corresponding to each candidate three-dimensional image from the image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image.
In the above embodiment, the search sub-module is specifically configured to calculate a tag similarity between an image tag corresponding to each candidate three-dimensional image and an image tag corresponding to the initial two-dimensional image; and determining the candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image.
In the above embodiment, the feedback module is specifically configured to obtain visual feature information corresponding to each target two-dimensional image in each target three-dimensional image and visual feature information corresponding to the initial two-dimensional image; calculating the image similarity of each target two-dimensional image and each initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image; and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image.
In a third aspect, an embodiment of the present invention provides a server, including:
one or more processors;
a memory for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors implement the image search method according to any embodiment of the present invention.
In a fourth aspect, an embodiment of the present invention provides a storage medium on which a computer program is stored, the program, when executed by a processor, implementing an image search method according to any embodiment of the present invention.
The embodiment of the invention provides an image searching method, an image searching device, a server and a storage medium, wherein an initial two-dimensional image input by a current user is received; then searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. That is to say, in the technical solution of the present invention, at least one target three-dimensional image corresponding to an initial two-dimensional image may be searched in a preset content resource library according to the initial two-dimensional image input by a user. Therefore, compared with the prior art, the image searching method, the image searching device, the server and the storage medium provided by the embodiment of the invention can support the user to search the three-dimensional image, so that the searching experience of the user can be improved; moreover, the technical scheme of the embodiment of the invention is simple and convenient to realize, convenient to popularize and wider in application range.
Drawings
Fig. 1 is a schematic flowchart of an image searching method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of an image searching method according to a second embodiment of the present invention;
fig. 3 is a schematic flowchart of an image searching method according to a third embodiment of the present invention;
fig. 4 is a schematic diagram of a first structure of an image searching apparatus according to a fourth embodiment of the present invention;
fig. 5 is a second structural diagram of an image searching apparatus according to a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of a server according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.
Example one
Fig. 1 is a schematic flowchart of an image searching method according to an embodiment of the present invention. As shown in fig. 1, the image search method may include the steps of:
s101, receiving an initial two-dimensional image input by a current user.
In a particular embodiment of the present invention, the server may receive an initial two-dimensional image of current user input. Specifically, the current user may input the initial two-dimensional image into the server in a preset input manner, for example, the current user may import the initial two-dimensional image into the server. Thus, the server may receive an initial two-dimensional image of the current user input.
S102, searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image.
In a specific embodiment of the present invention, the server may search, according to the initial two-dimensional image, at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library. Specifically, the server may first obtain an image tag corresponding to each candidate three-dimensional image and an image tag corresponding to the initial two-dimensional image in the content resource library; and then searching at least one target three-dimensional image corresponding to the initial two-dimensional image in the content resource library according to the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image.
S103, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
In a specific embodiment of the present invention, if the server searches for at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image, the server may feed back the at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. Specifically, the server may first obtain visual feature information corresponding to each target two-dimensional image in each target three-dimensional image and visual feature information corresponding to the initial two-dimensional image; then, according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image, calculating the image similarity of each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image.
The image searching method provided by the embodiment of the invention comprises the steps of firstly receiving an initial two-dimensional image input by a current user; then searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. That is to say, in the technical solution of the present invention, at least one target three-dimensional image corresponding to an initial two-dimensional image may be searched in a preset content resource library according to the initial two-dimensional image input by a user. Therefore, compared with the prior art, the image searching method provided by the embodiment of the invention can support the user to search the three-dimensional image, so that the searching experience of the user can be improved; moreover, the technical scheme of the embodiment of the invention is simple and convenient to realize, convenient to popularize and wider in application range.
Example two
Fig. 2 is a schematic flowchart of an image searching method according to a second embodiment of the present invention. As shown in fig. 2, the image search method may include:
s201, receiving an initial two-dimensional image input by a current user.
In a particular embodiment of the present invention, the server may receive an initial two-dimensional image of current user input. Specifically, the current user may input the initial two-dimensional image into the server in a preset input manner, for example, the current user may import the initial two-dimensional image into the server. Thus, the server may receive an initial two-dimensional image of the current user input.
S202, obtaining image labels corresponding to the candidate three-dimensional images and image labels corresponding to the initial two-dimensional images in the content resource library.
In a specific embodiment of the present invention, the server may obtain image tags corresponding to each candidate three-dimensional image and image tags corresponding to the initial two-dimensional image in the content repository. Specifically, the server may divide each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1; then acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; and selecting an image label corresponding to each candidate three-dimensional image from the image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image. In addition, the server can acquire the image label corresponding to the initial two-dimensional image in a picture word guessing mode and the like.
S203, searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a content resource library according to the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image.
In a specific embodiment of the present invention, the server may search the content resource library for at least one target three-dimensional image corresponding to the initial two-dimensional image according to the image tag corresponding to each candidate three-dimensional image and the image tag corresponding to the initial two-dimensional image. Specifically, the server may calculate the label similarity between the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image; and then determining the candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image.
And S204, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
In a specific embodiment of the present invention, if the server searches for at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image, the server may feed back the at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. Specifically, the server may first obtain visual feature information corresponding to each target two-dimensional image in each target three-dimensional image and visual feature information corresponding to the initial two-dimensional image; then calculating the image similarity of each target two-dimensional image and each initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to each initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image.
The image searching method provided by the embodiment of the invention comprises the steps of firstly receiving an initial two-dimensional image input by a current user; then searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. That is to say, in the technical solution of the present invention, at least one target three-dimensional image corresponding to an initial two-dimensional image may be searched in a preset content resource library according to the initial two-dimensional image input by a user. Therefore, compared with the prior art, the image searching method provided by the embodiment of the invention can support the user to search the three-dimensional image, so that the searching experience of the user can be improved; moreover, the technical scheme of the embodiment of the invention is simple and convenient to realize, convenient to popularize and wider in application range.
EXAMPLE III
Fig. 3 is a schematic flowchart of an image searching method according to a third embodiment of the present invention. As shown in fig. 3, the image search method may include:
s301, receiving an initial two-dimensional image input by a current user.
In a particular embodiment of the present invention, the server may receive an initial two-dimensional image of current user input. Specifically, the current user may input the initial two-dimensional image into the server in a preset input manner, for example, the current user may import the initial two-dimensional image into the server. Thus, the server may receive an initial two-dimensional image of the current user input.
S302, obtaining image labels corresponding to the candidate three-dimensional images and image labels corresponding to the initial two-dimensional images in the content resource library.
In a specific embodiment of the present invention, the server may obtain an image tag corresponding to each candidate three-dimensional image and an image tag corresponding to the initial two-dimensional image in the content resource library. Specifically, the server may divide each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1; then acquiring an image label corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; and selecting the image label corresponding to each candidate three-dimensional image from the image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image. In addition, the server can acquire the image label corresponding to the initial two-dimensional image in a picture word guessing mode and the like.
S303, calculating the label similarity of the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image.
In a specific embodiment of the present invention, the server may calculate the tag similarity between the image tag corresponding to each candidate three-dimensional image and the image tag corresponding to the initial two-dimensional image. Specifically, assume that the content resource library includes N candidate three-dimensional images, which are: candidate three-dimensional image 1, candidate three-dimensional image 2, …, and candidate three-dimensional image N; wherein N is a natural number of 1 or more. In a specific embodiment of the present invention, after acquiring the image tag corresponding to the candidate three-dimensional image 1, the image tag corresponding to the candidate three-dimensional image 2, …, and the image tag corresponding to the candidate three-dimensional image N, the server may calculate the tag similarities of the image tag corresponding to the candidate three-dimensional image 1, the image tag corresponding to the candidate three-dimensional image 2, …, the image tag corresponding to the candidate three-dimensional image N, and the image tag corresponding to the initial two-dimensional image, respectively.
S304, determining the candidate three-dimensional image corresponding to the image label with the label similarity larger than the preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image.
In a specific embodiment of the present invention, the server may determine, as the at least one target three-dimensional image corresponding to the initial two-dimensional image, the candidate three-dimensional image corresponding to the image tag whose tag similarity is greater than the preset threshold. Specifically, assuming that the label similarity between the image label corresponding to the candidate three-dimensional image 1 and the image label corresponding to the initial two-dimensional image is greater than the preset threshold, in this step, the server may determine the candidate three-dimensional image 1 as the target three-dimensional image corresponding to the initial two-dimensional image.
S305, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
In a specific embodiment of the present invention, if the server searches for at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image, the server may feed back the at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. Specifically, the server may first obtain visual feature information corresponding to each target two-dimensional image in each target three-dimensional image and visual feature information corresponding to the initial two-dimensional image; then calculating the image similarity of each target two-dimensional image and each initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to each initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image and each initial two-dimensional image in each target three-dimensional image.
The image searching method provided by the embodiment of the invention comprises the steps of firstly receiving an initial two-dimensional image input by a current user; then searching at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library according to the initial two-dimensional image; and finally, feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user. That is to say, in the technical solution of the present invention, at least one target three-dimensional image corresponding to an initial two-dimensional image may be searched in a preset content resource library according to the initial two-dimensional image input by a user. Therefore, compared with the prior art, the image searching method provided by the embodiment of the invention can support the user to search the three-dimensional image, so that the searching experience of the user can be improved; moreover, the technical scheme of the embodiment of the invention is simple and convenient to realize, convenient to popularize and wider in application range.
Example four
Fig. 4 is a schematic diagram of a first structure of an image searching apparatus according to a fourth embodiment of the present invention. As shown in fig. 4, the image search apparatus according to the embodiment of the present invention may include: a receiving module 401, a searching module 402 and a feedback module 403; wherein the content of the first and second substances,
the receiving module 401 is configured to receive an initial two-dimensional image input by a current user;
the searching module 402 is configured to search, according to the initial two-dimensional image, at least one target three-dimensional image corresponding to the initial two-dimensional image in a preset content resource library;
the feedback module 403 is configured to feed back, to the current user, at least one target three-dimensional image corresponding to the initial two-dimensional image.
Fig. 5 is a schematic diagram of a second structure of an image searching apparatus according to a fourth embodiment of the present invention. As shown in fig. 5, the search module 402 includes: an acquisition submodule 4021 and a search submodule 4022; wherein the content of the first and second substances,
the obtaining sub-module 4021 is configured to obtain an image tag corresponding to each candidate three-dimensional image in the content resource library and an image tag corresponding to the initial two-dimensional image;
the search sub-module 4022 is configured to search the content resource library for at least one target three-dimensional image corresponding to the initial two-dimensional image according to the image tag corresponding to each candidate three-dimensional image and the image tag corresponding to the initial two-dimensional image.
Further, the obtaining sub-module 4021 is specifically configured to divide each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1; acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; and selecting the image label corresponding to each candidate three-dimensional image from the image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image.
Further, the search submodule 4022 is specifically configured to calculate a tag similarity between an image tag corresponding to each candidate three-dimensional image and an image tag corresponding to the initial two-dimensional image; and determining the candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image.
Further, the feedback module 403 is specifically configured to obtain visual feature information corresponding to each target two-dimensional image in each target three-dimensional image and visual feature information corresponding to the initial two-dimensional image; calculating the image similarity of each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image; and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image.
The image searching device can execute the method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For details of the technology not described in detail in this embodiment, reference may be made to the image searching method provided in any embodiment of the present invention.
EXAMPLE five
Fig. 6 is a schematic structural diagram of a server according to a fifth embodiment of the present invention. FIG. 6 illustrates a block diagram of an exemplary server suitable for use in implementing embodiments of the present invention. The server 12 shown in fig. 6 is only an example, and should not bring any limitation to the function and the scope of use of the embodiment of the present invention.
As shown in FIG. 6, the server 12 is in the form of a general purpose computing device. The components of the server 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Bus 18 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. By way of example, such architectures include, but are not limited to, industry Standard Architecture (ISA) bus, micro-channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
The server 12 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by server 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The server 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 6, commonly referred to as a "hard drive"). Although not shown in FIG. 6, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The server 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with the server 12, and/or with any devices (e.g., network card, modem, etc.) that enable the server 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, the server 12 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) via the network adapter 20. As shown, the network adapter 20 communicates with the other modules of the server 12 via the bus 18. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the server 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing, such as implementing an image search method provided by an embodiment of the present invention, by running a program stored in the system memory 28.
EXAMPLE six
The sixth embodiment of the invention provides a computer storage medium.
The computer-readable storage media of embodiments of the invention may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the particular embodiments described herein, and that various obvious changes, rearrangements and substitutions will now be apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (6)

1. An image search method, characterized in that the method comprises:
receiving an initial two-dimensional image input by a current user; wherein the initial two-dimensional image comprises at least an image label corresponding thereto;
dividing each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1;
acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; selecting image labels corresponding to the candidate three-dimensional images from the image labels corresponding to the candidate two-dimensional images according to the voting number corresponding to each candidate two-dimensional image; acquiring an image label corresponding to the initial two-dimensional image in the content resource library; calculating the label similarity of the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image;
determining a candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image; wherein the target three-dimensional image includes but is not limited to: panoramic images, animated images, virtual reality images, or augmented reality images;
acquiring visual characteristic information corresponding to each target two-dimensional image in each target three-dimensional image and visual characteristic information corresponding to the initial two-dimensional image; calculating the image similarity of each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each target two-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image; and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image.
2. The method according to claim 1, wherein feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image comprises:
and according to the image similarity between each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image, acquiring at least one target three-dimensional image with the image similarity larger than a preset image similarity threshold, and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
3. An image search apparatus, characterized in that the apparatus comprises: the device comprises a receiving module, a searching module and a feedback module; wherein the content of the first and second substances,
the receiving module is used for receiving an initial two-dimensional image input by a current user; wherein the initial two-dimensional image comprises at least an image label corresponding thereto;
the searching module is used for dividing each candidate three-dimensional image into M candidate two-dimensional images; wherein M is a natural number greater than 1; acquiring an image tag corresponding to each candidate two-dimensional image in each candidate three-dimensional image and the voting number corresponding to each candidate two-dimensional image; selecting an image label corresponding to each candidate three-dimensional image from image labels corresponding to each candidate two-dimensional image according to the voting number corresponding to each candidate two-dimensional image; calculating the label similarity of the image label corresponding to each candidate three-dimensional image and the image label corresponding to the initial two-dimensional image; determining a candidate three-dimensional image corresponding to the image label with the label similarity larger than a preset threshold value as at least one target three-dimensional image corresponding to the initial two-dimensional image; wherein the target three-dimensional image includes, but is not limited to: a panoramic image, an animated image, a virtual reality image, or an augmented reality image;
the feedback module is used for acquiring visual characteristic information corresponding to each target two-dimensional image in each target three-dimensional image and visual characteristic information corresponding to the initial two-dimensional image; calculating the image similarity of each target two-dimensional image and the initial two-dimensional image in each target three-dimensional image according to the visual characteristic information corresponding to each target two-dimensional image and the visual characteristic information corresponding to the initial two-dimensional image; and feeding back at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user according to the image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image.
4. The apparatus of claim 3, wherein:
the feedback module is specifically configured to obtain at least one target three-dimensional image with an image similarity greater than a preset image similarity threshold according to an image similarity between each target two-dimensional image in each target three-dimensional image and the initial two-dimensional image, and feed back the at least one target three-dimensional image corresponding to the initial two-dimensional image to the current user.
5. A server, comprising:
one or more processors;
a memory for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the image search method of any one of claims 1 to 2.
6. A storage medium on which a computer program is stored, which program, when being executed by a processor, carries out an image search method according to any one of claims 1 to 2.
CN201810765693.1A 2018-07-12 2018-07-12 Image searching method, device, server and storage medium Active CN108875080B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810765693.1A CN108875080B (en) 2018-07-12 2018-07-12 Image searching method, device, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810765693.1A CN108875080B (en) 2018-07-12 2018-07-12 Image searching method, device, server and storage medium

Publications (2)

Publication Number Publication Date
CN108875080A CN108875080A (en) 2018-11-23
CN108875080B true CN108875080B (en) 2022-12-13

Family

ID=64301658

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810765693.1A Active CN108875080B (en) 2018-07-12 2018-07-12 Image searching method, device, server and storage medium

Country Status (1)

Country Link
CN (1) CN108875080B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729885A (en) * 2014-01-21 2014-04-16 北京邮电大学 Hand-drawn scene three-dimensional modeling method combining multi-perspective projection with three-dimensional registration
CN107038751A (en) * 2015-12-07 2017-08-11 达索系统公司 The identification of 3D modeling object is carried out from 2D images

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100456300C (en) * 2006-10-27 2009-01-28 北京航空航天大学 Method for searching 3D model based on 2D sketch
CN101907459B (en) * 2010-07-12 2012-01-04 清华大学 Monocular video based real-time posture estimation and distance measurement method for three-dimensional rigid body object
TWI536186B (en) * 2013-12-12 2016-06-01 三緯國際立體列印科技股份有限公司 Three-dimension image file serching method and three-dimension image file serching system
CN104751511B (en) * 2013-12-30 2018-02-06 北京师范大学 A kind of three-dimensional scene construction method and device
US9652871B2 (en) * 2015-01-28 2017-05-16 Impac Medical Systems, Inc. Three dimensional localization of a moving target for adaptive radiation therapy
CN106484692B (en) * 2015-08-25 2019-11-29 北京师范大学 A kind of method for searching three-dimension model
CN105488111A (en) * 2015-11-20 2016-04-13 小米科技有限责任公司 Image search method and device
CN106816077B (en) * 2015-12-08 2019-03-22 张涛 Interactive sandbox methods of exhibiting based on two dimensional code and augmented reality
US10235623B2 (en) * 2016-02-12 2019-03-19 Adobe Inc. Accurate tag relevance prediction for image search
CN105930382A (en) * 2016-04-14 2016-09-07 严进龙 Method for searching for 3D model with 2D pictures
JP2018055429A (en) * 2016-09-29 2018-04-05 ファナック株式会社 Object recognition device and object recognition method
CN106777388B (en) * 2017-02-20 2020-11-24 华南理工大学 Double-compensation multi-table Hash image retrieval method
CN107085731B (en) * 2017-05-11 2020-03-10 湘潭大学 Image classification method based on RGB-D fusion features and sparse coding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729885A (en) * 2014-01-21 2014-04-16 北京邮电大学 Hand-drawn scene three-dimensional modeling method combining multi-perspective projection with three-dimensional registration
CN107038751A (en) * 2015-12-07 2017-08-11 达索系统公司 The identification of 3D modeling object is carried out from 2D images

Also Published As

Publication number Publication date
CN108875080A (en) 2018-11-23

Similar Documents

Publication Publication Date Title
US10970334B2 (en) Navigating video scenes using cognitive insights
CN110020411B (en) Image-text content generation method and equipment
CN107832662B (en) Method and system for acquiring image annotation data
CN108334627B (en) Method and device for searching new media content and computer equipment
US11475588B2 (en) Image processing method and device for processing image, server and storage medium
WO2017124116A1 (en) Searching, supplementing and navigating media
CN108108342B (en) Structured text generation method, search method and device
US9563695B2 (en) Personalized electronic magazine
CN111309200B (en) Method, device, equipment and storage medium for determining extended reading content
CN111263186A (en) Video generation, playing, searching and processing method, device and storage medium
Vecchio et al. Cloud computing and augmented reality for cultural heritage
CN112703495A (en) Inferring topics using entity links and ontology data
CN110851712A (en) Book information recommendation method and device and computer readable medium
CN111984825A (en) Method and apparatus for searching video
US9892193B2 (en) Using content found in online discussion sources to detect problems and corresponding solutions
CN109657127B (en) Answer obtaining method, device, server and storage medium
CN109116718B (en) Method and device for setting alarm clock
US9298712B2 (en) Content and object metadata based search in e-reader environment
US9792527B2 (en) Automated slide comparator
CN107239209B (en) Photographing search method, device, terminal and storage medium
US8996984B2 (en) Automatic visual preview of non-visual data
US10140518B1 (en) Content information auditing service
CN112883218A (en) Image-text combined representation searching method, system, server and storage medium
CN108875080B (en) Image searching method, device, server and storage medium
US20160110346A1 (en) Multilingual content production

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant