JP6869226B2 - Information retrieval methods, devices, devices, and computer storage media by pictures - Google Patents

Description

[Cross-reference of related applications]
The present application claims the priority of the Chinese patent application number "201610037780.6" filed on January 20, 2016, the entire contents of which are incorporated herein by reference.

[Field of invention]
The present application relates to a computer technology field, and specifically to an Internet technology field, particularly an information retrieval method and device using pictures.

Conventional information retrieval generally finds information required by a user from a set of existing information by text such as a keyword. However, with the development of Internet technology, users are not satisfied with searching for information only by text, and many users also want to search network pictures or objects appearing in daily life by search engines. Information retrieval technology was born.

Currently, information retrieval technology using pictures generally takes a picture of a target object, acquires a picture containing one target object, and then performs a search based on the picture to search for the name of the target object and related information. Get search result information etc. However, the accuracy of the information retrieval result by the existing picture is not high, and a method of information retrieval by the picture with high accuracy is required.

An object of the present application is to provide an information retrieval method and an apparatus using an improved picture to solve the technical problem mentioned in the background art part.

As a first aspect, the present application provides an information retrieval method using pictures. In the method, the first feature information of the search waiting target in the first picture including the search waiting target input by the terminal is extracted, and the following repeating step is performed based on the first feature information. It is executed, that is, it is determined whether or not there is a search target matching the first feature information in the preset search database, and if it is affirmative, the name information corresponding to the search target is acquired and denied. In the case of, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature information and the first feature information are combined as the first feature information. The repeating step is continuously executed, and the name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal.

In some embodiments, the preset search database includes at least a search goal, feature information of the search goal, and name information of the search goal.

In some embodiments, the first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.

In some embodiments, extracting the second feature information of the search waiting target in the second picture input by the terminal is such that the number of executions of the iterative step is smaller than a preset threshold value. In the case of affirmation, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and in the case of negative, the presentation information indicating the search failure to the terminal is generated. Including.

In some embodiments, extracting the second feature information of the search-waiting target in the second picture input by the terminal inputs a second picture containing the search-waiting target to the terminal. This includes generating the presentation information to be presented as described above and extracting the second feature information of the search waiting target from the second picture input by the terminal.

In some embodiments, the method further acquires the first picture and / or the second picture in which the search waiting target is taken by the terminal, or the first stored locally by the terminal. It includes acquiring one picture and / or the second picture, or acquiring the first picture and / or the second picture searched from the network picture library by the terminal.

As a second aspect, the present application provides an information retrieval device using a picture. The device is based on an extraction module arranged to extract the first feature information of the search waiting target in the first picture including the search waiting target input by the terminal, and the first feature information. Then, the following iterative steps are executed, that is, it is determined whether or not there is a search target matching the first feature information in the preset search database, and if affirmative, the search target is dealt with. The name information is acquired, the second feature information of the search waiting target in the second picture input by the terminal in the case of negative is extracted, and the second feature information and the first feature information are combined. As the first feature information, the iterative step execution module arranged so as to continuously execute the iterative step, and the name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal. It is equipped with a display module arranged in.

In some embodiments, the preset search database includes at least a search goal, feature information of the search goal, and name information of the search goal.

In some embodiments, the first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.

In some embodiments, the iterative step execution module further determines if the number of times the iterative step is executed is less than a preset threshold, and if affirmative, said in the second picture entered by the terminal. It is arranged so as to extract the second feature information of the search waiting target and generate presentation information that presents the search failure to the terminal in the case of denial.

In some embodiments, the iterative step execution module further generates presentation information that presents the terminal to enter a second picture containing the search waiting target, and the second input by the terminal. It is arranged so as to extract the second feature information of the search waiting target from the picture of.

In some embodiments, the device further acquires the first picture and / or the second picture in which the search waiting target is captured by the terminal, or is stored locally by the terminal. An acquisition module arranged to acquire the first picture and / or the second picture, or to acquire the first picture and / or the second picture retrieved from the network picture library by the terminal. To be equipped.

The information retrieval method and device using pictures provided in the present application extracts the first feature information of the search waiting target from the first picture input by the terminal, and stores the first feature information in a preset search database. Judges whether or not there is a search target that matches the search target, obtains the name of the search target if it is affirmative, and obtains the name of the search target if it is negative, and if it is negative, the second of the search waiting targets in the second picture input by the terminal. By combining the feature information and the first feature information, it is continuously determined whether or not there is a search target matching the first feature information in the preset search database as the first feature information. The accuracy of the information retrieval by the picture was improved by displaying the name information of the search waiting target obtained by the matching and the search result corresponding to the name information on the terminal at the end by the plurality of matchings.

Other features, objectives and advantages of the present application will become apparent by viewing the detailed description of the non-restrictive embodiments made with reference to the drawings below.

It is a schematic system structure diagram to which this application is applied. It is a flowchart of one Example of the information retrieval method by a picture by this application. It is a schematic diagram of the application scene of the information retrieval method by a picture by this application. It is a schematic flowchart of an embodiment in which the first feature information is updated by a repeating step in the information retrieval method by a picture according to this application. It is structural schematic diagram of one Example of the information retrieval apparatus by a picture by this application. It is a structural schematic diagram of the computer system of the terminal device or server applied to the realization of the Example of this application.

The present application will be described in more detail below by combining drawings and examples. It should be understood that the specific examples described herein merely interpret a related invention and are not limited to that invention. Also, what should be explained is that, for the sake of brevity, only the parts relating to the related invention are shown in the drawings.

It should be explained that, if there is no contradiction, the examples in the present application and the features in the examples may be combined with each other. Hereinafter, the present application will be described in detail by combining examples with reference to the drawings.

FIG. 1 shows a schematic system structure 100 of an embodiment to which the information retrieval method using a picture or the information retrieval device using a picture of the present application can be applied.

As shown in FIG. 1, the system structure 100 can include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is a medium that provides a communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types such as wired, wireless communication links or optical fibers, cables and the like.

The user can use the terminal devices 101, 102, and 103 to interact with the server 105 via the network 104 to send and receive messages and the like. Various communication client applications, such as shooting applications, search-type applications, browser applications, shopping-type applications, instant communication tools, mailbox clients, and social platform applications, may be installed on the terminal devices 101, 102, and 103.

The terminal devices 101, 102, 103 may be various electronic devices including a display panel and supporting information retrieval. Includes smartphones, tablets, ebook viewers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 (Moving Picture Experts Group Audio Layer IV) players, not limited to them, laptops and desktop computers, etc.

The server 105 may be a server that provides various services, for example, a background information retrieval server that provides support to search engines in terminal devices 101, 102, 103. The background information retrieval server can perform processing such as extraction and analysis on the received picture data, and feed back the processing result to the terminal device.

It should be explained that the information retrieval method by the picture provided in the embodiment of the present application is generally executed by the server 105. Correspondingly, the picture-based information retrieval device is generally installed on the server 105.

It should be understood that the number of terminal devices, networks and servers in Figure 1 is just an example. Any number of terminal devices, networks and servers may be provided, if desired.

With reference to FIG. 2, a flow 200 of an embodiment of the information retrieval method using a picture according to the present application is shown. The information retrieval method using the picture includes the following steps.

In step 201, the first feature information of the search waiting target in the first picture input by the terminal is extracted.

In this embodiment, the electronic device (for example, the server shown in FIG. 1) on which the information retrieval method using a picture is executed is a terminal that is used by a user to perform information retrieval by a wired connection method or a wireless connection method. The first picture can be received from. Then, the electronic device extracts the first feature information of the search waiting target in the first picture. The search waiting target is included in the first picture. The search waiting target here is an arbitrary object whose characteristics are reflected by the picture, and may include, but is not limited to, a mobile phone, architecture, clothes, a bag, and the like. The first feature information includes, but is not limited to, color information, graphic information (for example, contour information of an object included in a picture is considered to be one of graphic information). It should be noted that the wireless connection methods include 3G / 4G connection, WiFi connection, Bluetooth® connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other existing or future developed. Wireless connection methods are included, but not limited to them.

Generally, a user searches for information by using a search engine or the like implemented in a terminal. At this time, the user can input the first picture including the search waiting target by the search box of the search engine. In this embodiment, the picture includes a jpg format, a jpeg format, a gif format, a png format, a bmp format, a tiff format, a pcx format picture, or a picture in another format developed in the future.

It should be explained that, in this embodiment, the first feature information can be extracted from the first picture by a method such as color feature extraction, texture feature extraction, shape feature extraction, or spatial feature extraction. The method of picture feature extraction is a well-known technique that has been well researched and applied at present, and will not be described in detail here.

In step 202, the iterative step is executed based on the first feature information. The repeating step includes the following.

In step 2021, it is determined whether or not there is a search target matching the first feature information in the preset search database.

In this embodiment, a search database can be created in advance in the electronic device. In the search database here, a picture including a search target, feature information related to the search target in each picture, and name information of the search target can be stored. The feature information related to these search targets is the extracted first feature information so that it can be determined whether or not there is a search target matching the first feature information in the database. Used for matching with. If there is a search target matching the first feature information as a result of the determination, the process proceeds to step 2022, and if there is no search target matching the first feature information as a result of the determination, step 2023 is performed. Move to.

In some selective embodiments of this embodiment, the search objectives may include mobile phones, architecture, clothing, bags, and the like. The name information may include the attributes of the search target, the manufacturer, the type, the place name, and the like. For example, when the search target is a mobile phone, the corresponding name may include the manufacturer and type of the mobile phone, for example, "iPhone (registered trademark) 6s". When the search target is a building, the corresponding name may include the name and location of the building, such as "Beijing Bird's Nest" and "Beijing Forbidden City".

In some selective embodiments of the present embodiment, the electronic device matches the first feature information with the feature information of each search target, and the first feature information and the feature information of a certain search target. If the similarity is greater than a predetermined threshold, it is determined that the search target matches the first feature information, otherwise the search target matches the first feature information. Confirm that it is not.

In step 2022, the name information corresponding to the search target is acquired.

In this embodiment, based on the determination result obtained in step 2021, the electronic device (for example, the server shown in FIG. 1) sets the search target matching the first feature information and the search target. The corresponding name information can be obtained. Here, the acquired name information is the name information of the search waiting target.

In step 2023, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature information and the first feature information are combined to form the first feature information. To do.

In this embodiment, the electronic device acquires a second picture input by the terminal. The second picture also includes the search waiting target. Then, the second feature information of the search waiting target is extracted from the second picture, and later, the extracted second feature information and the first feature information are combined to form the first feature information. The process proceeds to step 2021 to continuously determine whether or not the preset search database has a search target that matches the first feature information.

In some selective embodiments of the present embodiment, the first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture are completely. It's not a match. For example, the first picture is a front view of the target to be searched, whereas the second picture is a side view of the target to be searched, or the first picture is a side view of the target to be searched. In contrast to the overall view, the second picture is a partial view of the target to be searched.

In some selective embodiments of this embodiment, the electronic device may acquire a first picture and / or a second picture in which the search waiting target is taken by the terminal, or the terminal is local. The first picture and / or the second picture stored in may be acquired, or the first picture and / or the second picture searched from the network picture library by the terminal may be acquired.

In step 203, the name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal.

In the present embodiment, in the electronic device on which the information retrieval method using a picture is executed, the name information acquired in step 202 and the search result corresponding to the name information are transmitted to the terminal, and the terminal receives the received search waiting target. The name information of the above and the search result corresponding to the name information are displayed to the user.

In some selective embodiments of this embodiment, the search result corresponding to the name information may be a site or a web link related to the name information.

FIG. 3 will continue to be referred to. FIG. 3 is a schematic diagram of an application scene of the information retrieval method using a picture according to the present embodiment. In the application scene of FIG. 3, the user first inputs the first picture 301, and then the information retrieval server acquires the first picture, and the first feature information of the search waiting target in the first picture, For example, the shape feature information of the target to be searched can be extracted. After that, the following iterative steps are performed. That is, it is determined whether or not there is a search target matching the shape information in the preset search database. The judgment result is affirmative or negative, and the information retrieval server sends different presentation information to the user according to the different judgment result. If the decision is negative, the user is offered to upload a second picture, as shown in the drawing. The information retrieval server acquires the second picture uploaded by the user, extracts the second feature information of the search waiting target in the second picture, and then extracts the second feature information and the first one. The feature information is combined with the feature information to form the first feature information, and the repeating step is continued. Finally, the name information corresponding to the search target, for example, "Beijing's bird's nest" is acquired, and the acquired name information, that is, "Beijing's bird's nest" and the corresponding search result are displayed to the user. ..

The information retrieval method and device using pictures provided in the present application extracts the first feature information of the search waiting target in the first picture input by the terminal, and puts the first feature information in a preset search database. Judges whether there is a matching search target, obtains the name of the search target if it is affirmative, and obtains the second feature information of the search waiting target in the second picture entered if it is negative. The determination is continued as the first feature information by combining the first feature information, and by such repetition, finally, the name information of the search waiting target and the name information obtained by the matching are obtained. By displaying the corresponding search results on the terminal, the accuracy of information retrieval by pictures has been improved.

In some selective alternatives, as shown in FIG. 4, the second feature information of the search waiting target in the second picture input by the terminal in step 2023 is extracted and combined with the second feature information. Combining the first feature information into the first feature information can be realized by the following steps.

In step 401, it is determined whether the number of times the repeated step is executed is smaller than a predetermined threshold value.

In the present embodiment, the electronic device (for example, the server shown in FIG. 1) in which the information retrieval method using a picture is executed can set a threshold value in advance for the number of executions of the repeating step. Then, the electronic device determines whether the number of executions of the repeating step is smaller than the threshold value, and if the number of executions of the repeating step is equal to or greater than the threshold value as a result of the determination, the process proceeds to step 402, and the repeating step is performed as a result of the determination. When the number of executions of is smaller than the threshold value, the process proceeds to step 403.

In step 402, the presentation information indicating the failure of the terminal search is generated.

In the present embodiment, although the electronic device has not acquired a search target matching the first feature information, if the number of executions of the repetition step is already equal to or more than the threshold value, the repetition step is directly started. Exit and send the search failure presentation information to the terminal. Here, the search failure presentation information may be textual information that reports the search failure to the user, or search result information that reports to the user that the search is not completely accurate.

In step 403, the presentation information that the terminal presents to input the second picture is generated.

In the present embodiment, when the electronic device has not acquired a search target matching the first feature information, but the number of executions of the repeating step is smaller than the threshold value, the electronic device is the second. Input the picture Send the presentation information to the terminal.

In step 404, the second feature information of the search waiting target is extracted from the second picture input by the terminal.

In the present embodiment, when the user inputs the second picture based on the information presented in step 403, the electronic device acquires the second picture and features the search target in the second picture. The information is extracted and used as the second feature information. Here, the second picture includes the search waiting target.

In step 405, the second feature information and the first feature information are combined to form the first feature information.

In the present embodiment, the electronic device combines the acquired second feature information and the first feature information to obtain the first feature information. Since the information of the first feature information is more comprehensive than that of the first feature information, is there a search target matching the first feature information in the preset search database? It can contribute to the judgment of whether or not. For example, if the threshold is 3, the electronic device performs the first iterative step, for example, assuming that the preset search database does not have a search target that matches the first feature information. Then, the presentation information that presents the second picture to be input by the terminal is generated, and the second feature information extracted from the second picture and the first feature information are combined to generate the first feature. As information, and assuming that the electronic device performs a second iterative step, eg, there is still no search target in the preset search database that matches the first feature information, the second picture. Is continuously generated so as to be input by the terminal, and the second feature information extracted from the second picture and the first feature information are combined to form the first feature information. Then, the electronic device executes the third iterative step, and exits the iterative step and exits, for example, if there is still no search target matching the first feature information in the preset search database. If there is a search target that matches the first feature information in the preset search database, the presentation information that presents the search failure is generated, and the name information corresponding to the search target is acquired.

In the method provided in the embodiment of the above embodiment of the present application, the number of pictures input to the terminal can be conveniently controlled by setting the number of times the repeated steps are executed, and thus the time required for information retrieval. And improved the efficiency of information retrieval.

Further, referring to FIG. 5, as a realization of the methods shown in each of the above figures, the present application provides an embodiment of an information retrieval device using a picture. The embodiment of the device corresponds to the embodiment of the method shown in FIG. The device can be specifically applied to various electronic devices.

As shown in FIG. 5, the picture-based information retrieval apparatus 500 described in this embodiment includes an extraction module 501, a repeating step execution module 502, and a display module 503. The extraction module 501 is arranged so as to extract the first feature information of the search waiting target in the first picture input by the terminal. The search waiting target is included in the first picture. The iterative step execution module 502 executes the following iterative steps based on the first feature information, that is, has a search target matching the first feature information in a preset search database. Judging whether or not, if affirmative, the name information corresponding to the search target is acquired, and if negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted. , The second feature information and the first feature information are combined to form the first feature information, and the second feature information is arranged so as to continuously execute the repeating step. The display module 503 is arranged so as to display the name information of the search waiting target and the search result corresponding to the name information on the terminal.

In this embodiment, the information retrieval device 500 using a picture acquires the first picture and / or the second picture taken by the terminal for the search waiting target, or the first picture stored locally in the terminal. It further comprises an acquisition module (not shown) arranged to acquire and / or a second picture, or to acquire a first picture and / or a second picture retrieved by a terminal from a network picture library.

In some selective embodiments of this embodiment, the first feature information of the search waiting target in the first picture obtained by the extraction module 501 and the second picture obtained by the iterative step execution module 502. The second feature information of the search waiting target in the above does not completely match.

In some selective embodiments of this embodiment, the search database preset in the iterative step execution module 502 includes at least a search goal, search goal feature information, and search goal name information.

In some selective embodiments of the present embodiment, the repeat step execution module 502 further determines whether the number of repeat step executions is less than a predetermined threshold, and if affirmative, is input by the terminal. It is arranged so as to extract the second feature information of the search waiting target in the second picture and generate presentation information that presents a search failure to the terminal in the case of denial.

In some selective embodiments of this embodiment, the iterative step execution module 502 further generates presentation information that presents the terminal to input a second picture containing the search waiting target, and the terminal. It is arranged so as to extract the second feature information of the search waiting target from the second picture input by.

As will be appreciated by those skilled in the art, the information retrieval device 500 using the picture further includes other known configurations such as a processor and a memory. To clarify the embodiments of the present disclosure, these known configurations are not shown in FIG.

A schematic structural diagram of the computer system 600 for realizing the terminal device or server of the embodiment of the present application is shown below with reference to FIG.

As shown in FIG. 6, the computer system 600 has various suitable programs depending on the program stored in the read-only storage medium (ROM) 602 or the program loaded from the storage unit 608 into the random access memory (RAM) 603. It is provided with a central processing unit (CPU) 601 that executes various operations and processes. The RAM 603 further stores various programs and data necessary for operating the system 600. The CPU 601 and the ROM 602 and the RAM 603 are connected to each other by the bus 604. The input / output (I / O) interface 605 is also connected to the bus 604.

Input unit 606 including keyboard, mouse, etc., cathode ray tube (CRT), liquid crystal display (LCD), etc., output unit 607 including speakers, storage unit 608 including hard disk, and network interface card such as LAN card, modem, etc. The communication unit 609 including the above is also connected to the I / O interface 605. The communication portion 609 executes communication processing via a network such as the Internet. The driver 610 is also connected to the I / O interface 605 as needed. Removable media 611, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed in the driver 610 as needed, and computer programs read from them are installed in the storage unit 608 as needed.

In particular, according to the embodiments of the present disclosure, the process described with reference to the flowchart above may be realized as a computer software program. For example, the embodiments of the present disclosure include a computer program product that includes a computer program that is contained in a computer-readable medium. The computer program includes program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication unit 609 and / or installed from removable media 611. When executed by the central processing unit (CPU) 601 the computer program executes the above-mentioned function limited to the method of the present application.

The flowcharts and block diagrams in the drawings show the systems, methods and system structures, functions and operations that can be achieved by the computer program products according to each embodiment of the present application. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code. The module, program segment, or part of the code contains executable commands for implementing one or more predetermined logic functions. It should be noted that in some permutation implementations, the functions shown in the blocks may occur out of the order shown in the drawings. For example, two connected blocks may actually be executed essentially in parallel, or in some cases in reverse order, and are determined according to the relevant function. It should be noted that each block in the block diagram and / or flowchart, and the combination of blocks in the block diagram and / or flowchart, may be implemented in a system with dedicated hardware that performs a given function or operation. Alternatively, it may be realized by a combination of dedicated hardware and computer code.

The modules described in the embodiments of the present application may be realized by software means or hardware means. The modules described may be installed in the processor. For example, it may be described as a processor including an extraction module, a repeating step execution module, and a display module. The names of these modules are not, in some cases, limited to themselves. For example, the extraction module may be further described as "a module that extracts the first feature information of the search waiting target in the first picture input by the terminal".

As another aspect, the present application further provides a non-volatile computer storage medium. The non-volatile computer storage medium may be the non-volatile computer storage medium included in the apparatus described in the above embodiment, or may be a non-volatile computer storage medium that exists alone and is not incorporated in the terminal. good. When one or more programs are stored in the non-volatile computer storage medium and the one or more programs are executed by the device, the device is made to execute the following. That is, the first feature information of the search waiting target in the first picture including the search waiting target input by the terminal is extracted, and the following iterative steps are executed based on the first feature information in advance. It is determined whether or not there is a search target matching the first feature information in the set search database, and if affirmative, the name information corresponding to the search target is acquired, and if negative, the terminal determines. The second feature information of the search waiting target in the input second picture is extracted, and the repeating step is continued as the first feature information by combining the second feature information and the first feature information. Then, the name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal.

The above description is merely a description of preferred embodiments and operating technical principles of the present application. As will be appreciated by those skilled in the art, the scope of the invention according to the present application is not limited to the technical proposal consisting of a specific combination of the technical features, and is optional according to the technical features or equivalent features if it does not deviate from the invention concept. Other technical proposals formed by the combination of the above should be included at the same time. For example, a technical proposal obtained by substituting the above-mentioned features with technical features having similar functions disclosed in the present application (not limited to them) is applicable.
The description of the scope of claims at the time of filing is as follows.
Claim 1:
It is an information retrieval method using pictures.
A step of extracting the first feature information of the search-waiting target in the first picture input by the terminal, wherein the search-waiting target is included in the first picture.
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. A step in which the repetitive step is continuously executed as the first feature information by combining the information and the first feature information, and
A step of displaying the name information of the search waiting target and the search result corresponding to the name information on the terminal, and
A method of searching information by a picture, which comprises.
Claim 2:
The preset search database includes at least a search target, characteristic information of the search target, and name information of the search target.
The information retrieval method using a picture according to claim 1, wherein the information retrieval method is based on a picture.
Claim 3:
The first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.
The information retrieval method using a picture according to claim 2, wherein the information retrieval method is based on a picture.
Claim 4:
Extracting the second feature information of the search waiting target in the second picture input by the terminal can be performed.
It is determined whether the number of executions of the repeating step is smaller than the preset threshold value, and the number of executions is determined.
In the case of affirmation, the second feature information of the search waiting target in the second picture input by the terminal is extracted.
If negative, generate presentation information that presents the search failure to the terminal,
The information retrieval method using a picture according to claim 3, wherein the information retrieval method includes the above.
Claim 5:
Extracting the second feature information of the search waiting target in the second picture input by the terminal can be performed.
Generate presentation information that presents the terminal to input a second picture containing the search waiting target.
The second feature information of the search waiting target is extracted from the second picture input by the terminal.
The information retrieval method using a picture according to claim 1 or 4, wherein the information retrieval method includes the above.
Claim 6:
The method is
The search waiting target acquires the first picture and / or the second picture taken by the terminal, or
Acquires or obtains the first picture and / or the second picture stored locally in the terminal.
Acquires the first picture and / or the second picture searched by the terminal from the network picture library.
The information retrieval method using a picture according to claim 1, further comprising the above.
Claim 7:
An extraction module arranged to extract the first feature information of the search-waiting target in the first picture input by the terminal, wherein the search-waiting target is included in the first picture. ,
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether or not there is a search target matching the first feature information in the preset search database. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. A repeating step execution module, which is arranged so as to continuously execute the repeating step as the first feature information by combining the information and the first feature information,
A display module arranged so as to display the name information of the search waiting target and the search result corresponding to the name information on the terminal.
An information retrieval device using a picture, which comprises.
Claim 8:
The preset search database includes at least a search target, characteristic information of the search target, and name information of the search target.
The information retrieval device using a picture according to claim 7, wherein the information retrieval device is based on a picture.
Claim 9:
The first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.
The information retrieval device using a picture according to claim 8, wherein the information retrieval device is based on a picture.
Claim 10:
The iterative step execution module further
It is determined whether the number of executions of the repeating step is smaller than the preset threshold value, and the number of executions is determined.
In the case of affirmation, the second feature information of the search waiting target in the second picture input by the terminal is extracted.
If negative, it is arranged to generate presentation information that presents the search failure to the terminal,
The information retrieval device using a picture according to claim 9, wherein the information retrieval device is based on a picture.
Claim 11:
The iterative step execution module further
Generate presentation information that presents the terminal to input a second picture containing the search waiting target.
Arranged so as to extract the second feature information of the search waiting target from the second picture input by the terminal.
The information retrieval device based on a picture according to claim 7 or 10.
Claim 12:
The device is
The search waiting target acquires the first picture and / or the second picture taken by the terminal, or
Acquires or obtains the first picture and / or the second picture stored locally in the terminal.
An acquisition module arranged to acquire the first picture and / or the second picture searched by the terminal from the network picture library.
The information retrieval device using a picture according to claim 7, further comprising.
Claim 13:
With the processor
With memory,
A computer-readable command that can be executed by the processor is stored in the memory, and when the computer-readable command is executed, the processor executes a picture-based information retrieval method.
The method is
The first feature information of the search-waiting target in the first picture including the search-waiting target input by the terminal is extracted.
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. The repetitive step is continuously executed as the first feature information by combining the information and the first feature information.
The name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal.
A device characterized by including.
Claim 14:
A computer-readable command that can be executed by the processor is stored, and when the computer-readable command is executed by the processor, the information retrieval method using a picture is executed by the processor.
The method is
The first feature information of the search-waiting target in the first picture including the search-waiting target input by the terminal is extracted.
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. The repetitive step is continuously executed as the first feature information by combining the information and the first feature information.
The name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal.
A non-volatile computer storage medium comprising.

Claims (14)

It is an information retrieval method using pictures.
It is a step of extracting the first feature information of the search waiting target in the first picture input by the terminal, the search waiting target is included in the first picture, and the search waiting target targets architecture. you, and the step,
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. A step in which the repetitive step is continuously executed as the first feature information by combining the information and the first feature information, and
A step of displaying the name information of the search waiting target and the search result corresponding to the name information on the terminal , wherein the name information includes the name and place of the building .
A method of searching information by a picture, which comprises. The preset search database includes at least a search target, characteristic information of the search target, and name information of the search target.
The information retrieval method using a picture according to claim 1, wherein the information retrieval method is based on a picture. The first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.
The information retrieval method using a picture according to claim 2, wherein the information retrieval method is based on a picture. Extracting the second feature information of the search waiting target in the second picture input by the terminal can be performed.
It is determined whether the number of executions of the repeating step is smaller than the preset threshold value, and the number of executions is determined.
In the case of affirmation, the second feature information of the search waiting target in the second picture input by the terminal is extracted.
If negative, generate presentation information that presents the search failure to the terminal,
The information retrieval method using a picture according to claim 3, wherein the information retrieval method includes the above. Extracting the second feature information of the search waiting target in the second picture input by the terminal can be performed.
Generate presentation information that presents the terminal to input a second picture containing the search waiting target.
The second feature information of the search waiting target is extracted from the second picture input by the terminal.
The information retrieval method using a picture according to claim 1 or 4, wherein the information retrieval method includes the above. The method is
The search waiting target acquires the first picture and / or the second picture taken by the terminal, or
Acquires or obtains the first picture and / or the second picture stored locally in the terminal.
Acquires the first picture and / or the second picture searched by the terminal from the network picture library.
The information retrieval method using a picture according to claim 1, further comprising the above. An extraction module arranged to extract the first feature information of the search-waiting target in the first picture input by the terminal, wherein the search-waiting target is included in the first picture and the search-waiting target is included . the goal shall be the subject of architecture, and the extraction module,
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether or not there is a search target matching the first feature information in the preset search database. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. A repeating step execution module, which is arranged so as to continuously execute the repeating step as the first feature information by combining the information and the first feature information,
A display module arranged to display the name information of the search waiting target and the search result corresponding to the name information on the terminal, and the name information includes a display module including a name and a place of a building. ,
An information retrieval device using a picture, which comprises. The preset search database includes at least a search target, characteristic information of the search target, and name information of the search target.
The information retrieval device using a picture according to claim 7, wherein the information retrieval device is based on a picture. The first feature information of the search-waiting target in the first picture and the second feature information of the search-waiting target in the second picture do not completely match.
The information retrieval device using a picture according to claim 8, wherein the information retrieval device is based on a picture. The iterative step execution module further
It is determined whether the number of executions of the repeating step is smaller than the preset threshold value, and the number of executions is determined.
In the case of affirmation, the second feature information of the search waiting target in the second picture input by the terminal is extracted.
If negative, it is arranged to generate presentation information that presents the search failure to the terminal,
The information retrieval device using a picture according to claim 9, wherein the information retrieval device is based on a picture. The iterative step execution module further
Generate presentation information that presents the terminal to input a second picture containing the search waiting target.
Arranged so as to extract the second feature information of the search waiting target from the second picture input by the terminal.
The information retrieval device based on a picture according to claim 7 or 10. The device is
The search waiting target acquires the first picture and / or the second picture taken by the terminal, or
Acquires or obtains the first picture and / or the second picture stored locally in the terminal.
An acquisition module arranged to acquire the first picture and / or the second picture searched by the terminal from the network picture library.
The information retrieval device using a picture according to claim 7, further comprising. With the processor
With memory,
A computer-readable command that can be executed by the processor is stored in the memory, and when the computer-readable command is executed, the processor executes a picture-based information retrieval method.
The method is
The first feature information of the search-waiting target in the first picture including the search-waiting target for architecture, which is input by the terminal, is extracted.
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. The repetitive step is continuously executed as the first feature information by combining the information and the first feature information.
The name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal, and the name information includes the name and place of the building.
A device characterized by including. A computer-readable command that can be executed by the processor is stored, and when the computer-readable command is executed by the processor, the information retrieval method using a picture is executed by the processor.
The method is
The first feature information of the search-waiting target in the first picture including the search-waiting target for architecture, which is input by the terminal, is extracted.
Based on the first feature information, the following iterative steps are performed, that is, it is determined and affirmed whether the preset search database has a search target that matches the first feature information. In the case of, the name information corresponding to the search target is acquired, and in the case of negative, the second feature information of the search waiting target in the second picture input by the terminal is extracted, and the second feature is described. The repetitive step is continuously executed as the first feature information by combining the information and the first feature information.
The name information of the search waiting target and the search result corresponding to the name information are displayed on the terminal, and the name information includes the name and place of the building.
A non-volatile computer storage medium comprising.

Images