CN107798115A - Image identification search method, system and the mobile terminal of mobile terminal - Google Patents
Image identification search method, system and the mobile terminal of mobile terminal Download PDFInfo
- Publication number
- CN107798115A CN107798115A CN201711072877.1A CN201711072877A CN107798115A CN 107798115 A CN107798115 A CN 107798115A CN 201711072877 A CN201711072877 A CN 201711072877A CN 107798115 A CN107798115 A CN 107798115A
- Authority
- CN
- China
- Prior art keywords
- search
- image
- user
- mobile terminal
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Business, Economics & Management (AREA)
- Business, Economics & Management (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention is image identification search method, system and the mobile terminal of a kind of mobile terminal, and methods described includes：The target start instruction that user sends is received, the taking module for starting the mobile terminal shoots a target object, obtains the image of the target object；The image of the target object is identified, extracts the characteristic information of described image, while produce the request signal of an information search；The request signal of described information search is responded, according to the characteristic information of described image, the search search result associated with the characteristic information of described image；And the associated search result that display searches.The present invention is on the premise of greatly reducing search and taking, effectively improve the quality of the search image of user's input, and then it can accordingly improve the quality of picture search, so that search product is to searching for the identification of image and judging more accurate, single search efficiency may finally be lifted, improves the search frequency that user uses the search product.
Description
Technical field
The present invention relates to technical field of information processing, and in particular to a kind of image identification search method of mobile terminal, is
System and mobile terminal.
Background technology
With the continuous maturation of mobile terminal to search technology, people carry out picture search wish and demand also increasingly
Substantially, at present, mainly based on input of taking pictures, it operates maturity to user and requires higher the picture search form of industry.
Such as：When user take pictures manually search, the main flow of picture search includes：" user's startup picture search function->
User takes pictures->System identification->Result presentation ".
Existing way of search of taking pictures is complex, and is to redirect Webpage search, is not very convenient for user；
And during be input to output, user to system detectio to target and oneself want search target it is whether consistent, with
And how operating that can to lift outcome quality be unaware, whole process is transparent to user.Accordingly, it is above-mentioned from input
Process to output has two：1st, whole process average time reaches 7s or so, the patience time of normal movement user
Only 3s, therefore cause a large amount of losses of user；2nd, feedback of the transparence without node is searched for so that user is to systematic search
Target is whether what, the target are consistent with the search target of oneself, and whether the input of oneself meets the requirements and how to carry
The information such as the high search accuracy rate of oneself are known nothing, can not error correction in time until seeing final search result.
The content of the invention
The shortcomings that for above-mentioned prior art, the present invention provide a kind of image identification search method, the system of mobile terminal
And mobile terminal, to optimize existing picture search technology, meet the growing personalization of people, the picture search of facilitation
Demand.
The purpose of the present invention can use following technical scheme to realize with solving its technical problem.
A kind of image identification search method of mobile terminal proposed by the present invention, comprises the following steps：User is received to send
A target start instruction, start the mobile terminal taking module shoot a target object, obtain the target object
Image；The image of the target object is identified, extracts the characteristic information of described image, while produces the request letter of an information search
Number；The request signal of described information search is responded, according to the characteristic information of described image, search and the characteristic information of described image
Associated search result；And the associated search result that display searches.
Wherein, the request signal of the response described information search, according to the characteristic information of described image, search with it is described
The associated search result of the characteristic information of image, is further included：According to the characteristic information of described image, from a search database
Search for and read the search result associated with the characteristic information of described image；Wherein, the search database purchase is deposited in one
In storage unit；Or the search database purchase is in a webserver, communicated by network with the webserver with
Access the search database.
Wherein, in addition to：The image for obtaining the target object of the taking module captured in real-time detects as adjustment
Image；Local identification is carried out to the adjustment detection image, and guiding opinion is shot to user feedback according to local recognition result,
To instruct the user to optimize adjustment to the adjustment detection image；When meeting that image selectes condition, the bat is obtained
The image of module current shooting is taken the photograph as search image；Scanned for according to the search image, and the search result is carried
Supply the user.
Wherein, it is described to carry out local identification to the adjustment detection image, and according to local recognition result to user feedback
Guiding opinion is shot, in addition to：Substance feature identification or ambient parameter identification are carried out to the adjustment detection image；According to entity
Feature recognition result or ambient parameter recognition result, to the shooting guiding opinion corresponding to user feedback.
Wherein, it is described to be scanned for according to the search image, and the search result is supplied to the user, also wrap
Include：Obtain the target entity that the search image includes；Interception is corresponding with the target entity in the search image
Topography, and the topography is shown in the first display location of search image display interfaces；Obtain with it is described
Network inquiry condition corresponding to target entity；Web search is carried out according to the network inquiry condition, and by search result in institute
The second display location for stating search image display interfaces is shown.
The purpose of the present invention can also further be realized with solving its technical problem using following technical measures.
According to a kind of image identification search system of mobile terminal proposed by the present invention, including：Taking module, for receiving
The target start instruction that user sends, shoots a target object；Acquisition module, obtain the image of the target object；Image
Identification module, for identifying the image of the target object, the characteristic information of described image is extracted, while produce an information search
Request signal；Search module, for responding the request signal of described information search, according to the characteristic information of described image, search
The rope search result associated with the characteristic information of described image；And display module, show the associated search searched
As a result.
Wherein, further include：Detection image acquisition module is adjusted, obtains the object of the taking module captured in real-time
The image of body is as adjustment detection image；Guiding opinion feedback module is shot, local identification is carried out to the adjustment detection image,
And guiding opinion is shot to user feedback according to local recognition result, to instruct the user to carry out the adjustment detection image
Optimize and revise；Image collection module is searched for, when meeting that image selectes condition, obtains the image of the taking module current shooting
As search image；The display module, scanned for, and the search result is supplied to described according to the search image
User.
Wherein, the shooting guiding opinion feedback module is specifically used for, and substance feature is carried out to the adjustment detection image
Identification or ambient parameter identification；According to substance feature recognition result or ambient parameter recognition result, to institute corresponding to user feedback
State shooting guiding opinion.
A kind of mobile terminal, including：At least one processor；Memory；And it is stored in the image on the memory
Search utility is identified, described image identification search utility realizes following operation when being run by the processor：User is received to send
A target start instruction, start the mobile terminal taking module shoot a target object, obtain the target object
Image；The image of the target object is identified, extracts the characteristic information of described image, while produces the request letter of an information search
Number；The request signal of described information search is responded, according to the characteristic information of described image, search and the characteristic information of described image
Associated search result；And the associated search result that display searches.
A kind of computer-readable recording medium, image identification search journey is stored with the computer-readable recording medium
Sequence, described image identification search utility realize when being run by processor it is above-mentioned any one of method the step of.
By above technical scheme and measure, the invention provides a kind of image identification search method of mobile terminal, it is
System and mobile terminal, the image by obtaining camera real-time capture are used as adjustment detection image；To the adjustment detection image
Local identification is carried out, and guiding opinion is shot to user feedback according to local recognition result；When meeting that image selectes condition, obtain
The image that the camera is currently caught is taken as search image；Web search is carried out according to the search image, and by network
Search result is supplied to the technological means of the user, realizes local acquisition user feedback corresponding with adjustment detection image and claps
After taking the photograph guiding opinion, with can sensible form be supplied to user, greatly reduce search it is time-consuming on the premise of, it is defeated to effectively improve user
The quality of the search image entered, and then can accordingly improve the quality of picture search so that knowledge of the search product to search image
Not and judgement is more accurate, may finally lift single search efficiency, improves the search frequency that user uses the search product.
Brief description of the drawings
Figure 1A to Figure 1B is a kind of module of the image identification search system of mobile terminal in first embodiment of the invention
Schematic diagram.
Fig. 2 is the schematic flow sheet of the image identification search method of mobile terminal in second embodiment of the invention.
Fig. 3 A are the schematic flow sheets of the image identification search method of mobile terminal in third embodiment of the invention.
Fig. 3 B are a kind of according to ambient parameter recognition result in third embodiment of the invention, to bat corresponding to user feedback
Take the photograph the display schematic diagram of guiding opinion.
Fig. 4 A are the schematic flow sheets of the image identification search method of mobile terminal in fourth embodiment of the invention.
Fig. 4 B to Fig. 4 E are a kind of according to substance feature recognition result in fourth embodiment of the invention, to user feedback pair
The display schematic diagram for the shooting guiding opinion answered.
Fig. 5 A are the schematic flow sheets of the image identification search method of mobile terminal in fifth embodiment of the invention.
Fig. 5 B are a kind of the aobvious of display image search result in search image shows interface in fifth embodiment of the invention
Show schematic diagram.
Fig. 6 is a kind of structural representation of mobile terminal proposed by the present invention.
Embodiment
For further illustrate the present invention a kind of image identification search method, system and the mobile terminal of mobile terminal be up to
The technological means taken into predetermined goal of the invention and its effect of reach, below in conjunction with accompanying drawing and preferred embodiment, to foundation
The image identification search method of mobile terminal proposed by the present invention, the embodiment of system and mobile terminal, structure, feature
And its effect, it is described in detail.
Figure 1A to Figure 1B is refer to, it is a kind of image identification search system of mobile terminal in first embodiment of the invention
The module diagram of system.
In figure ia, the module diagram of the image identification search system of a kind of mobile terminal proposed by the present invention, the shifting
Dynamic terminal includes；Taking module 110, acquisition module 120, picture recognition module 130, search module 140 and display module
150, wherein, the taking module 110, the target start instruction sent for receiving user, shoot a target object；Obtain
Module 120, obtain the image of the target object；Picture recognition module 130, for identifying the image of the target object, carry
The characteristic information of described image is taken, while produces the request signal of an information search；Search module 140, for responding the letter
The request signal of search is ceased, according to the characteristic information of described image, the search search associated with the characteristic information of described image
As a result；And display module 150, show the associated search result searched.
In one embodiment, in addition to：According to the characteristic information of described image, search for and read from a search database
The search result associated with the characteristic information of described image；Wherein, the search database purchase is in a memory cell；Or
The search database purchase is communicated to access the search in a webserver by network with the webserver
Database.
In fig. ib, the mobile terminal also includes；Adjust detection image acquisition module 160, shooting guiding opinion feedback mould
Block 170, search image collection module 180；Wherein, detection image acquisition module 160 is adjusted, the taking module is obtained and claps in real time
The image for the target object taken the photograph is as adjustment detection image；Guiding opinion feedback module 170 is shot, the adjustment is detected
Image carries out local identification, and shoots guiding opinion to user feedback according to local recognition result, to instruct the user to institute
State adjustment detection image and optimize adjustment；Image collection module 180 is searched for, when meeting that image selectes condition, described in acquisition
The image of taking module current shooting is as search image；The display module 150, scanned for according to the search image,
And the search result is supplied to the user.
In one embodiment, the shooting guiding opinion feedback module 170 is specifically used for, and the adjustment detection image is entered
Row substance feature identifies or ambient parameter identification；It is anti-to user according to substance feature recognition result or ambient parameter recognition result
The shooting guiding opinion corresponding to feedback.
In one embodiment, in addition to：The substance feature identification specifically refers to wrap according in the adjustment detection image
Whether the distance between the physical quantities that include, entity and camera and the entity identified meet class corresponding with entity type
The recognition result of the substance features such as type identification condition, to shooting guiding opinion corresponding to user feedback, such as：Shot away from target
Object shoots guiding opinion close to target reference object etc..It is, of course, understood that the shooting guiding opinion can be with
By different describing modes (such as：Close to target or close to target etc.), different expression ways (such as：Voice or text
Word) user is fed back to, the present embodiment is to this and is not limited.
In one embodiment, in addition to：By local SIFT (Scale-invariant featuretransform,
Scale invariant features transform) technology, feature point extraction is carried out in the adjustment detection image, and then identify that the adjustment detects
What what image included be mutually distinguishable, one or more independent community.The ambient parameter identification specifically refers to, according to institute
State adjustment detection image image features recognition result (such as：Brightness, and/or definition), it is corresponding to user feedback
Shooting guiding opinion, such as：Open flash lamp or close flash lamp etc..
In one embodiment, in addition to：The adjustment detection image is different from the search that user finally carries out web search
Image, but before user determines input search image, image that camera real-time capture arrives, schemed by being detected to the adjustment
As being identified, user can be instructed how to adjust camera and shot, so that the network for being based ultimately upon search image is searched
Hitch fruit to the greatest extent can be accurate.Wherein it is possible to while the image of camera real-time capture is obtained as adjustment detection image, will
The adjustment detection image obtained in real time is shown to user in view-finder is shot.
Fig. 2 is refer to, is the schematic flow sheet of the image identification search method of mobile terminal in second embodiment of the invention.
Comprise the following steps：
Step S210:The target start instruction that user sends is received, starts the taking module shooting of the mobile terminal
One target object, obtain the image of the target object；
Step S220:The image of the target object is identified, extracts the characteristic information of described image, while produce an information
The request signal of search；
Step S230:Respond the request signal of described information search, according to the characteristic information of described image, search with it is described
The associated search result of the characteristic information of image；
Step S240:Show the associated search result searched.
In the first embodiment of the present invention, the request signal of the response described information search, according to described image
Characteristic information, the search search result associated with the characteristic information of described image, is further included：Believed according to the feature of described image
Breath, searched for from a search database and read the search result associated with the characteristic information of described image；Wherein, it is described to search
Rope database purchase is in a memory cell；Or the search database purchase passes through network and institute in a webserver
Webserver communication is stated to access the search database.
Fig. 3 A are refer to, are the flow signal of the image identification search method of mobile terminal in third embodiment of the invention
Figure.Comprise the following steps：
Step S310:The image of the target object of the taking module captured in real-time is obtained as adjustment detection figure
Picture.
In one embodiment, in addition to：When user has picture search demand, image that can accordingly in opening terminal apparatus
Taking pictures in the client software of search engine searches figure function, the client software can with so that opening terminal apparatus shooting
Head, and the image of camera real-time capture is obtained as adjustment detection image.Wherein, the adjustment detection image is different from user
The final search image for carrying out web search, but before user determines input search image, camera real-time capture arrives
Image, by the way that the adjustment detection image is identified, user can be instructed how to adjust camera and shot, so that most
Web search results eventually based on search image to the greatest extent can be accurate.Optionally, the image of camera real-time capture can obtained
While as adjustment detection image, the adjustment detection image obtained in real time is shown to user in view-finder is shot.
Step S320:Carry out local identification to the adjustment detection image, and according to local recognition result to user feedback
Guiding opinion is shot, to instruct the user to optimize adjustment to the adjustment detection image；
Wherein, the purpose locally identified is exactly to be taken to reduce search, as stated in the Background Art, existing image
Search technique is mainly that the image of user's shooting is sent into back-end server to scan for, time-consuming longer (the 7s left sides of whole process
It is right), and search result can not be predicted；In the present embodiment, creative proposition carries out local knowledge to the adjustment detection image
Other scheme, experiment find that locally identification takes only 170ms to single, can real-time feed back, improve conversion ratio.
In one embodiment, in addition to:It is local that substance feature identification is carried out to the adjustment detection image；It is special according to entity
Recognition result is levied, to shooting guiding opinion corresponding to user feedback.
In one embodiment, in addition to:It is local that ambient parameter identification is carried out to the adjustment detection image；Joined according to environment
Number recognition results, to shooting guiding opinion corresponding to user feedback.
In one embodiment, in addition to:It is local that substance feature identification and ambient parameter are carried out to the adjustment detection image
Identification；According to substance feature recognition result and ambient parameter recognition result, to shooting guiding opinion corresponding to user feedback.
In one embodiment, in addition to:The substance feature identification specifically refers to wrap according in the adjustment detection image
Whether the distance between the physical quantities that include, entity and camera and the entity identified meet class corresponding with entity type
The recognition result of the substance features such as type identification condition, to shooting guiding opinion corresponding to user feedback, such as：Shot away from target
Object shoots guiding opinion close to target reference object etc..
In one embodiment, in addition to:By local SIFT (Scale-invariant feature transform,
Scale invariant features transform) technology, feature point extraction is carried out in the adjustment detection image, and then identify that the adjustment detects
What what image included be mutually distinguishable, one or more independent community.The ambient parameter identification specifically refers to, according to institute
State adjustment detection image image features recognition result (such as：Brightness, and/or definition), it is corresponding to user feedback
Shooting guiding opinion, such as：Open flash lamp or close flash lamp etc..
In one embodiment, in addition to：According to the recognition result of ambient parameter, built to guidance is shot corresponding to user feedback
View, can include：If it is determined that the image features of the adjustment detection image are unsatisfactory for first count and shine identification condition, then give birth to
The user is fed back into instructing user to open the shooting guiding opinion of flash lamp；If it is determined that the figure of the adjustment detection image
Identification condition is shone as characteristic parameter is unsatisfactory for second count, then generation instructs the shooting guiding opinion of user's closing flash lamp to feed back to
The user；Wherein, described image characteristic parameter includes：Brightness, and/or definition.
Specifically, if it is determined that it is described adjustment detection image brightness be less than first setting luminance threshold (namely：It is unsatisfactory for
First count shines identification condition), then generation instructs the shooting guiding opinion of user's unlatching flash lamp to feed back to the user；If really
The brightness of the fixed adjustment detection image be more than the second setting luminance threshold (namely：It is unsatisfactory for second count and shines identification condition), then
Generation instructs user to close the shooting guiding opinion of flash lamp to feed back to the user, so that finally to shoot light moderate by user
Picture rich in detail as search image.
In figure 3b, one kind in third embodiment of the invention is shown according to ambient parameter recognition result, it is anti-to user
The display schematic diagram of shooting guiding opinion corresponding to feedback；
Step S330:When meeting that image selectes condition, the image of the taking module current shooting is obtained as search
Image；
In one embodiment, also include two kinds and take pictures and search the mode of figure, typically, manual shooting style and automatic camera
Mode.Accordingly, if user have selected manual shooting style, can detect user input photographing instruction when,
It is determined that meet that image selectes condition；If user have selected automatic camera mode, it can stablize in the stand-by period, detect
The adjustment detection image obtained in real time meets stable condition (typical, the adjustment detection image that different time obtains of taking pictures
There is no significant change) when, it is determined that meeting that image selectes condition.
Step S340:Scanned for according to the search image, and the search result is supplied to the user.
In one embodiment, in addition to：Current interface (shooting view-finder) can be jumped to after search image is obtained
Search result is shown in interface to show corresponding web search results；In another optional embodiment of the present embodiment
In, search image shows interface can be provided the user first after search image is obtained, wherein, the search image shows
Interface specifically refers to the program interface that the client of image search engine is supplied to user to browse its search image inputted, and
Shown simultaneously in the search image shows interface user's input search image (all or local) and with the search
Subnetwork search result corresponding to image.
Fig. 4 A are refer to, are the flow signal of the image identification search method of mobile terminal in fourth embodiment of the invention
Figure.Comprise the following steps：
Step S410:The image of camera real-time capture is obtained as adjustment detection image.
Step S420:It is local that substance feature identification is carried out to the adjustment detection image.
Step S430:Whether the physical quantities for judging to identify in the adjustment detection image are 1：If so, perform
S440；Otherwise, S4100 is performed.
In the present embodiment, it is contemplated that user typically by the client of image search engine take pictures when searching figure, its
It is interested in a specific single entities content with very big probability.Therefore, if the adjustment detection image obtained in real time
In include more than 1 entity or fail to include 1 complete entity, then the web search knot that image search engine finally returns that
Fruit may will and user actual search demand occur deviation.Accordingly, can be identified according in adjustment detection image
Physical quantities, provide a user corresponding to shooting guiding opinion.
Wherein, in Fig. 4 B to Fig. 4 E, show that a kind of identified according to substance feature in fourth embodiment of the invention is tied
Fruit, to the display schematic diagram that guiding opinion is shot corresponding to user feedback；
As shown in Figure 4 B, adjust in detection image and contain two complete entities, " tree " and " snowman ", and user is real
Search need be normally only " tree " or be only " snowman ", if according to the adjustment detection image to user return web search
As a result, then the web search results can include the information of the unwanted entity of user, therefore, " be able to please be leaned on to user feedback
The shooting guiding opinion of close-target ", single entities are only included with the search image for causing end user to input；Similar, such as
Shown in Fig. 4 C, " tree " or " snowman " that the adjustment detection image includes is imperfect, based on an incomplete entity
Web search is carried out, the web search results of final return also have larger error, therefore, " can be asked remote to user feedback
From target " shooting guiding opinion, with cause end user input search image only include single entities；Similar, such as
Shown in Fig. 4 C, " tree " or " snowman " that the adjustment detection image includes is imperfect, based on an incomplete entity
Web search is carried out, the web search results of final return also have larger error, therefore, " can be asked remote to user feedback
From target " shooting guiding opinion, with cause end user input search image include complete entity.It will of course be understood that
, it is described shooting guiding opinion can by different describing modes (such as：Close to target or close to target etc.), it is different
Expression way (such as：Voice or word) user is fed back to, the present embodiment is to this and is not limited.
Step S440:Whether the distance between described entity and the camera that judgement identifies are less than first apart from threshold
Value, if so, performing S450；Otherwise, S460 is performed.
Further, after single entities are identified, can instruct with and then according to the distance between entity and camera
User is adjusted to shooting focal length, to cause the size of the entity in image is searched for be more beneficial for web search.
Step S450：Generation instructs shooting guiding opinion of the user away from target reference object to feed back to the user, holds
Row S4130.
Step S460：Whether the distance between described entity and the camera that judgement identifies are more than second distance threshold
Value, if so, performing S470；Otherwise, S480 is performed.
Step S470：Generation instructs user to feed back to the user close to the shooting guiding opinion of target reference object, holds
Row S4130.
In the present embodiment, entity is being obtained after the pixel coordinate in adjusting detection image, can be according to image pixel
Corresponding relation between coordinate and actual position coordinate, it is determined that in physical location space, between the entity and camera away from
From value, and can be built according to the difference value between the distance value and setpoint distance threshold value to guidance is shot corresponding to user feedback
View.
Wherein, as shown in Figure 4 D, when it is determined that the distance between camera and the entity (" snowman ") farther out when, can to
The shooting guiding opinion of family feedback " please be close to target "；As shown in Figure 4 E, when it is determined that between camera and the entity (" snowman ")
It is closer to the distance when, can be to the shooting guiding opinion of user feedback " please away from target ", finally to ensure that the entity is being searched for
It is of moderate size in image, in order to follow-up web search.
Step S480：Whether the entity for judging to identify meets that type corresponding with the entity type of the entity is known
Other condition, if so, performing S4130；Otherwise, S490 is performed.
In the present embodiment, the identification mould of multiple different entities types is locally stored in the client of image search engine
Plate, such as：Flowers, plant, animal, fruit and vegetables etc..To adjustment detection image carry out Entity recognition when, can with and then
It is determined that the entity type belonging to the entity identified.
Step S490：Generate the shooting guiding opinion matched with the entity type and feed back to the user, perform
S4130。
Step S4100：Whether the entity for judging to identify in the adjustment detection image is more than 1, if so, performing
S4110；Otherwise, S4120 is performed.
Step S4110：Generation instructs user to feed back to user close to the shooting guiding opinion of target reference object, performs
S4130。
Step S4120：Generation instructs shooting guiding opinion of the user away from target reference object to feed back to user, performs
S4130。
Step S4130：Judge whether to meet that image selectes condition, if so, performing S2140；Otherwise, return and perform S430.
Step S4140：Obtain the image that the camera is currently caught and be used as search image.
Step S4150:Web search is carried out according to the search image, and web search results are supplied to the use
Family.
Fig. 5 A are refer to, it is the flow signal of the image identification search method of mobile terminal in fifth embodiment of the invention
Figure.Comprise the following steps：
Step S510：The image of camera real-time capture is obtained as adjustment detection image.
Step S520：Carry out local identification to the adjustment detection image, and according to local recognition result to user feedback
Guiding opinion is shot, to instruct the user to optimize adjustment to the adjustment detection image.
Step S530：When meeting that image selectes condition, image that the camera is currently caught is obtained as search graph
Picture.
Step S540：Obtain the target entity that the search image includes.
Step S550：Corresponding with the target entity topography of interception in the search image, and by the office
Portion's image is shown in the first display location of search image display interfaces.
Step S560：Obtain network inquiry condition corresponding with the target entity.
Step S570：Web search is carried out according to the network inquiry condition, and by search result in the search image
Second display location at displaying interface is shown.
Wherein, in figure 5b, show that one kind shows figure in search image shows interface in fifth embodiment of the invention
As the display schematic diagram of search result.
As shown in Figure 5 B, after search image is determined, it will obtain user based on the search image and select search
Target entity, and the position according to the target entity in image is searched for, the part of the target entity will be included in search image
The interception of image 5101 is come out, and half screen is carried out in search image shows interface and is shown (upper half screen), meanwhile, it is real the target will to be based on
The search result 5102 (part) of body, equally carry out half screen in the search image shows interface and show (lower half screen).
Accordingly, the option of " checking more search results " is included simultaneously in the search image shows interface
5103, when the search result 5102 that user half-and-half shields display is unsatisfied with, interface can be jumped to search result displaying interface
In check more other search results.The benefit so set is：Because limitation be present in image recognition technology, so even
The picture quality of user's input is high-quality picture, however it remains search result mistake or retrieval result and user view are inconsistent
Situation.Therefore by user's multidimensional demand structuring by half screen deploy in a manner of it is preposition be presented to user, facilitate user's fast browsing
To find satisfactory result, or initiation retrieval again, lifting single improves and searches for frequency summary info while retrieving feedback efficiency
It is secondary.
Fig. 6 is refer to, it is a kind of structural representation of mobile terminal proposed by the present invention.It please coordinate reference picture 1.
In figure 6, the mobile terminal 600 includes：At least one processor 601, memory 602, at least one network connect
Mouth 603.Each component in mobile terminal 600 is coupled by bus system 604.It is understood that bus system 604 is used for
Realize the connection communication between these components.Bus system 604 is in addition to including data/address bus, in addition to power bus, control
Bus and status signal bus in addition.But for the sake of clear explanation, various buses are all designated as bus system 604 in figure 6.
In one embodiment, in addition to：User interface 605, wherein, user interface 605 can include display, keyboard or
Person's pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or touch-screen etc., for receiving the information of user
Input operation.
In one embodiment, in addition to：Network interface 603 can be with connection communication equipment, for receiving the letter of outside input
Number instruction.
It is appreciated that the memory 602 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
Or it may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage, may be programmed
Read-only storage, Erasable Programmable Read Only Memory EPROM, Electrically Erasable Read Only Memory or flash memory.Volatile memory
Can be random access memory, it is used as External Cache.The memory 602 of system and method described herein is intended to wrap
Include but be not limited to the memory of these and any other suitable type.
In addition, memory 602 stores following element, module either data structure or their subset are can perform, or
Their superset：Operating system 6021 and application program 6022.Wherein, operating system 6021, various system programs, example are included
Such as ccf layer, core library layer, driving layer, for realizing various basic businesses and the hardware based task of processing.It is being answered
With program 6022, comprising various application programs, such as media player (MediaPlayer), browser (Browser) etc., use
In realizing various applied business.Realize that the program of present invention method may be embodied in application program 6022.
In one embodiment, in addition to：By calling program or the instruction of the storage of memory 602, specifically, can answer
With the program or instruction stored in program 6022, processor 601 is used to receive the target start instruction that user sends, and starts institute
The taking module for stating mobile terminal shoots a target object, obtains the image of the target object；Identify the target object
Image, the characteristic information of described image is extracted, while produce the request signal of an information search；Respond asking for described information search
Signal is sought, according to the characteristic information of described image, the search search result associated with the characteristic information of described image；It is and aobvious
Show the associated search result searched.
The method that the embodiments of the present invention disclose can apply in processor 601, or be realized by processor 601.
Processor 601 is probably a kind of IC chip, has the disposal ability of signal.In implementation process, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 601 or the instruction of software form.With reference to the present invention
The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform completion, or use decoding processor
In hardware and software module combination perform completion.
Software module can be located at random access memory, flash memory, read-only storage, programmable read only memory or electrically erasable
Write in the ripe storage medium in this areas such as programmable storage, register.The storage medium is located in memory 602, processing
Device 601 reads the information in memory 602, with reference to the step of its hardware completion above method.
Mobile terminal 600 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
Repeat no more.
The embodiment of the present invention 7 provides a kind of computer-readable recording medium, is deposited on the computer-readable recording medium
Image identification search program is contained, described image identification search utility realizes any one of above-mentioned institute when being run by processor 601
The step of method stated.
Any combination of one or more computer-readable media can be used.Computer-readable medium can be calculated
Machine readable signal medium or computer-readable recording medium.Computer-readable recording medium for example can be --- but it is unlimited
In system, device or the device of --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or it is any more than combination.Calculate
The more specifically example (non exhaustive list) of machine readable storage medium storing program for executing includes：Electrical connection with one or more wires, just
Take formula computer disk, hard disk, random access memory (RAM), read-only storage (ROM), erasable type and may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only storage (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.
In this document, computer-readable recording medium can be it is any include or the tangible medium of storage program, the journey
Sequence can be commanded the either device use or in connection of execution system, device.Included on computer-readable medium
Program code can use any appropriate medium to transmit, including --- but being not limited to --- is wireless, electric wire, optical cable, RF etc., or
The above-mentioned any appropriate combination of person.
It can be write with one or more programming languages or its combination for performing the computer that operates of the present invention
Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++,
Also include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with
Fully perform, partly perform on the user computer on the user computer, the software kit independent as one performs, portion
Divide and partly perform or performed completely on remote computer or server on the remote computer on the user computer.
Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including LAN (LAN) or
Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as carried using Internet service
Pass through Internet connection for business).
In one embodiment, in addition to：The construction of embodiments of the present invention can also apply to mobile phone, intelligence electricity
Words, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet personal computer), PMP (portable multimedias
Player), the equipment such as guider.
The above described is only a preferred embodiment of the present invention, any formal limitation not is made to the present invention, though
So the present invention is disclosed above with preferred embodiment, but is not limited to the present invention, any to be familiar with this professional technology people
Member, without departing from the scope of the present invention, when the technology contents using the disclosure above make a little change or modification
For the equivalent embodiment of equivalent variations, as long as being the content without departing from technical solution of the present invention, the technical spirit according to the present invention
Any simple modification and the equivalent variations and modification made to above example, still fall within the scope of technical solution of the present invention
It is interior.
Claims (10)
1. a kind of image identification search method of mobile terminal, it is characterised in that comprise the following steps：
The target start instruction that user sends is received, the taking module for starting the mobile terminal shoots a target object, obtained
Take the image of the target object；
The image of the target object is identified, extracts the characteristic information of described image, while produces the request letter of an information search
Number；
The request signal of described information search is responded, according to the characteristic information of described image, search and the feature of described image are believed
The search result of manner of breathing association；And
Show the associated search result searched.
2. the image identification search method of mobile terminal according to claim 1, it is characterised in that the response described information
The request signal of search, according to the characteristic information of described image, the search search knot associated with the characteristic information of described image
Fruit, further include：
According to the characteristic information of described image, search for and read related to the characteristic information of described image from a search database
The search result of connection；Wherein, the search database purchase is in a memory cell；Or the search database purchase is in a net
In network server, communicated by network with the webserver to access the search database.
3. the image identification search method of mobile terminal according to claim 1, it is characterised in that further include：
The image of the target object of the taking module captured in real-time is obtained as adjustment detection image；
Local identification is carried out to the adjustment detection image, and guiding opinion is shot to user feedback according to local recognition result,
To instruct the user to optimize adjustment to the adjustment detection image；
When meeting that image selectes condition, the image of the taking module current shooting is obtained as search image；
Scanned for according to the search image, and the search result is supplied to the user.
4. the image identification search method of mobile terminal according to claim 3, it is characterised in that described to be examined to the adjustment
Altimetric image carries out local identification, and shoots guiding opinion to user feedback according to local recognition result, in addition to：
Substance feature identification or ambient parameter identification are carried out to the adjustment detection image；
According to substance feature recognition result or ambient parameter recognition result, to the shooting guiding opinion corresponding to user feedback.
5. the image identification search method of mobile terminal according to claim 3, it is characterised in that described according to the search
Image is scanned for, and the search result is supplied into the user, in addition to：
Obtain the target entity that the search image includes；
The interception topography corresponding with the target entity in the search image, and by the topography in search graph
As the first display location of display interface is shown；
Obtain network inquiry condition corresponding with the target entity；
Web search is carried out according to the network inquiry condition, and by search result the second of the search image display interfaces
Display location is shown.
A kind of 6. image identification search system of mobile terminal, it is characterised in that including：
Taking module, the target start instruction sent for receiving user, shoots a target object；
Acquisition module, obtain the image of the target object；
Picture recognition module, for identifying the image of the target object, the characteristic information of described image is extracted, while produce one
The request signal of information search；
Search module, for responding the request signal of described information search, according to the characteristic information of described image, search with it is described
The associated search result of the characteristic information of image；And
Display module, show the associated search result searched.
7. the image identification search system of mobile terminal according to claim 6, it is characterised in that further include：
Detection image acquisition module is adjusted, obtains the image of the target object of the taking module captured in real-time as adjustment
Detection image；
Shoot guiding opinion feedback module, carry out local identification to the adjustment detection image, and according to local recognition result to
User feedback shoots guiding opinion, to instruct the user to optimize adjustment to the adjustment detection image；
Image collection module is searched for, when meeting that image selectes condition, obtains the image conduct of the taking module current shooting
Search for image；
The display module, scanned for according to the search image, and the search result is supplied to the user.
8. the image identification search system of mobile terminal according to claim 7, it is characterised in that the shooting guiding opinion
Feedback module is specifically used for, and carries out substance feature identification to the adjustment detection image or ambient parameter identifies；It is special according to entity
Recognition result or ambient parameter recognition result are levied, to the shooting guiding opinion corresponding to user feedback.
A kind of 9. mobile terminal, it is characterised in that including：
At least one processor；
Memory；And
The image identification search program being stored on the memory, described image identification search utility are transported by the processor
Following operation is realized during row：
The target start instruction that user sends is received, the taking module for starting the mobile terminal shoots a target object, obtained
Take the image of the target object；
The image of the target object is identified, extracts the characteristic information of described image, while produces the request letter of an information search
Number；
The request signal of described information search is responded, according to the characteristic information of described image, search and the feature of described image are believed
The search result of manner of breathing association；And
Show the associated search result searched.
10. a kind of computer-readable recording medium, image identification search program is stored with the computer-readable recording medium,
The step of described image identification search utility realizes the method as any one of claim 1-5 when being run by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711072877.1A CN107798115A (en) | 2017-11-03 | 2017-11-03 | Image identification search method, system and the mobile terminal of mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711072877.1A CN107798115A (en) | 2017-11-03 | 2017-11-03 | Image identification search method, system and the mobile terminal of mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107798115A true CN107798115A (en) | 2018-03-13 |
Family
ID=61548990
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711072877.1A Pending CN107798115A (en) | 2017-11-03 | 2017-11-03 | Image identification search method, system and the mobile terminal of mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107798115A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108846621A (en) * | 2018-02-01 | 2018-11-20 | 贺桂和 | A kind of inventory management system based on policy module |
| CN109005286A (en) * | 2018-07-13 | 2018-12-14 | 维沃移动通信有限公司 | A kind of display control method and Folding screen terminal |
| CN109740011A (en) * | 2018-12-03 | 2019-05-10 | 珠海格力电器股份有限公司 | A kind of searching method, electronic equipment and computer readable storage medium |
| CN112052784A (en) * | 2020-09-02 | 2020-12-08 | 腾讯科技（深圳）有限公司 | Article searching method, device, equipment and computer readable storage medium |
| CN113496157A (en) * | 2020-03-20 | 2021-10-12 | 庄宿龙 | Type identification system using big data server |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102682091A (en) * | 2012-04-25 | 2012-09-19 | 腾讯科技（深圳）有限公司 | Cloud-service-based visual search method and cloud-service-based visual search system |
| CN103353875A (en) * | 2013-06-09 | 2013-10-16 | 华中科技大学 | Method and system for media interaction based on visible search |
| US20140064626A1 (en) * | 2012-08-30 | 2014-03-06 | Samsung Techwin Co., Ltd. | Adaptive image processing apparatus and method based in image pyramid |
| CN103955525A (en) * | 2014-05-09 | 2014-07-30 | 北京奇虎科技有限公司 | Method and client for searching answer to test question |
| CN106815237A (en) * | 2015-11-30 | 2017-06-09 | 北京睿创投资管理中心（有限合伙） | Searching method, searcher, user terminal and search server |
| CN107169148A (en) * | 2017-06-21 | 2017-09-15 | 北京百度网讯科技有限公司 | Image search method, device, equipment and storage medium |
-
2017
- 2017-11-03 CN CN201711072877.1A patent/CN107798115A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102682091A (en) * | 2012-04-25 | 2012-09-19 | 腾讯科技（深圳）有限公司 | Cloud-service-based visual search method and cloud-service-based visual search system |
| US20140064626A1 (en) * | 2012-08-30 | 2014-03-06 | Samsung Techwin Co., Ltd. | Adaptive image processing apparatus and method based in image pyramid |
| CN103353875A (en) * | 2013-06-09 | 2013-10-16 | 华中科技大学 | Method and system for media interaction based on visible search |
| CN103955525A (en) * | 2014-05-09 | 2014-07-30 | 北京奇虎科技有限公司 | Method and client for searching answer to test question |
| CN106815237A (en) * | 2015-11-30 | 2017-06-09 | 北京睿创投资管理中心（有限合伙） | Searching method, searcher, user terminal and search server |
| CN107169148A (en) * | 2017-06-21 | 2017-09-15 | 北京百度网讯科技有限公司 | Image search method, device, equipment and storage medium |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108846621A (en) * | 2018-02-01 | 2018-11-20 | 贺桂和 | A kind of inventory management system based on policy module |
| CN108846621B (en) * | 2018-02-01 | 2020-06-30 | 湖南人文科技学院 | Inventory management system based on strategy module |
| CN109005286A (en) * | 2018-07-13 | 2018-12-14 | 维沃移动通信有限公司 | A kind of display control method and Folding screen terminal |
| CN109005286B (en) * | 2018-07-13 | 2021-06-04 | 维沃移动通信有限公司 | Display control method and folding screen terminal |
| CN109740011A (en) * | 2018-12-03 | 2019-05-10 | 珠海格力电器股份有限公司 | A kind of searching method, electronic equipment and computer readable storage medium |
| CN113496157A (en) * | 2020-03-20 | 2021-10-12 | 庄宿龙 | Type identification system using big data server |
| CN112052784A (en) * | 2020-09-02 | 2020-12-08 | 腾讯科技（深圳）有限公司 | Article searching method, device, equipment and computer readable storage medium |
| CN112052784B (en) * | 2020-09-02 | 2024-04-19 | 腾讯科技（深圳）有限公司 | Method, device, equipment and computer readable storage medium for searching articles |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107798115A (en) | Image identification search method, system and the mobile terminal of mobile terminal | |
| US9367756B2 (en) | Selection of representative images | |
| WO2021135601A1 (en) | Auxiliary photographing method and apparatus, terminal device, and storage medium | |
| CN107169148B (en) | Image searching method, device, equipment and storage medium | |
| CN105518678B (en) | Searching method, searcher and user equipment | |
| CN107704525A (en) | Video searching method and device | |
| WO2022111072A1 (en) | Image photographing method and apparatus, and electronic device, server and storage medium | |
| CN111259148B (en) | Information processing method, device and storage medium | |
| CN107959883A (en) | Video editing method for pushing, system and intelligent mobile terminal | |
| CN104392338A (en) | Building fire protection check and acceptance system and method, check terminal and mobile acceptance terminal | |
| CN108174097B (en) | Picture shooting method and device, and picture shooting parameter providing method and device | |
| WO2021169720A1 (en) | Content operation method and device, terminal, and storage medium | |
| CN109101658A (en) | Information search method, device and equipment/terminal/server | |
| CN109727411B (en) | Book borrowing system based on face recognition, code scanning authentication and human body induction | |
| CN109389088B (en) | Video recognition method, device, machine equipment and computer readable storage medium | |
| US20230237825A1 (en) | Wine product positioning method, wine product information management method and apparatus, device, and storage medium | |
| CN112052784B (en) | Method, device, equipment and computer readable storage medium for searching articles | |
| CN105975554A (en) | Mobile terminal-based big data search method and apparatus | |
| WO2022062028A1 (en) | Wine label recognition method, wine information management method and apparatus, device, and storage medium | |
| CN112424792A (en) | Aesthetics-based portrait image assessment | |
| CN113869063A (en) | Data recommendation method and device, electronic equipment and storage medium | |
| WO2024012289A1 (en) | Video generation method and apparatus, electronic device and medium | |
| CN111586329A (en) | Information display method and device and electronic equipment | |
| WO2023184745A1 (en) | Data labeling method and apparatus, electronic device, and storage medium | |
| KR102502575B1 (en) | Apparatus, method and program for providing product trend prediction service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180313 |