CN107533566A - Method, portable electric appts and the graphic user interface retrieved to the content of picture - Google Patents

Method, portable electric appts and the graphic user interface retrieved to the content of picture Download PDF

Info

Publication number
CN107533566A
CN107533566A CN201680024911.5A CN201680024911A CN107533566A CN 107533566 A CN107533566 A CN 107533566A CN 201680024911 A CN201680024911 A CN 201680024911A CN 107533566 A CN107533566 A CN 107533566A
Authority
CN
China
Prior art keywords
picture
identification region
electronic device
portable electronic
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680024911.5A
Other languages
Chinese (zh)
Inventor
郜文美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN107533566A publication Critical patent/CN107533566A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Method, portable electric appts and the graphic user interface that a kind of content to picture is retrieved.This method includes：The first operation for acting on a picture is detected, the picture is shown on the screen of the portable electric appts (203)；In response to the described first operation, the first retrieval result using the entire content of the picture as retrieval key element is obtained, shows first retrieval result (204)；Detect the second operation (205) for acting on the picture；In response to the described second operation, it is determined that the identification region (206) that the picture is identified, the second retrieval result (207) with the content that the identification region overlaps as retrieval key element using the picture is obtained, shows second retrieval result (208).This method can simplify operating procedure of the user when the content to picture is retrieved.

Description

Method, portable electronic device and the graphic user interface that the content of picture is retrieved Technical field
The method and portable electronic device retrieved the present embodiments relate to the content of mobile communication technology more particularly to a kind of pair of picture.
Background technique
At present, many portable electronic devices (such as, mobile phone, tablet computer etc.) all there is the function of being identified to the specific content (such as personage, commodity, plant, bar code, two dimensional code, text) in picture, the content identified can also be retrieved, show search result.Specifically, in the prior art, the detailed process article in photo identified using portable electronic device are as follows: open camera -> enter option -> click and intelligently know object -> shooting photo -> finger and draw a circle and choose object -> click index button -> obtains search result.Prior art operation step is comparatively laborious, and from picture is obtained, to obtaining, the time that corresponding search result needs is longer, and real-time is poor, and user experience is bad.
Summary of the invention
Method, portable electronic device and the graphic user interface retrieved provided herein is the content of a kind of pair of picture improve user experience to simplify operating procedure.
In a first aspect, the method that the content for providing a kind of pair of picture is retrieved, the method is applied to portable electronic device, comprising: detects the first operation for acting on a picture, the picture is shown on the screen of the portable electronic device；In response to first operation, the first search result using the entire content of the picture as retrieval element is obtained, shows first search result；Detect the second operation for acting on the picture；In response to second operation, determine the identification region identified to the picture, obtain the second search result using the content that the picture is overlapped with the identification region as retrieval element, show second search result, wherein, the content that the picture is overlapped with the identification region is a part of the entire content of the picture, and first operation is different from second operation.
After portable electronic device detects first operation of the user to the picture shown on screen, it can obtain using the entire content of picture as the first search result of retrieval element and show the first search result, and detect that the second search result as the second search result for retrieving element and is shown the available partial content using the picture after the second of picture the operation by user, from this, portable electronic device may be implemented when different operations to the entire content of picture detecting or Local content executes retrieval automatically, object option is known with needing first to open intelligence in the prior art, obtain the photo comprising target object, then region of the selection comprising target object in photo, search result could be obtained and compare by finally clicking retrieval again, the operating procedure that user retrieves the content of picture is simplified, user experience is improved.
With reference to first aspect, in the first implementation of first aspect, after showing second search result, the method also includes: detect the third operation for acting on the picture, the third operation includes dragging, zooms in or out, and the third operation is different from first operation；It is operated in response to the third, obtains the third search result using the content that the picture is overlapped with the identification region as retrieval element, show third search result, wherein the identification region is the predeterminable area on the screen.
With reference to first aspect, in second of implementation of first aspect, after showing second search result, the method also includes: detect the 4th operation for acting on the identification frame being displayed on the screen, 4th operation includes dragging or movement, the identification frame is overlapped with the boundary line of the identification region, and the 4th operation is different from first operation；In response to the 4th operation, the 4th search result using the content that the picture is overlapped with the identification region as retrieval element is obtained, shows the 4th search result.
With reference to first aspect, in the third implementation of first aspect, determine the identification region identified to the picture, it include: using the content that predeterminable area is overlapped with the picture on the screen as the identification region identified to the picture, alternatively, the content that the identification frame being displayed on the screen is drawn a circle to approve on the picture is as the identification region identified to the picture.
With reference to first aspect, in the 4th kind of implementation of first aspect, in response to second operation, determine the identification region identified to the picture, it include: second operation including again by operation, the region for determining that the heavy closed curve by centered on the position operated on the screen surrounds is the identification region, and the size of the closed curve is pre-set.
With reference to first aspect, in the 5th kind of implementation of first aspect, in response to second operation, determine the identification region identified to the picture, it include: that second operation includes double-click or articulations digitorum manus knocking, the identification region is in the region that the determining closed curve centered on the touch point of the double-click or the articulations digitorum manus knocking surrounds, wherein the size of the closed curve is pre-set.
It should be understood that the articulations digitorum manus that above-mentioned articulations digitorum manus knocking can be user taps the screen of portable electronic device, the number of knocking, which can be, to be once also possible to repeatedly, to be set as needed.
With reference to first aspect, it in the 6th kind of implementation of first aspect, is operated in response to described second, Determine the identification region identified to the picture, it include: that second operation includes two finger expansions, it determines and refers to that initial touch point on the screen connects the region that the closed curve centered on being formed by the midpoint of line segment surrounds as the identification region by two, the size of the closed curve is pre-set.
With reference to first aspect; in the 7th kind of implementation of first aspect; in response to second operation; determine the identification region identified to the picture; include: that second operation includes delineation or slides, determines the region surrounded with the track of the delineation or the track of the sliding for the identification region.
When the second operation is delineation or slide, identification region can be determined according to the curvilinear path that delineation or slide generate on the screen, specifically, it can be user and the curvilinear path that perhaps delineation generates slided by the finger belly or articulations digitorum manus of finger on the screen to determine that identification region is also possible to user and by the finger belly or articulations digitorum manus of multiple fingers slide or draw a circle to approve on the screen the curvilinear path of generation determine identification region.In addition, the track of above-mentioned delineation and the track of sliding can be closed curve, it is also possible to the curve of non-close, the curve can be also possible to dotted line for solid line, the region that the closed curve for the composition that can be linked together when the track that delineation is perhaps slided is non-closed curve with the two endpoint line segments or curve of the non-close curve surrounds is above-mentioned identification region.Wherein, the finger belly of finger or articulations digitorum manus slide the finger belly that can be understood as finger on the screen or articulations digitorum manus is continuously slipping on the screen.The finger belly or articulations digitorum manus of finger draw a circle to approve the finger belly that can be understood as finger or articulations digitorum manus on the screen and draw a circle or draw on the screen other closed curves (or non-close curve).
With reference to first aspect, and any one of the first of first aspect into the 7th kind of implementation, in the 8th kind of implementation of first aspect, in response to second operation, before determining the identification region identified to the picture, the method also includes: determine that the picture is in magnifying state and the picture is in the duration of magnifying state more than first threshold.
The 8th kind of implementation with reference to first aspect, in the 9th kind of implementation of first aspect, the determination picture is in magnifying state, comprising: the ratio for determining the initial display size of the amplified size of the picture and the picture is more than second threshold.
Second aspect, provides a kind of portable electronic device, and the portable electronic device includes the unit for executing method provided by any possible implementation of above-mentioned first aspect or first aspect.
The third aspect, provides a kind of portable electronic device, and the portable electronic device includes: processor, detector, memory, bus system；The processor, the detector and the memory are connected by the system bus；The memory is used for one or more programs, one or more of programs include instruction, and described instruction makes the portable electronic device execute method provided by any possible implementation of first aspect or first aspect when being executed by the portable electronic device.
Fourth aspect, a kind of computer readable storage medium storing one or more programs is provided, when one or more of programs are executed by the portable electronic device, the portable electronic device executes method provided by any possible implementation of first aspect or first aspect.
5th aspect, provides the graphic user interface on a kind of portable electronic device, the portable electronic device includes display, memory, multiple application programs；With the one or more processors for executing the one or more programs being stored in the memory, the graphic user interface includes the user interface that the method according to provided by any possible implementation of first aspect or first aspect is shown, wherein, the display includes touch sensitive surface and display screen.
In some implementations, the entire content refers to that the full content for including in the picture either picture shows full content on the screen.
In some implementations, when operating the determining identification region according to second, the closed curve includes rectangular curve, circular curve and elliptic curve or other closed curves.
In some implementations, the identification region is the region that surrounds of closed curve for the default size for being preset in the screen predeterminated position, and the closed curve includes circular curve, rectangular curve, elliptic curve and other closed curves.
In some implementations, the closed curve shows curve on the screen.
In some implementations, the closed curve is the transparent curve not appeared on the screen.
In some implementations, the identification region is longitudinal intermediate strip region of the screen or the center boxed area of lateral intermediate strip region or screen entirety, wherein, the size of longitudinal intermediate strip region or lateral intermediate strip region and the center boxed area is pre-set.
In some implementations, after detecting the second operation, and before obtaining the second search result using the content that the picture is overlapped with the identification region as retrieval element according to the second operation, the method also includes: detect whether that there is also the other operations for acting on the picture, if not detecting other operations within a preset time, just to the content of identification region coincidence as the second search result for retrieving element；If detecting above-mentioned other operations within a preset time, so, in response to other operations, and respective handling is carried out to the picture according to other operations, picture is being carried out to detect whether that there is also another operations for acting on the picture in the preset time after respective handling, if not detecting another described operation within a preset time, so just to the content of identification region coincidence as the second search result for retrieving element, wherein, other operations include amplification, diminution, dragging or at least one on the move.
In some implementations, it is described first operation include click, long-pressing, double-click, again by, double-click, Articulations digitorum manus knocking, two refer to that extension, two refer to contraction, delineation and sliding.
In some implementations, second operation includes clicking, long-pressing, double-click, referring to that extension, two refer to by, double-clicks, articulations digitorum manus knocking, two again and shrink, delineation and slide.It is to be understood that the first operation is different from the second operation in the concrete realization.For example, the first operation is again by the second operation is delineation.
In some implementations, the third operation is the operation after the second operation, and the third operation and second operation are same or different.
In some implementations, the 4th operation is different with second operation, and described second acts on picture, and the 4th operation is for the identification frame on the screen.
In some implementations, when it is described operation be two fingers shrink when, determine by two refer on the screen initial touch point connection be formed by line segment centered on circle or rectangular area be the identification region.
In some implementations, the initial display size of the picture is the size that the picture is shown on the screen after the portable electronic device opens the picture.
In some implementations, before the operation for detecting the picture, the method also includes: search result is stored all effective objects or object progress automatic identification and retrieval, acquisition search result in the picture by the portable electronic device.
In some implementations, before the operation for detecting the picture, the method also includes: the portable electronic device in the picture all effective objects or object carry out automatic identification and retrieval, obtain search result to specifically include: the portable electronic device carries out retrieval to the entire content of the picture and obtains integral retrieval result, the portable electronic device carries out retrieval to each object in the picture and obtains the search result of each object, and the search result of integral retrieval result and each object is stored.
In some implementations, the image in the identification region is identified using at least one of following technology: being based on character recognition technology, bar code/two dimensional code identification technology, the human face detection tech, Articles detecting technology of optical character identification (Optical Character Recognition, abbreviation OCR).
In some implementations, it carries out retrieval to obtain search result including: to retrieve to obtain search result according to retrieval element inside the portable electronic device according to the retrieval element, or, retrieval element is issued to the server of network side, it is retrieved by the server and obtains search result, search result is sent to portable electronic device again by server, shows search result by portable electronic device.
In some implementations, the picture shown on formula electronic equipment screen of taking is the picture obtained from photograph album, webpage or application.
In some implementations, the portable electronic device includes mobile phone, removable computer, puts down Plate computer, personal digital assistant, media player, smart television.
Identification region is assured that after detecting operation and the image in identification region is identified, and then obtain search result, to simplify the operating procedure retrieved to the content of picture, furthermore, the image of different zones in picture can also be retrieved according to different realize of operation, improve user experience.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, attached drawing needed in the embodiment of the present invention will be briefly described below, apparently, drawings described below is only some embodiments of the present invention, for those of ordinary skill in the art, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.
Fig. 2 is the schematic diagram of the middle section in the method for the embodiment of the present invention retrieved to the content of picture.
Fig. 3 is the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.
Fig. 4 is the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.
Fig. 5 is the schematic diagram that the method for the embodiment of the present invention retrieved to the content of picture retrieves the content of picture.
Fig. 6 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Fig. 7 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Fig. 8 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Fig. 9 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 10 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 11 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 12 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 13 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 14 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 15 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 16 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 17 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 18 is the schematic diagram of the embodiment of the present invention retrieved to the content of picture.
Figure 19 is the schematic block diagram of the portable electronic device of the embodiment of the present invention.
Figure 20 is the schematic block diagram of the portable electronic device of the embodiment of the present invention.
Figure 21 is the schematic block diagram of the portable electronic device of the embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, every other embodiment obtained by those of ordinary skill in the art without making creative efforts, shall fall within the protection scope of the present invention.
The embodiment of the invention provides the methods that the content of a kind of pair of picture is retrieved, this method can realize the retrieval to content automatically, when user passes through portable electronic device browsing pictures (picture in photograph album or webpage), after portable electronic device detects first operation of the user to the picture shown on screen, the first search result using the entire content of picture as retrieval element can be obtained automatically, and show the first search result, and detect user to the second search result that can be obtained automatically after the second operation of picture using the partial content of the picture as retrieval element, and show the second search result, it allows users to retrieve the content in picture by simpler operation, and it can also be retrieved according to different zones of the different gestures to picture.The method of the embodiment of the present invention retrieved to the content of picture is described in detail combined with specific embodiments below.
Fig. 1 shows the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.This method can be executed by portable electronic device (for example, mobile phone, tablet computer etc.).Retrieved that detailed process is as follows to the content of picture:
101, portable electronic device shows picture.
102, portable electronic device is captured and is judged in real time to the operation of user.
It should be understood that portable electronic device here, which can be by showing the screen of picture, captures the operation of user, identification of the certain operations triggering of user to picture can be set, and other gestures of user will not can then trigger the identification to picture.Aforesaid operations can include but is not limited to double-click, long-pressing, amplification, again by, reduce, it is mobile, suspend, delineation, sliding, articulations digitorum manus knocking and articulations digitorum manus sliding delineation etc..It should be understood that long-pressing refers to that the compressing time of the finger of user on the screen is more than regular hour threshold value.
103, portable electronic device detects the first operation.
First operation includes clicking, long-pressing, double-click, referring to that extension, two refer to by, double-clicks, articulations digitorum manus knocking, two again and shrink, delineation and slide.
104, portable electronic device shows the first search result.
First search result is the search result obtained to the entire content of picture as retrieval element.
105, portable electronic device detects that the operation of user is the second operation.
Second operation includes clicking, long-pressing, double-click, referring to that extension, two refer to by, double-clicks, articulations digitorum manus knocking, two again and shrink, delineation and slide.It is to be understood that the first operation is different from the second operation in the concrete realization.For example, the first operation is again by the second operation is delineation.It may also movement or dragging picture etc. be operated when should be understood that user to after the second operation of picture progress.
106, portable electronic device determines the identification region identified to picture.
The image content of the covering of the identification region is a part of the entire content of above-mentioned picture, which can be the region that the closed curve for the default size for being preset in screen predeterminated position surrounds.Specifically, the identification region can be the middle section for being preset in screen, the size and concrete shape of the middle section can be it is pre-set, as shown in Fig. 2, the middle section can for the longitudinal intermediate strip region of screen, the lateral center boxed area of intermediate strip region or screen entirety.
107, obtaining with the content that above-mentioned picture is overlapped with the identification region is to retrieve the second search result of element.
108, the second search result is shown.Return step 102 continues circular treatment after showing the second search result.
Optionally, the recognizer to picture can be started after showing picture, as long as after next detecting user to the first operation of picture, it can show search result, simplify the step of retrieving to the content of picture, in the second operation for detecting user, the partial picture content of identification region covering is retrieved, and show search result.
Optionally, in order to enable existing operation can in conjunction with picture particular state (such as, magnifying state or deflated state) it is retrieved to trigger, content shown in FIG. 1 carries out knowledge method for distinguishing can also be between step 103 and step 104, or judge between step 105 and step 106 whether picture is in the state of zooming in or out, decide whether to retrieve the content of picture again according to the result of judgement.
Specifically, after detecting the first operation of user, judge whether picture is in the state of zooming in or out, if the picture that screen is shown is in and zooms in or out state, it is so carried out using the entire content of picture as retrieval element, obtain the first search result, if picture is in non-amplified or non-deflated state (it is considered that the picture opened in step 101 is in initial display state, if the picture currently shown is not scaled relative to the initial display state of picture, it is judged that current image is in non-zoom state), retrieval so is carried out with regard to the entire content for not executing to picture and obtains the first search result.
In addition, whether can also be in magnifying state after detecting the second operation of user to picture and judge, if picture is in magnifying state, and be more than time t in the picture in stable condition time0(time t0Size can preset, for example, t can be set0It is 0.5 second) 106 to 108 are executed afterwards, 106 to 108 are not executed if picture is not at magnifying state so.
It should be understood that, here magnifying state can refer to that picture is greater than 100% relative to the display scale of original state, after can also be picture amplification certain multiple is amplified to relative to original image just belongs to magnifying state, for example, just thinking that the picture is in magnifying state when picture is amplified to twice of original image (original image here may be considered the picture initially shown).
It can be seen that the method that the embodiment of the present invention retrieves the content of picture can judge after the first operation or the second operation of detection user whether picture is in the state of zooming in or out.
Fig. 3 shows the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.It is described in detail below with reference to the method to the content of picture retrieved of the Fig. 3 to the embodiment of the present invention.As shown in figure 3, step 201-205 (detailed content of step 201-205 can be found in the step 101-105 in Fig. 1) identical as the step 101-105 in method shown in FIG. 1, to avoid repeating, is not described in detail herein.Emphasis describes step 206 below.
206, the identification region identified to picture is determined according to the zone of action of the second operation；
The specific implementation of step 206 includes following several:
If the second operation of user is to double-click picture, then the circle drawn a circle to approve centered on double-clicking touch point, on original image or rectangular area are just determined as identification region, wherein the size of above-mentioned border circular areas or rectangular area is pre-set.
If the second operation of user is the expansion of two fingers, determine the region that surrounds of closed curve centered on the initial touch point connection for referring on the screen by two is formed by the midpoint of line segment for identification region.Specifically, circle centered on the midpoint of the line segment or rectangular area can be determined as identification region, specifically, the center line of the rectangular area can be overlapped with the line segment, the diameter of the border circular areas can be overlapped with the line segment or the length of the center line of the rectangular area can be greater than the line segment, and the diameter of the border circular areas can be greater than the length of the line segment, wherein, the size of above-mentioned border circular areas or rectangular area is pre-set.
When again the second operating gesture of user is to determine that the region surrounded by the closed curve centered on the position operated on the screen is identification region, wherein the size of the closed curve is pre-set by (firmly pressing) again.Specifically, can determine the circle using centered on the touch point of operating gesture perhaps rectangular area as identification region wherein the size of above-mentioned border circular areas or rectangular area is preparatory It is arranged.
After determining the identification region identified to picture by step 206, step 207 and 208 are continued to execute, obtains search result.Since step 207 to 208 and the step 107 in method shown in FIG. 1 are to 108 identical, all it is to obtain the second search result and show the second search result, therefore, in order to avoid repeating, step 207 and 208 is not described in detail here.
Optionally, in order to enable existing operation can be retrieved in conjunction with the particular state of picture to trigger, after step 203 detects the first operation of user, and before step 204 shows the first search result, the above method can also include: that portable electronic device judges whether picture is in the state of zooming in or out, if the picture that screen is shown is in and zooms in or out state, so just the first operation of response, using the entire content of picture as retrieval element, obtain the first search result, if picture, which is in non-amplified or non-deflated state, can so be not responding to the first operation, also retrieval is not carried out to the entire content of picture and obtains the first search result.
In addition, after step 205 detects the second operation of user, and before the identification region that step 206 determines that picture is identified, the above method can also include: to judge whether picture is in magnifying state, if picture is in magnifying state, and is more than time t in the picture in stable condition time0(time t0Size can preset, for example, t can be set0It is 0.5 second) step 206 is executed afterwards to 208.It should be understood that, here magnifying state can refer to that picture is greater than 100% relative to the display scale of original state, after can also be picture amplification certain multiple is amplified to relative to original image just belongs to magnifying state, for example, just thinking that the picture is in magnifying state when picture is amplified to twice of original image (original image here may be considered the picture initially shown).
That is the method that the embodiment of the present invention retrieves the content of picture can judge after the first operation or the second operation of detection user whether picture is in zoom state.
In embodiments of the present invention, the retrieval to the content of picture can be started after showing picture, as long as after next detecting user to the operating gesture of picture, it can show corresponding search result, simplify the step of retrieving to the content of picture, and allow users to be retrieved by content of the different gestures to different zones in picture (such as, the operating gesture for detecting user is " double-clicks ", the content in " two refer to expansion " or region when " firmly pressing " to user's touch-control is retrieved), improve user experience.
The content of picture is retrieved by Fig. 1 and Fig. 3 it is found that the identification frame for the method retrieved in the two embodiments to the content of picture is fixed.In fact, identification frame can also be mobile, and user can control the shifting of identification frame by a series of gesture when the content to picture identifies It is dynamic, when the content that identification frame is moved in the region that can be covered to identification frame where screen identifies.The identification transportable situation of frame is described in detail below with reference to Fig. 4.
Fig. 4 shows the flow chart for the method for the embodiment of the present invention retrieved to the content of picture.This method can be executed by above-mentioned portable electronic device.As shown in figure 4, step 301-302 is identical as the step 101-102 in method shown in FIG. 1, to avoid repeating, it is not described in detail herein.Emphasis describes the step different from method shown in FIG. 1 below.
303, portable electronic device detects that the operation of user is the second operation.This second operation include double-click, press, double-click again, articulations digitorum manus knocking, two refer to extension, two refer to shrink, delineation and sliding at least one of.
304, identification frame is generated in the zone of action of the second operation on the screen, the content which is drawn a circle to approve on picture is as the identification region identified to the picture.The identification frame is moveable, and concrete shape can be rectangle, circle, ellipse or other irregular figures.Identify that the screen area other than frame, identification frame can disappear automatically when the user clicks.
305, obtaining with the content that above-mentioned picture is overlapped with the identification region is to retrieve the second search result of element.
306, the second search result is shown.
307, detect that identification is frameed shift dynamic, continues to identify the content that the identification frame is drawn a circle to approve on picture.Specifically, if the second operation of user includes pressing again, identification frame can be dragged, dragging at this time can be to lift and pin identification frame after finger again and be dragged, and can not also lift finger, continue to pin identification frame being dragged.If the second operation of user just now is suspends, dragging at this time can be to continue with the movement for keeping suspension gesture and carrying out suspended pattern, to realize the dragging to identification frame；After being also possible to finger far from screen, then click screen pin identification frame dragged.
It should be understood that, in the embodiment shown in Fig. 1 to Fig. 4, the picture that portable electronic device is shown can be the picture that user opens from the photograph album in portable electronic device, it is also possible to the picture that shoots of camera that user starts portable electronic device or picture that when user browses webpage with portable electronic device obtains.In addition, portable electronic device can be first to all effective objects or object progress automatic identification and retrieval, acquisition search result in picture, and search result is stored before detecting to the operation of picture.More specifically, portable electronic device carries out retrieval to the entire content of picture and obtains integral retrieval result, and the search result that retrieval obtains each object is carried out to each object in picture, then the search result of integral retrieval result and each object is stored.With search result that quick calling has stored and search result can be shown when detecting the operation to picture in this way.In addition, portable electronic device can be inside portable electronic device according to retrieval element retrieval Obtain search result, alternatively, retrieval element is issued the server of network side by portable electronic device, is retrieved by the server and obtain search result, search result is sent to portable electronic device again by server, shows search result by portable electronic device.
In addition, obtaining the first search result in the embodiment of Fig. 1 to Fig. 4 or the second search result can be using bar code/two dimensional code identification technology, human face detection tech and Articles detecting technology etc..Specifically, obtaining search result can be using face retrieval and the technologies such as identification, item retrieval and identification, odd numbers retrieval, goods number retrieval.After obtaining the first search result or the second search result, first search result or the second search result can be shown on white space or screen on picture or around picture, search result can be specifically that perhaps link icon user can obtain more detailed information by clickthrough or link icon for a link.
Fig. 1 to Fig. 4 is combined above, describe in detail the whole flow process for the method that the content according to an embodiment of the present invention to picture is retrieved, below in conjunction with Fig. 5 to Figure 12, it is described in detail in conjunction with the method to the content of picture retrieved of the gesture specifically operated to the embodiment of the present invention.
Initial display interface after portable electronic device opening picture is as shown in Figure 5, in Fig. 5, picture is located at the centre of portable electronic device screen, there are three object (being three objects represented in picture with round, pentagon and triangle here) in picture, if it is desired to if the content in picture is retrieved in realization, picture can so be operated on the interface of display, to realize the retrieval to the content in picture.
As shown in Figure 6, when portable electronic device detects the first operation for acting on picture, such as first operation be to click, so portable electronic device will obtain the first search result using the entire content of the picture as retrieval element, that is retrieval element be Fig. 6 in three objects, and by the first search result be displayed on the screen or picture on or picture around.
As shown in Figure 7, when portable electronic device detects the second operation for acting on picture, such as, second operation is to double-click, portable electronic device just will acquire the second search result using the content that the picture is overlapped with the predeterminable area of center Screen as retrieval element, i.e. retrieval element be pentagon object, and by the second search result be displayed on the screen or picture on or pentagon object around.In addition, it can also be as shown in Figure 8, portable electronic device detects the third operation for acting on picture, such as, third operation is mobile picture, so that different objects is in the predeterminable area in center of screen, portable electronic device in this way will obtain the search result to the new object for being moved to the predeterminable area automatically, and the search result that will acquire be displayed on the screen or picture on or new near vicinity (being retrieved to the circular object being moved in preparatory region in Fig. 8).
As shown in Figure 9, when portable electronic device detects that act on picture second operates, whens second operation is the extension of two fingers or two finger contractions etc., portable electronic device forms circular identification region by diameter of the line of two contacts automatically, and the content in the identification region is retrieved, the search result that will acquire be displayed on the screen or picture on or target object near.
As shown in Figure 10, portable electronic device can also generate a transportable identification frame, user can retrieve the different objects in picture by mobile identification frame realization, as shown in Figure 10, after portable electronic device detects the second operation of user, can the zone of action on the screen generate identification frame, the content that the identification frame is drawn a circle to approve on the picture is as the identification region identified to the picture, identification frame in Figure 10 is a rectangle frame, user can downwards or the identification frame that moves right is to move identification region, to the different objects in retrieving image.
When the second operation of user is draws a circle to approve or slides, identification region can be determined according to the curvilinear path that delineation or slide generate on the screen, specifically, user can determine identification region in the sliding curvilinear path that perhaps delineation generates by a finger to determine identification region user or by multiple fingers slide or draw a circle to approve on the screen the curvilinear path of generation.The track of above-mentioned delineation or sliding is identification region, specifically, as shown in figure 11, user is marking a closed curve by sliding or delineation operation on the screen, then the region that the closed curve surrounds a pentagon object among comprising picture is exactly identification region.It should be understood that, as shown in figure 12, user can also determine identification region by sliding or drawing a circle to approve the curve of operation standardized non-close on the screen, when user draw be non-closed curve when, two endpoints of the non-close curve can be linked together and constitute a closed curve, above-mentioned identification region is in the region surrounded with the closed curve.It will also be understood that, the track drawn a circle to approve or slided in Figure 11 and 12 is either dotted line is also possible to solid line, either transparent curve (will not show the track of sliding or delineation at this time on screen, but still identification region can be determined according to the track of sliding), or can also be other types of curve.
For the retrieval effectiveness for the method for the vivider more intuitive display embodiment of the present invention retrieved to the content of picture, the method for the embodiment of the present invention retrieved to the content of picture is described in detail below with reference to specific recognition result of the Figure 13 into Figure 18.
As shown in figure 13, user is after the picture (at this time it is considered that the picture does not zoom in and out processing also) for opening portable electronic device storage, portable electronic device detects the first operation of user, at this moment portable electronic device is retrieved the entire content of the picture as retrieval element, and search result " NBA all-star battle array " is shown on the picture.After carrying out integral retrieval, if user wants to further appreciate that each personage in the picture as shown in figure 14, when user using second operate come After operating the picture, portable electronic device automatically retrieves the image in the central area of the screen, and search result " Ao Ni'er " is shown on picture.If user also wants to further appreciate that other personages in the picture, so the picture can be operated using the thirds operation such as mobile, as shown in figure 15, after user moves right the picture, portable electronic device automatically retrieves the content of the central area of the screen, and search result " Duncan " is shown on picture.From the retrieving of Figure 13 to Figure 15, user wants only to need to carry out picture the first operation when retrieving the entire content of picture, when wanting to the part of picture when retrieving, the second operation can be carried out to the picture, at this moment portable electronic device can automatically retrieve the content under middle section, and it will show search result, if user retrieves with respect to other contents in picture, the content of desired retrieval can be moved to the middle section of screen by mobile picture, facilitate the operation of user.
As shown in figure 16, user is after the picture for opening portable electronic device storage, and user carries out the first operation to the picture, and portable electronic device retrieves the entire content of the picture, and search result " in riotous profusion dessert " is shown on the picture.If user wants to further appreciate that each object in the picture, so user can double-click the picture, as shown in figure 17, the region that user double-clicks is the object in the upper left corner, following portable electronic device obtains the object search result in the upper left corner, and search result " fruit mousse cup " is shown near object.As shown in figure 18, user continues to double-click the picture, and the region that at this moment user double-clicks is the object in the lower right corner, and at this moment portable electronic device obtains the object search result in the lower right corner, and search result " strawberry cake " is shown near object.By Figure 16 to Figure 18 it is found where the touch area that acts on of the operating gesture of user can carry out automatically retrieval to the content in the region, and by search result be displayed on the screen or the image on or the image near, facilitate the operation of user.
It should be understood that, in the method for the embodiment of the present invention retrieved to the content of picture, portable electronic device can before detecting to the operation of picture, in advance in picture all effective objects or object carry out automatic identification and retrieval, search result is obtained, and search result is stored.Furthermore, portable electronic device can also the entire content to picture carry out retrieval obtain integral retrieval result, and retrieval is carried out to each object in picture and obtains the search result of each object, and the search result of integral retrieval result and each object is stored.In this way can be with the search result of storage before quick calling after portable electronic device detects the operation of user, and search result is shown.
Fig. 1 to Figure 18 is combined above, is described in detail the method that the content according to an embodiment of the present invention to picture is retrieved, below in conjunction with Figure 19 to Figure 21, is described the device of the embodiment of the present invention retrieved to the content of picture.It should be understood that being retrieved to the content of picture of describing of Figure 19 to Figure 21 Device can be realized each step of the method retrieved described in Fig. 1 to Figure 18 to the content of picture, for sake of simplicity, suitably omitting repetitive description.
Figure 19 shows the schematic block diagram for the device of the embodiment of the present invention retrieved to the content of picture.The portable electronic device 400 includes:
Detection unit 410, for detecting the first operation for acting on a picture, the picture is shown on the screen of the portable electronic device；
Processing unit 420 obtains the first search result using the entire content of the picture as retrieval element, shows first search result for responding first operation；
The detection unit 410 is also used to detect the second operation for acting on the picture；
The processing unit 420 is also used to respond second operation, determine the identification region identified to the picture, obtain the second search result using the content that the picture is overlapped with the identification region as retrieval element, show second search result, wherein, the content that the picture is overlapped with the identification region is a part of the entire content of the picture, and first operation is different from second operation.
Portable electronic device may be implemented to identify the wholly or partially content of picture when different operations detecting, object option is known with needing first to open intelligence in the prior art, obtain the photo comprising target object, then identification region of the selection comprising target object in photo, search result could be obtained and compare by finally clicking retrieval again, simplify the operating procedure that user retrieves the content of picture.
Optionally, as one embodiment, the detection unit 410 is also used to detect the third operation for acting on the picture, and the third operation includes dragging, zooms in or out, and the third operation is different from first operation；The processing unit 420 is also used to respond the third operation, obtains the third search result using the content that the picture is overlapped with the identification region as retrieval element, shows third search result, wherein the identification region is the predeterminable area on the screen.
Optionally, as one embodiment, the detection unit 410 is also used to detect the 4th operation for identifying frame for acting on and being displayed on the screen, and the 4th operation includes dragging or movement, the identification frame is overlapped with the boundary line of the identification region, and the 4th operation is different from first operation；The processing unit 420 is also used to respond the 4th operation, obtains the 4th search result using the content that the picture is overlapped with the identification region as retrieval element, shows the 4th search result.
Optionally, as one embodiment, the processing unit 420 is specifically used for: response second operation, using the content that predeterminable area is overlapped with the picture on the screen as the identification region identified to the picture, alternatively, in the identification frame being displayed on the screen draws a circle to approve on the picture Hold as the identification region identified to the picture.
Optionally, as one embodiment, second operation includes again by operation, and the processing unit 420 is specifically used for: the region for determining that the heavy closed curve by centered on the position operated on the screen surrounds is the identification region, and the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes double-click or articulations digitorum manus knocking, the processing unit 420 is specifically used for: determining that the region that the closed curve centered on the touch point of the double click operation or the articulations digitorum manus knocking surrounds is the identification region, wherein, the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes two finger expansions, the processing unit 420 is specifically used for: determining and refers to that initial touch point on the screen connects the region that the closed curve centered on being formed by the midpoint of line segment surrounds as the identification region by two, the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes that delineation or sliding, the processing unit are specifically used for: determining the region surrounded with the track of the delineation or the track of the sliding for the identification region.
Optionally, as one embodiment, the portable electronic device further include: determination unit 430, before operating in response to described second for the processing unit and determine the identification region identified to the picture, determine that the picture is in magnifying state and the picture is in the duration of magnifying state more than first threshold.
Figure 20 shows the schematic block diagram for the device of the embodiment of the present invention retrieved to the content of picture.The portable electronic device 500 includes:
Processor 510, detector 520, memory 530, bus system 540；
The processor 510, the memory 530 and 520 devices of the detection are connected by the bus；
The memory 530 includes instruction for storing one or more programs, one or more of programs；
When described instruction is executed by the portable electronic device, the detector 520 is used to detect the act on a picture first operation, wherein the picture is shown on the screen of the portable electronic device；The processor 510 obtains the first search result using the entire content of the picture as retrieval element, shows first search result for responding first operation；
The detector 520 is also used to detect the second operation for acting on the picture；
The processor 510 is also used to respond second operation, determine the identification region identified to the picture, obtain the second search result using the content that the picture is overlapped with the identification region as retrieval element, show second search result, wherein, the content that the picture is overlapped with the identification region is a part of the entire content of the picture, and first operation is different from second operation.
In embodiments of the present invention, after the detector 520 of portable electronic device detects first operation of the user to the picture shown on screen, directly can retrieve and come out what is retrieved as the result is shown by entire content of the processor 510 to picture, and detector 520 detects user to can be retrieved by partial content of the processor 510 to picture and be come out what is retrieved as the result is shown after the second of picture the operation, in view of this, portable electronic device may be implemented to retrieve the wholly or partially content of picture when different operations detecting, object option is known with needing first to open intelligence in the prior art, obtain the photo comprising target object, then identification region of the selection comprising target object in photo, search result could be obtained and compare by finally clicking retrieval again, simplify user couple The operating procedure that the content of picture is retrieved, and allow users to identify by image of the different gestures to different zones in picture, retrieval effectiveness is enhanced, user experience is improved.
Optionally, as one embodiment, the detector 520 is also used to detect the third operation for acting on the picture, and the third operation includes dragging, zooms in or out, and the third operation is different from first operation；The processor 510 is also used to respond the third operation, obtains the third search result using the content that the picture is overlapped with the identification region as retrieval element, shows third search result, wherein the identification region is the predeterminable area on the screen.
Optionally, as one embodiment, the detector 520 is also used to detect the 4th operation for identifying frame for acting on and being displayed on the screen, and the 4th operation includes dragging or movement, the identification frame is overlapped with the boundary line of the identification region, and the 4th operation is different from first operation；The processor 510 is also used to respond the 4th operation, obtains the 4th search result using the content that the picture is overlapped with the identification region as retrieval element, shows the 4th search result.
Optionally, as one embodiment, the processor 510 is specifically used for: response second operation, using the content that predeterminable area is overlapped with the picture on the screen as the identification region identified to the picture, alternatively, the content that the identification frame being displayed on the screen is drawn a circle to approve on the picture is as the identification region identified to the picture.
Optionally, as one embodiment, second operation includes again by operation, and the processor 510 is specifically used for: the region for determining that the heavy closed curve by centered on the position operated on the screen surrounds is the identification region, and the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes double-click or articulations digitorum manus knocking, the processor 510 is specifically used for: the identification region is in the region that the determining closed curve centered on the touch point of the double-click or the articulations digitorum manus knocking surrounds, wherein, the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes two finger expansions, the processor 510 is specifically used for: determining and refers to that initial touch point on the screen connects the region that the closed curve centered on being formed by the midpoint of line segment surrounds as the identification region by two, the size of the closed curve is pre-set.
Optionally, as one embodiment, second operation includes that delineation or sliding, the processor 510 are specifically used for: determining the region surrounded with the track of the delineation or the track of the sliding for the identification region.
Optionally, as one embodiment, the processor 510 is specifically used for: before operating in response to described second and determine the identification region identified to the picture, determining that the picture is in magnifying state and the picture is in the duration of magnifying state more than first threshold.
The invention also includes a kind of computer readable storage mediums for storing one or more programs, when one or more of programs are executed by the portable electronic device, the portable electronic device can execute the method retrieved as shown in Fig. 1 to Figure 18 to the content of picture.
The invention also includes the graphic user interface on a kind of portable electronic device, the portable electronic device includes display, memory, multiple application programs；With the one or more processors for executing the one or more programs being stored in the memory, the graphic user interface includes the user interface shown according to the method retrieved as shown in Fig. 1 to Figure 18 to the content of picture, wherein, the display includes touch sensitive surface and display screen.
It is introduced below with reference to specific structure of the Figure 21 to the portable electronic device of the embodiment of the present invention, the case where should be understood that one of portable electronic device of the structure knowledge embodiment of the present invention shown in Figure 21 most specifically, will not cause to limit to the portable electronic device of the embodiment of the present invention.
Figure 21 shows the schematic block diagram for the portable electronic device of the embodiment of the present invention retrieved to the content of picture.The device contains the modules for executing the method for the embodiment of the present invention retrieved to the content of picture, and above-mentioned portable electronic device is described in detail below with reference to Figure 21.As shown in figure 21, which includes processor unit, input unit, storage unit, communication unit, Peripheral Interface, output unit and power supply.These units or component are communicated by one or more bus.It should be understood that portable electronic device shown in Figure 21 be it is a kind of most specifically Situation, it will not constitute the portable electronic device of the embodiment of the present invention and limit, it is also possible to hub-and-spoke configuration either busbar network, can also include perhaps combining certain components or different component layouts than illustrating more or fewer components.The portable electronic device of the embodiment of the present invention can be any movement or portable electronic device, including but not limited to mobile phone, removable computer, tablet computer, personal digital assistant (Personal Digital Assistant, abbreviation PDA), media player, the combination of smart television and above-mentioned two or two or more etc..The modules or unit of the portable electronic device of the embodiment of the present invention are described in detail below.
Input unit, input unit is for realizing the interaction of user and electronic equipment and/or information input into electronic equipment.For example, input unit can receive the number or character information of user's input, to generate signal input related with user setting or function control.In the specific embodiment of the invention, input unit can be touch panel, be also possible to other human-computer interaction interfaces, such as entity enter key, microphone etc., can also be other external information capture devices, such as camera etc..Touch panel, also referred to as touch screen or touch screen, collectable user touches on it or close operational motion.For example user drives corresponding attachment device using the operational motion of the positions of any suitable object or attachment on touch panel or close to touch panel such as finger, stylus, and according to preset formula.Optionally, touch panel may include both touch detecting apparatus and touch controller.Wherein, the touch operation of touch detecting apparatus detection user, and the touch operation that will test is converted to electric signal, and sends the electric signal to touch controller；Touch controller receives the electric signal from touch detecting apparatus, and is converted into contact coordinate, then gives processing unit.The touch controller can also receive the order that processing unit is sent and execution.Furthermore, it is possible to realize touch panel using multiple types such as resistance-type, condenser type, condenser type+pressure inductive, infrared ray (Infrared) and surface acoustic waves.In other embodiments of the invention, entity enter key used by input unit can include but is not limited to one of physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. or a variety of.The input unit of microphone form can collect the voice of user or environment input and order that convert thereof into electrical signal form, that processing unit is executable.
Specifically, the input unit of the portable electronic device of the embodiment of the present invention can be various kinds of sensors part, such as hall device, it can be used for detecting the physical quantity of electronic equipment, such as power, torque, pressure, stress, position, displacement, speed, acceleration, angle, angular speed, revolution, revolving speed and working condition changed time etc., it is transformed into electricity to be detected and controlled.Other some senser elements can also include that gravity-feed tank is accrued, triaxial accelerometer, gyroscope, electronic compass, ambient light sensor, proximity sensor, temperature sensor, humidity sensor, pressure (air pressure) sensor, piezoelectricity Sensor, heart rate sensor, Fingerprint Identification Unit etc..
Processor unit, it is the control centre of portable electronic device, it can use the various pieces of various interfaces and the entire portable electronic device of connection, by running or executing the software program and/or module that are stored in storage unit, and the data being stored in storage unit are called, to execute the various functions and/or processing data of electronic equipment.The processor unit can be made of integrated circuit (Integrated Circuit, abbreviation IC), such as the IC that can be encapsulated by single is formed, and can also be made of the encapsulation IC of more identical functions of connection or different function.For example, processor unit can only include central processing unit (Central Processing Unit, abbreviation CPU), it is also possible to the combination of GPU, digital signal processor (Digital Signal Processor, abbreviation DSP) and the control chip (such as baseband chip) in communication unit.In embodiments of the present invention, CPU can be single operation core, also may include multioperation core.
Communication unit makes portable electronic device carry out voice communication, text communication, data communication by the communication channel and remote electronics or server for establishing communication channel.Above-mentioned communication unit may include WLAN (Wireless Local Area Network, abbreviation WLAN) module, bluetooth module, the communication modules such as base band (Base Band) module, and corresponding radio frequency (the Radio Frequency of the communication module, abbreviation RF) circuit, for carrying out WLAN communication, Bluetooth communication, infrared communication and/or cellular communications system communication, such as wideband code division multiple accesses (Wideband Code Division Multiple Access, abbreviation WCDMA) and/or high-speed downstream packet access (High Speed Downlink Packet Acces S, abbreviation HSDPA).Communication of the communication module for each component in controlling electronic devices, and can support direct memory access (Direct Memory Access).
Specifically, various communication modules in the communication unit of the portable electronic device of the embodiment of the present invention can occur in the form of IC chip (Integrated Circuit Chip), and the property of can be chosen combines, without including all communication modules and corresponding antenna sets.For example, above-mentioned communication unit can only include baseband chip, radio frequency chip and corresponding antenna to provide communication function in a cellular communication system.The wireless communication connection established via the communication unit, such as WLAN access or WCDMA access, above-mentioned portable electronic device can connect to Cellular Networks (Cellular Network) or internet (Internet).Above-mentioned radio frequency chip can form radio circuit, which can be used for sending and receiving signal in information transmit-receive or communication process.For example, giving processing unit processes after radio circuit can will receive the downlink information of base station；In addition, the data for designing uplink are sent to base station.In general, the radio circuit includes the known circuits for executing these functions, including but not limited to antenna System, radio frequency transceiver, one or more amplifiers, tuner, one or more oscillators, digital signal processor, encoding and decoding (Codec) chipset, subscriber identity module (SIM) card, memory etc..In addition, radio circuit can also be communicated with network and other equipment by wireless communication.Any communication standard or agreement, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution), emai can be used in the wireless communication L (electronic mail), SMS (Short Messaging Service) etc..
Output unit, the output unit are not limited to image output unit and voice output unit.Image output unit is used for output character, picture and/or video.The image output unit may include display panel, the display panel configured for example, by using forms such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), FED (field emission display).Or the image output unit may include reflected displaying device, such as electrophoresis-type (electrophoretic) display, or the display using interference of light modulation tech (Interferometric Modulation of Light).The image output unit may include individual monitor or various sizes of multiple displays.In a specific embodiment of the invention, touch panel used by above-mentioned input unit also can be simultaneously as the display panel of output unit.For example, sending processing unit to after touch panel detects touch or close gesture operation on it to determine the type of touch event, unit is followed by subsequent processing according to the type of touch event, corresponding visual output is provided on a display panel.Although in Figure 21, input unit and output unit are to output and input function as two independent components come realize electronic equipment, but it is in some embodiments it is possible to touch panel and display panel is integrated and that realizes electronic equipment output and input function.Such as, the image output unit can show various Graphic User Interfaces (Graphical User Interface, abbreviation GUI) using as virtual controlling component, including but not limited to window, scroll bar, icon and scrapbook, so that user is operated by touch control manner.
Storage unit, the storage unit can be used for storing software program and module, and processing unit is stored in the software program and module of storage unit by operation, thereby executing the various function application and realization data processing of electronic equipment.Storage unit mainly includes program storage area and data storage area, wherein program storage area can application program, such as sound playing program, image playing program needed for storage program area, at least one function etc.；Data storage area, which can be stored, uses created data (such as audio data, phone directory etc.) etc. according to electronic equipment.In the specific embodiment of the invention, storage unit may include volatile memory, such as non-volatile dynamic random access memory (Nonvolatile Random Access Memory, abbreviation NVRAM), phase change random access memory (Phase Change RAM, abbreviation PRAM), magnetic-resistance random access memory (Magetoresistive RAM, abbreviation MRAM) etc., it can also include nonvolatile memory, a for example, at least disk memory, Electrical Erasable programmable read only memory (Electrically Erasable Programmable Read-Only Memory, abbreviation EEPROM), flush memory device, such as anti-or flash memory (NOR flash memory) or anti-and flash memory (NAND flash mem Ory).Nonvolatile storage stores operating system and application program performed by processing unit.The processing unit is stored in mass storage from the nonvolatile storage load operating program and data to memory and by digital content.The operating system includes such as memory management, storage equipment control, power management etc. for controlling and manage general system tasks, and facilitates the various assemblies communicated between various software and hardwares and/or driver.In embodiments of the present invention, the operating system can be the android system of Google company, Windows system/Windows Phone system etc. of the iOS system of Apple company exploitation or Microsoft Corporation exploitation or this kind of embedded OS of Vxworks.
Power supply is powered for the different components to portable electronic device to maintain its operation.Understand as generality, the power supply can be built-in battery, such as common lithium ion battery, nickel-metal hydride battery etc., also include directly to external power supply of power electronic equipment, such as AC adapter etc..In certain embodiments of the present invention, the power supply can also be made more widely to define, it such as can also include power-supply management system, charging system, power failure detection circuit, power adapter or inverter, power supply status indicator (such as light emitting diode), and generated with the electric energy of electronic equipment, manage and be distributed other associated any components.
It should be understood that the terms "and/or", only a kind of incidence relation for describing affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, character "/" herein, typicallys represent the relationship that forward-backward correlation object is a kind of "or".
It should be understood that, in various embodiments of the present invention, magnitude of the sequence numbers of the above procedures are not meant that the order of the execution order, and the execution sequence of each process should be determined by its function and internal logic, and the implementation process of the embodiments of the invention shall not be constituted with any limitation.
Those of ordinary skill in the art may be aware that unit described in conjunction with the examples disclosed in the embodiments of the present disclosure and algorithm steps, can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Professional technician can use not Tongfang to each specific application Method realizes described function, but such implementation should not be considered as beyond the scope of the present invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, system, the specific work process of device and unit of foregoing description can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods may be implemented in other ways.Such as, the apparatus embodiments described above are merely exemplary, such as, the division of the unit, only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, and component shown as a unit may or may not be physical unit, it can and it is in one place, or may be distributed over multiple network units.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, the functional units in various embodiments of the present invention may be integrated into one processing unit, it is also possible to each unit and physically exists alone, can also be integrated in one unit with two or more units.
If the function is realized in the form of SFU software functional unit and when sold or used as an independent product, can store in a computer readable storage medium.Based on this understanding, substantially the part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products technical solution of the present invention in other words, the computer software product is stored in a storage medium, it uses including some instructions so that a computer equipment (can be personal computer, server or the network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), the various media that can store program code such as magnetic or disk.
It is described above; only a specific embodiment of the invention, but scope of protection of the present invention is not limited thereto, and anyone skilled in the art is in the technical scope disclosed by the present invention; it can easily think of the change or the replacement, should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (22)

  1. The method that the content of a kind of pair of picture is retrieved, the method are applied to portable electronic device characterized by comprising
    Detect the first operation for acting on a picture, the picture is shown on the screen of the portable electronic device；
    In response to first operation, the first search result using the entire content of the picture as retrieval element is obtained, shows first search result；
    Detect the second operation for acting on the picture；
    In response to second operation, determine the identification region identified to the picture, obtain the second search result using the content that the picture is overlapped with the identification region as retrieval element, show second search result, wherein, the content that the picture is overlapped with the identification region is a part of the entire content of the picture, and first operation is different from second operation.
  2. The method as described in claim 1, which is characterized in that after showing second search result, the method also includes:
    Detect that the third operation for acting on the picture, the third operation include dragging, zoom in or out, the third operation is different from first operation；
    It is operated in response to the third, obtains the third search result using the content that the picture is overlapped with the identification region as retrieval element, show third search result, wherein the identification region is the predeterminable area on the screen.
  3. The method as described in claim 1, which is characterized in that after showing second search result, the method also includes:
    Detect that the 4th operation for identifying frame for acting on and being displayed on the screen, the 4th operation include that dragging or movement, the identification frame are overlapped with the boundary line of the identification region, the 4th operation is different from first operation；
    In response to the 4th operation, the 4th search result using the content that the picture is overlapped with the identification region as retrieval element is obtained, shows the 4th search result.
  4. The method as described in claim 1, which is characterized in that in response to second operation, determine the identification region identified to the picture, comprising:
    Using the content that predeterminable area is overlapped with the picture on the screen as the identification region identified to the picture, alternatively,
    Identification frame is generated in the zone of action of second operation on the screen, the identification frame is existed The content drawn a circle to approve on the picture is as the identification region identified to the picture, wherein the identification frame is moveable.
  5. The method as described in claim 1, which is characterized in that in response to second operation, determine the identification region identified to the picture, comprising:
    Second operation includes pressing again, determines that the region that the heavy closed curve by centered on position on the screen surrounds is the identification region, the size of the closed curve is pre-set.
  6. The method as described in claim 1, which is characterized in that in response to second operation, determine the identification region identified to the picture, comprising:
    Second operation includes double-click or articulations digitorum manus knocking, and the identification region is in the region that the determining closed curve centered on the touch point of the double-click or the articulations digitorum manus knocking surrounds, wherein the size of the closed curve is pre-set.
  7. The method as described in claim 1, which is characterized in that determine the identification region identified to the picture in response to second operation in response to second operation, comprising:
    Second operation includes two finger expansions, determines and refers to that initial touch point on the screen connects the region that the closed curve centered on being formed by the midpoint of line segment surrounds as the identification region by two, the size of the closed curve is pre-set.
  8. The method as described in claim 1, which is characterized in that in response to second operation, determine the identification region identified to the picture, comprising:
    Second operation includes delineation or sliding, determines the region surrounded with the track of the delineation or the track of the sliding for the identification region.
  9. Such as method of any of claims 1-8, which is characterized in that it is operated in response to described second, before determining the identification region identified to the picture, the method also includes:
    Determine that the picture is in magnifying state and the picture is in the duration of magnifying state more than first threshold.
  10. Method as claimed in claim 9, which is characterized in that the determination picture is in magnifying state, comprising:
    The ratio for determining the initial display size of the amplified size of the picture and the picture is more than second threshold.
  11. A kind of portable electronic device characterized by comprising
    Detection unit, for detecting the first operation for acting on a picture, the picture is shown on the screen of the portable electronic device；
    Processing unit obtains the first search result using the entire content of the picture as retrieval element, shows first search result for responding first operation；
    The detection unit is also used to detect the second operation for acting on the picture；
    The processing unit is also used to respond second operation, determine the identification region identified to the picture, obtain the second search result using the content that the picture is overlapped with the identification region as retrieval element, show second search result, wherein, the content that the picture is overlapped with the identification region is a part of the entire content of the picture, and first operation is different from second operation.
  12. Portable electronic device as claimed in claim 11, which is characterized in that the detection unit is also used to detect the third operation for acting on the picture, and the third operation includes dragging, zooms in or out, and the third operation is different from first operation；
    The processing unit is also used to respond the third operation, obtains the third search result using the content that the picture is overlapped with the identification region as retrieval element, shows third search result, wherein the identification region is the predeterminable area on the screen.
  13. Portable electronic device as claimed in claim 11, it is characterized in that, the detection unit is also used to detect the 4th operation for acting on the identification frame being displayed on the screen, 4th operation includes dragging or movement, the identification frame is overlapped with the boundary line of the identification region, and the 4th operation is different from first operation；
    The processing unit is also used to respond the 4th operation, obtains the 4th search result using the content that the picture is overlapped with the identification region as retrieval element, shows the 4th search result.
  14. Portable electronic device as claimed in claim 11, which is characterized in that the processing unit is specifically used for:
    Second operation is responded, using the content that predeterminable area is overlapped with the picture on the screen as the identification region identified to the picture, alternatively,
    The content that the identification frame being displayed on the screen is drawn a circle to approve on the picture is as the identification region identified to the picture.
  15. Portable electronic device as claimed in claim 11, which is characterized in that second operation includes pressing again, and the processing unit is specifically used for:
    Determine that the region that the heavy closed curve by centered on position on the screen surrounds is the identification region, the size of the closed curve is pre-set.
  16. Portable electronic device as claimed in claim 11, which is characterized in that second operation includes that double-click or articulations digitorum manus knocking, the processing unit are specifically used for:
    The identification region is in the region that the determining closed curve centered on the touch point of the double-click or the articulations digitorum manus knocking surrounds, wherein the size of the closed curve is pre-set.
  17. Portable electronic device as claimed in claim 11, which is characterized in that second operation includes two finger expansions, and the processing unit is specifically used for:
    It determines and refers to that initial touch point on the screen connects the region that the closed curve centered on being formed by the midpoint of line segment surrounds as the identification region by two, the size of the closed curve is pre-set.
  18. Portable electronic device as claimed in claim 11, which is characterized in that second operation includes that delineation or sliding, the processing unit are specifically used for:
    Determine the region surrounded with the track of the delineation or the track of the sliding for the identification region.
  19. Portable electronic device as described in any one of claim 11-18, which is characterized in that the portable electronic device further include:
    Determination unit before operating in response to described second for the processing unit and determine the identification region identified to the picture, determines that the picture is in magnifying state and the picture is in the duration of magnifying state more than first threshold.
  20. A kind of portable electronic device characterized by comprising
    Processor, detector, memory, system bus；
    The processor, the detector and the memory are connected by the system bus；
    The memory includes instruction for storing one or more programs, one or more of programs, and described instruction makes the portable electronic device execute such as method of any of claims 1-10 when being executed by the portable electronic device.
  21. A kind of computer readable storage medium storing one or more programs, when one or more of programs are executed by the portable electronic device, the portable electronic device executes such as method of any of claims 1-10.
  22. A kind of graphic user interface on portable electronic device, the portable electronic device includes display, memory, multiple application programs；With the one or more processors for executing the one or more programs being stored in the memory, the graphic user interface includes the user interface that method according to claim 1 to 10 is shown, wherein, the display includes touch sensitive surface and display screen.
CN201680024911.5A 2016-02-25 2016-02-25 Method, portable electric appts and the graphic user interface retrieved to the content of picture Pending CN107533566A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/074597 WO2017143575A1 (en) 2016-02-25 2016-02-25 Method for retrieving content of image, portable electronic device, and graphical user interface

Publications (1)

Publication Number Publication Date
CN107533566A true CN107533566A (en) 2018-01-02

Family

ID=59684968

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680024911.5A Pending CN107533566A (en) 2016-02-25 2016-02-25 Method, portable electric appts and the graphic user interface retrieved to the content of picture

Country Status (2)

Country Link
CN (1) CN107533566A (en)
WO (1) WO2017143575A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110764726A (en) * 2019-10-18 2020-02-07 网易（杭州）网络有限公司 Target object determination method and device, terminal device and storage medium
CN113918017A (en) * 2021-10-11 2022-01-11 厦门顶尖电子有限公司 Instruction input method based on recognition of weighing platform of scale

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108121486B (en) * 2017-12-19 2023-06-16 维沃移动通信有限公司 Picture display method and mobile terminal
CN110929058B (en) * 2018-08-30 2023-01-31 北京蓝灯鱼智能科技有限公司 Trademark picture retrieval method and device, storage medium and electronic device
CN115033658A (en) * 2021-02-24 2022-09-09 北京小米移动软件有限公司 Information searching method, device, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120001856A1 (en) * 2010-07-02 2012-01-05 Nokia Corporation Responding to tactile inputs
CN102883066A (en) * 2012-09-29 2013-01-16 惠州Tcl移动通信有限公司 Method for realizing file operation based on gesture recognition and cellphone
CN104376052A (en) * 2014-11-03 2015-02-25 杭州淘淘搜科技有限公司 Same-style commodity merging method based on commodity images
CN105190644A (en) * 2013-02-01 2015-12-23 英特尔公司 Techniques for image-based search using touch controls

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8670597B2 (en) * 2009-08-07 2014-03-11 Google Inc. Facial recognition with social network aiding
US9596515B2 (en) * 2012-01-04 2017-03-14 Google Inc. Systems and methods of image searching
KR20150006606A (en) * 2013-07-09 2015-01-19 주식회사 케이티 Server and method for retrieving picture based on object
CN104504083B (en) * 2014-12-24 2019-03-26 北京畅游天下网络技术有限公司 A kind of picture based on picture searching determines method and device
CN104866564B (en) * 2015-05-21 2019-03-15 百度在线网络技术（北京）有限公司 Image searching method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120001856A1 (en) * 2010-07-02 2012-01-05 Nokia Corporation Responding to tactile inputs
CN102883066A (en) * 2012-09-29 2013-01-16 惠州Tcl移动通信有限公司 Method for realizing file operation based on gesture recognition and cellphone
CN105190644A (en) * 2013-02-01 2015-12-23 英特尔公司 Techniques for image-based search using touch controls
CN104376052A (en) * 2014-11-03 2015-02-25 杭州淘淘搜科技有限公司 Same-style commodity merging method based on commodity images

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110764726A (en) * 2019-10-18 2020-02-07 网易（杭州）网络有限公司 Target object determination method and device, terminal device and storage medium
CN110764726B (en) * 2019-10-18 2023-08-22 网易（杭州）网络有限公司 Target object determination method and device, terminal equipment and storage medium
CN113918017A (en) * 2021-10-11 2022-01-11 厦门顶尖电子有限公司 Instruction input method based on recognition of weighing platform of scale
CN113918017B (en) * 2021-10-11 2024-05-03 厦门顶尖电子有限公司 Instruction input method based on identification scale weighing platform

Also Published As

Publication number Publication date
WO2017143575A1 (en) 2017-08-31

Similar Documents

Publication Publication Date Title
US11429276B2 (en) Method for displaying graphical user interface and mobile terminal
US20220027040A1 (en) Method and device for folder management by controlling arrangements of icons
CN106775420B (en) Application switching method and device and graphical user interface
EP2905679B1 (en) Electronic device and method of controlling electronic device
CN110476189B (en) Method and apparatus for providing augmented reality functions in an electronic device
EP3748467A1 (en) Electronic device and operation method thereof
US20200183574A1 (en) Multi-Task Operation Method and Electronic Device
US20160077620A1 (en) Method and apparatus for controlling electronic device using touch input
CN108536365A (en) A kind of images share method and terminal
CN107077295A (en) A kind of method, device, electronic equipment, display interface and the storage medium of quick split screen
CN106775313A (en) Split screen method of controlling operation thereof and mobile terminal
CN108255304A (en) Video data handling procedure, device and storage medium based on augmented reality
CN107533566A (en) Method, portable electric appts and the graphic user interface retrieved to the content of picture
CN109684524A (en) Using recommended method, device, storage medium and electronic equipment
CN104238918B (en) List View component slippage display methods and device
EP2958006A1 (en) Electronic device and method for controlling display
WO2019000287A1 (en) Icon display method and device
CN108509122B (en) Image sharing method and terminal
US20170199588A1 (en) Electronic device and method of operating same
US10438525B2 (en) Method of controlling display of electronic device and electronic device thereof
CN109165075A (en) Application display method, device, electronic equipment and storage medium
CN108696642B (en) Method for arranging icons and mobile terminal
CN109634481A (en) Text display method, device, mobile terminal and storage medium
CN109408072A (en) A kind of application program delet method and terminal device
CN113791725A (en) Touch pen operation identification method, intelligent terminal and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180102

RJ01 Rejection of invention patent application after publication