CN105868385B - Method and system for searching based on terminal interface touch operation - Google Patents

Method and system for searching based on terminal interface touch operation Download PDF

Info

Publication number
CN105868385B
CN105868385B CN201610225527.3A CN201610225527A CN105868385B CN 105868385 B CN105868385 B CN 105868385B CN 201610225527 A CN201610225527 A CN 201610225527A CN 105868385 B CN105868385 B CN 105868385B
Authority
CN
China
Prior art keywords
mask
interface
touch
searched
display area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610225527.3A
Other languages
Chinese (zh)
Other versions
CN105868385A (en
Inventor
谢军样
张倩倩
吴帅
郑相振
凌灵
颜显进
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201410768967.4A priority Critical patent/CN104536995B/en
Priority to CN201610225527.3A priority patent/CN105868385B/en
Publication of CN105868385A publication Critical patent/CN105868385A/en
Application granted granted Critical
Publication of CN105868385B publication Critical patent/CN105868385B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/9038Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The invention discloses a method and a system for searching based on terminal interface touch operation, which relate to the technical field of searching, wherein the method comprises the following steps: when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area; receiving touch operation of a user on the mask, and selecting an interface area to be searched on the mask according to the touch operation; and identifying elements contained in the interface area to be searched, and searching according to the identified elements. According to the method and the device, the touch operation of the user on the mask is received, the interface area to be searched is selected on the mask according to the touch operation, the elements contained in the interface area to be searched are identified, and the search is carried out according to the identified elements, so that the process that the user inputs keywords into the search box in a fussy mode is omitted, and the search is more convenient.

Description

Method and system for searching based on terminal interface touch operation
The patent application of the invention is a divisional application of Chinese invention patent application with application date of 2014, 12 months and 12 days, application number of 201410768967.4 and name of 'method and system for searching based on terminal interface trigger operation'.
Technical Field
The invention relates to the technical field of searching, in particular to a method and a system for searching based on terminal interface touch operation.
Background
Search services on a terminal (such as a smart phone) are input based on a search box, a user needs to input keywords into the search box in a complicated manner to display search results related to the keywords on a terminal display interface by a search engine, but the search mode has low efficiency and very poor search experience.
Especially, when a user needs to search for an instant character, an image and other elements on a display interface of the terminal in the process of using the terminal, the user needs to open a search application program first, and then inputs a keyword in a search box after the application program pops up the search box, which is very inconvenient.
Disclosure of Invention
In view of the above problems, the present invention is proposed to provide a method for searching based on a terminal interface touch operation and a corresponding system for searching based on a terminal interface touch operation, which overcome or at least partially solve the above problems.
According to an aspect of the present invention, a method for searching based on a terminal interface touch operation is provided, where the method includes:
when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
receiving touch operation of a user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;
and identifying elements contained in the interface area to be searched, and searching according to the identified elements.
Optionally, the taking the screenshot as a mask covering the display area of the terminal interface further includes:
and taking the screenshot as a mask in a semitransparent state covering the display area of the terminal interface.
Optionally, the receiving a touch operation of a user on the mask and selecting an interface area to be searched on the mask according to the touch operation further includes:
detecting a touch track generated based on touch operation of a user on the mask, and displaying an interface area to be searched corresponding to the touch track on the mask, wherein the display mode of the interface area to be searched is different from that of other areas on the mask.
Optionally, the display mode of the interface area to be searched is highlight or full transparent display;
and/or the presence of a gas in the gas,
other areas on the mask are displayed in grayscale, blurred, or translucent form.
Optionally, the searching according to the identified element further includes:
removing the mask, and pushing the elements to a search box located in the display area of the terminal interface;
and if the user clicks a first icon arranged in the terminal interface display area, searching according to the elements.
Optionally, before the identifying the elements contained in the interface region to be searched, the method further includes:
and if the user clicks a second icon arranged in the mask, triggering and identifying the elements contained in the interface area to be searched.
Optionally, after the searching according to the identified element, the method further includes:
and displaying the search result item related to the element in the terminal interface display area.
Optionally, the displaying, in the terminal interface display area, a search result item related to the element further includes:
and displaying the search result items related to the elements in a form of combining application cards, text entries and pictures and texts in the terminal interface display area.
Optionally, the elements include: at least one of a text, a picture and a symbol.
According to another aspect of the present invention, there is provided a system for searching based on a terminal interface touch operation, the system including:
the mask generator is suitable for capturing a screen of a current interface display area of the terminal when a user triggers an interface touch search request so as to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
the touch receiver is suitable for receiving touch operation of a user on the mask and selecting an interface area to be searched on the mask according to the touch operation;
and the identification searcher is suitable for identifying the elements contained in the interface area to be searched and searching according to the identified elements.
Optionally, the mask generator is further adapted to: and taking the screenshot as a mask in a semitransparent state covering the display area of the terminal interface.
Optionally, the touch receiver is further adapted to detect a touch track generated based on a touch operation of a user on the mask, and display an interface area to be searched corresponding to the touch track on the mask, where the interface area to be searched is displayed in a manner different from other areas on the mask.
Optionally, the display mode of the interface area to be searched is highlight or full transparent display;
and/or the presence of a gas in the gas,
other areas on the mask are displayed in grayscale, blurred, or translucent form.
Optionally, the identification searcher is further adapted to remove the mask and push the element into a search box located in the display area of the terminal interface;
and when the user clicks a first icon arranged in the terminal interface display area, the identification searcher is also suitable for searching according to the elements.
Optionally, when the user clicks a second icon disposed in the mask, the identification searcher is further adapted to trigger identification of an element included in the interface region to be searched.
Optionally, the system further comprises:
and the search displayer is suitable for displaying the search result items related to the elements in the terminal interface display area.
Optionally, the search presenter is further adapted to present search result items related to the elements in a form of a combination of application cards, text entries, and graphics in the terminal interface display area.
Optionally, the elements include: at least one of a text, a picture and a symbol.
According to the method and the device, the touch operation of the user on the mask is received, the interface area to be searched is selected on the mask according to the touch operation, the elements contained in the interface area to be searched are identified, and the search is carried out according to the identified elements, so that the process that the user inputs keywords into the search box in a fussy mode is omitted, and the search is more convenient.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart illustrating steps of a method for searching based on a terminal interface touch operation according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of a method for searching based on a touch operation of a terminal interface according to an embodiment of the present invention;
FIG. 3 is an exemplary diagram of an interface area to be searched in accordance with one embodiment of the present invention;
FIG. 4 is an exemplary diagram of a terminal interface display area after an element push in accordance with one embodiment of the present invention;
FIG. 5 is a flowchart illustrating steps of a method for searching based on a touch operation of a terminal interface according to an embodiment of the present invention;
FIG. 6 is a pictorial diagram illustrating an example of a search result item, in accordance with an embodiment of the present invention;
fig. 7 is a block diagram of a system for searching based on a terminal interface touch operation according to an embodiment of the present invention;
fig. 8 is a block diagram of a system for searching based on a terminal interface touch operation according to an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
Fig. 1 is a flowchart illustrating steps of a method for searching based on a terminal interface touch operation according to an embodiment of the present invention; referring to fig. 1, the method includes:
s101: when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
it should be noted that, a user may implement triggering an interface touch search request in various ways, for example, the user may trigger a search floating window on a screen, or trigger the interface touch search request through a shortcut such as some buttons or gestures, which is not limited in this embodiment of the present invention.
The method can be understood that the screen capture is firstly carried out on the current interface display area of the terminal, and then the screen capture is used as a mask covering the terminal interface display area, so that the application or program running in the background of the terminal can not be influenced, the original browsing interface can be returned after the whole search interaction is finished, and the user experience is further improved to a certain extent.
Of course, if only the screenshot is taken as a pure transparent mask covering the terminal interface display area, since the mask is consistent with the content displayed in the terminal interface display area, the user may mistakenly think that the terminal does not respond, and in order to avoid the problem, in this embodiment, the mask is set to be in a semi-transparent state, which can effectively prompt the user.
S102: receiving touch operation of a user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;
the user touches the mask, for example, by touching a touch point controlled by the screen with a finger of the user or a sensing pen, and the selection manner may be sliding or circling the finger/the sensing pen on the screen, so as to select the interface area to be searched, and so on.
S103: and identifying elements contained in the interface area to be searched, and searching according to the identified elements.
It should be noted that, in the interface area to be searched, in a general case, only one type of element, such as a piece of text or a picture, may also include multiple types of elements, such as words and pictures, and this is not limited in the embodiment of the present invention, and the types of the elements include, but are not limited to: text, pictures and symbols.
In this embodiment, a touch operation of a user on a mask is received, an interface area to be searched is selected on the mask according to the touch operation, and elements included in the interface area to be searched are identified. The recognition mode may be various, for example, the recognition of the text element may be realized by an OCR optical character recognition technology, the text element may also be recognized by invoking a control supported by an operating system, for example, a uiiautormatter control, whether an element contained in the interface region to be searched is an image face or not may also be recognized by a face recognition technology, and other sources of the picture on the internet may also be recognized by using a similar picture recognition technology, of course, also using other recognition technologies, or combining multiple recognition technologies, so as to improve the recognition accuracy. Therefore, the user directly jumps to the search interface according to the identified elements, so that the process that the user inputs key words into the search box in a complicated way is omitted, or the complicated process that the user needs to copy page contents first and then start the search client to paste the page contents into the search box is omitted, and the whole search interaction is more convenient.
FIG. 2 is a flowchart illustrating steps of a method for searching based on a touch operation of a terminal interface according to an embodiment of the present invention; the method of the embodiment comprises the following steps:
s201: when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
s202: detecting a touch track generated based on touch operation of a user on the mask, and displaying an interface area to be searched corresponding to the touch track on the mask, wherein the display mode of the interface area to be searched is different from that of other areas on the mask;
it should be noted that, when the interface area to be searched is selected on the mask, if the presentation manner of the interface area to be searched is not distinguished from other areas on the mask, it may be difficult for the user to determine the elements in the interface area to be searched.
Therefore, step S202 is substantially a preferred implementation of step S102 in the embodiment shown in fig. 1.
It can be understood that, in order to implement the difference of the display modes, a plurality of display modes may be adopted, in this embodiment, the display mode of the interface area to be searched may be displayed in a highlight or fully transparent form, and the other area on the mask may still be displayed in a semi-transparent form, or may be displayed in a gray scale form, referring to fig. 3, the other area a on the mask is displayed in a gray scale or a fuzzy form, and the interface area B to be searched is displayed in a fully transparent form, of course, the difference of the display modes may also be implemented in other modes, which is not limited in this embodiment of the present invention.
S203: identifying elements contained in the interface area to be searched, removing the mask, and pushing the elements to a search box C located in the terminal interface display area with reference to FIG. 4; and if the user clicks a first icon D arranged in the terminal interface display area, searching according to the elements.
It should be noted that after the elements included in the interface area to be searched are identified, the elements need to be pushed into the search box located in the terminal interface display area, and if the mask is still reserved, the elements pushed into the search box are difficult to see, so that the mask needs to be removed after the elements included in the interface area to be searched are identified.
Therefore, step S203 is substantially a preferred implementation of step S103 in the embodiment shown in fig. 1.
Understandably, since the element is pushed to the search box located in the terminal interface display area, the search box needs to be popped up in the terminal interface display area.
In order to facilitate the user to search after confirming the elements, the user can search according to the elements after clicking the first icon triggering the search.
FIG. 5 is a flowchart illustrating steps of a method for searching based on a touch operation of a terminal interface according to an embodiment of the present invention; the method of the embodiment comprises the following steps:
s501: when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
s502: receiving touch operation of a user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;
s503: and identifying elements contained in the interface area to be searched, and searching according to the identified elements.
S504: and displaying the search result item related to the element in the terminal interface display area.
It should be noted that steps S501 to S503 are substantially the same as steps S101 to S103 of the embodiment shown in fig. 1, and therefore are not described herein again.
It should be noted that the search result item may be displayed in various forms, in this embodiment, the search result item related to the element is displayed in the terminal interface display area in a form of combining an application card, a text entry, and an image and text, fig. 6 is a display manner of the search result item, and certainly, other forms of display may also be used, which is not limited in this embodiment of the present invention.
It can be understood that, in order to facilitate the user to confirm the interface area to be searched, and then identify the elements contained in the interface area to be searched, optionally, on the basis of the embodiments shown in fig. 1, 2, and 5, before identifying the elements contained in the interface area to be searched, the method further includes: if the user clicks a second icon (i.e., "E" in fig. 3) disposed in the mask, the element included in the interface area to be searched is triggered to be identified.
Of course, other icons may be further disposed in the mask, for example, a repaint icon (i.e., "F" in fig. 3) for reselecting the interface area to be searched, a return icon (i.e., "G" in fig. 3) for exiting, and the like, which may be added as needed, and this is not limited by the embodiment of the present invention.
It is to be understood that the executing entities of the methods of the embodiments shown in fig. 1, 2, and 5 are all terminals, and the terminals may be devices such as a desktop computer with a touch screen, a notebook, a mobile phone, and a tablet computer, which are not limited in this respect.
For simplicity of explanation, the method embodiments are described as a series of acts or combinations, but those skilled in the art will appreciate that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the embodiments of the invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Fig. 7 is a block diagram of a system for searching based on a terminal interface touch operation according to an embodiment of the present invention; referring to fig. 7, the system includes:
the mask generator 701 is suitable for capturing a screen of a current interface display area of a terminal when a user triggers an interface touch search request so as to obtain a screenshot of the current interface display area of the terminal, and taking the screenshot as a mask covering the terminal interface display area;
a touch receiver 702, adapted to receive a touch operation of a user on the mask, and select an interface area to be searched on the mask according to the touch operation;
the identification searcher 703 is adapted to identify elements included in the interface region to be searched, and perform a search according to the identified elements.
In an alternative embodiment of the invention, the mask generator is further adapted to: and taking the screenshot as a mask in a semitransparent state covering the display area of the terminal interface.
In an optional embodiment of the present invention, the display mode of the interface area to be searched is a highlight or full transparent display;
and/or the presence of a gas in the gas,
other areas on the mask are displayed in grayscale, blurred, or translucent form.
In an optional embodiment of the present invention, the touch receiver is further adapted to detect a touch track generated based on a touch operation of a user on the mask, and display an interface area to be searched corresponding to the touch track on the mask, where the interface area to be searched is displayed in a manner different from other areas on the mask.
In an optional embodiment of the present invention, the identification searcher is further adapted to remove the mask and push the element into a search box located in the display area of the terminal interface;
and when the user clicks a first icon arranged in the terminal interface display area, the identification searcher is also suitable for searching according to the elements.
Fig. 8 is a block diagram of a system for searching based on a terminal interface touch operation according to an embodiment of the present invention; referring to fig. 8, the system includes:
the mask generator 801 is suitable for capturing a screen of a current interface display area of a terminal when a user triggers an interface touch search request so as to obtain a screenshot of the current interface display area of the terminal, and taking the screenshot as a mask covering the terminal interface display area;
a touch receiver 802, adapted to receive a touch operation of a user on the mask, and select an interface area to be searched on the mask according to the touch operation;
and the identification searcher 803 is suitable for identifying the elements contained in the interface area to be searched and searching according to the identified elements.
A search presenter 804 adapted to present search result items related to the elements in the terminal interface display area.
In an optional embodiment of the present invention, the search presenter 804 is further adapted to present search result items related to the element in a form of a combination of application cards, text entries, and graphics in the terminal interface display area.
In an alternative embodiment of the invention, the elements comprise: at least one of a text, a picture and a symbol.
In an optional embodiment of the present invention, when the user clicks the second icon disposed in the mask, the recognition searcher is further adapted to trigger recognition of an element included in the interface region to be searched.
For the system embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
It should be noted that, in the respective components of the system of the present invention, the components therein are logically divided according to the functions to be implemented, but the present invention is not limited thereto, and the respective components may be re-divided or combined as needed, for example, some components may be combined into a single component, or some components may be further decomposed into more sub-components.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functionality of some or all of the components in a system according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The above embodiments are only suitable for illustrating the present invention and not limiting the present invention, and those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, so that all equivalent technical solutions also belong to the scope of the present invention, and the scope of the present invention should be defined by the claims.

Claims (12)

1. A method for searching based on terminal interface touch operation is characterized by comprising the following steps:
when a user triggers an interface touch search request, screen capturing is carried out on a current interface display area of a terminal to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
receiving touch operation of a user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;
identifying elements contained in the interface area to be searched, and searching according to the identified elements;
wherein, the taking the screenshot as a mask covering the terminal interface display area further comprises:
taking the screenshot as a mask covering the display area of the terminal interface and in a semitransparent state;
the receiving a touch operation of a user on the mask and selecting an interface area to be searched on the mask according to the touch operation further comprises:
detecting a touch track generated based on touch operation of a user on the mask, and displaying an interface area to be searched corresponding to the touch track on the mask, wherein the display mode of the interface area to be searched is different from that of other areas on the mask;
and, said searching according to the identified element further comprises:
removing the mask, and pushing the elements to a search box located in the display area of the terminal interface;
and if the user clicks a first icon arranged in the terminal interface display area, searching according to the elements.
2. The method according to claim 1, wherein the interface area to be searched is displayed in a highlight or full transparent manner;
and/or the presence of a gas in the gas,
other areas on the mask are displayed in grayscale, blurred, or translucent form.
3. The method according to claim 1 or 2, before the identifying the elements contained in the interface region to be searched, further comprising:
and if the user clicks a second icon arranged in the mask, triggering and identifying the elements contained in the interface area to be searched.
4. The method of claim 1 or 2, after said searching according to the identified elements, further comprising:
and displaying the search result item related to the element in the terminal interface display area.
5. The method of claim 4, wherein the presenting search result items related to the element in the terminal interface display area further comprises:
and displaying the search result items related to the elements in a form of combining application cards, text entries and pictures and texts in the terminal interface display area.
6. The method of claim 1 or 2, the element comprising: at least one of a text, a picture and a symbol.
7. A system for searching based on terminal interface touch operation is characterized in that the system comprises:
the mask generator is suitable for capturing a screen of a current interface display area of the terminal when a user triggers an interface touch search request so as to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the terminal interface display area;
the touch receiver is suitable for receiving touch operation of a user on the mask and selecting an interface area to be searched on the mask according to the touch operation;
the identification searcher is suitable for identifying elements contained in the interface area to be searched and searching according to the identified elements;
wherein the mask generator is further adapted to: taking the screenshot as a mask covering the display area of the terminal interface and in a semitransparent state;
the touch receiver is further adapted to detect a touch track generated based on a touch operation of a user on the mask, and display an interface area to be searched corresponding to the touch track on the mask, wherein the interface area to be searched is displayed in a manner different from other areas on the mask;
and the identification searcher is also suitable for removing the mask and pushing the elements into a search box positioned in the display area of the terminal interface;
and when the user clicks a first icon arranged in the terminal interface display area, the identification searcher is also suitable for searching according to the elements.
8. The system of claim 7, wherein the interface area to be searched is displayed in a highlight or full transparent manner;
and/or the presence of a gas in the gas,
other areas on the mask are displayed in grayscale, blurred, or translucent form.
9. The system according to claim 7 or 8, wherein said recognition searcher is further adapted to trigger recognition of elements contained in said interface area to be searched when a user clicks on a second icon provided in said mask.
10. The system of claim 7 or 8, further comprising:
and the search displayer is suitable for displaying the search result items related to the elements in the terminal interface display area.
11. The system of claim 10, the search presenter further adapted to present search result items associated with the elements in the terminal interface display area in a combination of application cards, text entries, and text.
12. The system of claim 7 or 8, the elements comprising: at least one of a text, a picture and a symbol.
CN201610225527.3A 2014-12-12 2014-12-12 Method and system for searching based on terminal interface touch operation Active CN105868385B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201410768967.4A CN104536995B (en) 2014-12-12 2014-12-12 The method and system of searching for based on terminal interface touch control operation
CN201610225527.3A CN105868385B (en) 2014-12-12 2014-12-12 Method and system for searching based on terminal interface touch operation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610225527.3A CN105868385B (en) 2014-12-12 2014-12-12 Method and system for searching based on terminal interface touch operation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201410768967.4A Division CN104536995B (en) 2014-12-12 2014-12-12 The method and system of searching for based on terminal interface touch control operation

Publications (2)

Publication Number Publication Date
CN105868385A CN105868385A (en) 2016-08-17
CN105868385B true CN105868385B (en) 2020-02-07

Family

ID=52852523

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610225527.3A Active CN105868385B (en) 2014-12-12 2014-12-12 Method and system for searching based on terminal interface touch operation
CN201410768967.4A CN104536995B (en) 2014-12-12 2014-12-12 The method and system of searching for based on terminal interface touch control operation

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201410768967.4A CN104536995B (en) 2014-12-12 2014-12-12 The method and system of searching for based on terminal interface touch control operation

Country Status (2)

Country Link
CN (2) CN105868385B (en)
WO (1) WO2016091095A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105868385B (en) * 2014-12-12 2020-02-07 北京奇虎科技有限公司 Method and system for searching based on terminal interface touch operation
CN104462437B (en) * 2014-12-15 2018-06-08 北京奇虎科技有限公司 The method and system of search are identified based on the multiple touch control operation of terminal interface
WO2016101768A1 (en) * 2014-12-26 2016-06-30 北京奇虎科技有限公司 Terminal and touch operation-based search method and device
CN106469280A (en) * 2015-08-14 2017-03-01 腾讯科技(深圳)有限公司 The method and device of instant messaging interface processing
CN106897291B (en) * 2015-12-18 2020-10-02 北京奇虎科技有限公司 Searching method and device based on screen capture operation
CN106383847B (en) * 2016-08-30 2019-03-22 宇龙计算机通信科技(深圳)有限公司 A kind of page content processing method and device
CN106843884B (en) * 2017-01-24 2020-05-19 宇龙计算机通信科技(深圳)有限公司 Query data processing method and device
CN106909507A (en) * 2017-02-27 2017-06-30 网易(杭州)网络有限公司 Method, device and electronic equipment for automatically generating test script
CN107273447A (en) * 2017-05-27 2017-10-20 北京小米移动软件有限公司 Information acquisition method and device, terminal, server and storage medium
CN108881616B (en) * 2018-05-07 2019-12-10 珠海格力电器股份有限公司 Display control method and device, storage medium and terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103135884A (en) * 2011-11-22 2013-06-05 财团法人资讯工业策进会 Input method, system and device thereof for querying by using a region formed by an enclosed track
CN103294363A (en) * 2013-05-20 2013-09-11 华为技术有限公司 Search method and terminal
CN103455590A (en) * 2013-08-29 2013-12-18 百度在线网络技术(北京)有限公司 Method and device for retrieving in touch-screen device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2770186C (en) * 2009-08-07 2018-05-22 Google, Inc. User interface for presenting search results for multiple regions of a visual query
US9135277B2 (en) * 2009-08-07 2015-09-15 Google Inc. Architecture for responding to a visual query
CN102023852A (en) * 2009-09-15 2011-04-20 深圳市巨龙科教高技术股份有限公司 Screen capture method and system
CN102012919B (en) * 2010-11-26 2013-08-07 深圳市同洲电子股份有限公司 Method and device for searching association of image screenshots from televisions and digital television terminal
CN102609208B (en) * 2012-02-13 2014-01-15 广州市动景计算机科技有限公司 Method and system for word capture on screen of touch screen equipment, and touch screen equipment
CN103338405A (en) * 2013-06-03 2013-10-02 四川长虹电器股份有限公司 Screen capture application method, equipment and system
CN105868385B (en) * 2014-12-12 2020-02-07 北京奇虎科技有限公司 Method and system for searching based on terminal interface touch operation
CN104462437B (en) * 2014-12-15 2018-06-08 北京奇虎科技有限公司 The method and system of search are identified based on the multiple touch control operation of terminal interface
CN104516632B (en) * 2014-12-30 2016-11-30 北京奇虎科技有限公司 Determine and touch the method and device that character scans for
CN104503679B (en) * 2014-12-30 2017-04-12 北京奇虎科技有限公司 Searching method and searching device based on terminal interface touch operation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103135884A (en) * 2011-11-22 2013-06-05 财团法人资讯工业策进会 Input method, system and device thereof for querying by using a region formed by an enclosed track
CN103294363A (en) * 2013-05-20 2013-09-11 华为技术有限公司 Search method and terminal
CN103455590A (en) * 2013-08-29 2013-12-18 百度在线网络技术(北京)有限公司 Method and device for retrieving in touch-screen device

Also Published As

Publication number Publication date
CN104536995A (en) 2015-04-22
WO2016091095A1 (en) 2016-06-16
CN105868385A (en) 2016-08-17
CN104536995B (en) 2016-05-11

Similar Documents

Publication Publication Date Title
US10685417B2 (en) Method and device for searching in a touch-screen apparatus based on gesture inputs
US20180341397A1 (en) Methods and devices for searching and displaying information on a terminal
US9965138B2 (en) Mobile communications device, non-transitory computer-readable medium and method of activating update of home screen of mobile communications device
US20200159392A1 (en) Method of processing content and electronic device thereof
US9703462B2 (en) Display-independent recognition of graphical user interface control
KR101566596B1 (en) Device, method, and graphical user interface for navigating a list of identifiers
CN102609208B (en) Method and system for word capture on screen of touch screen equipment, and touch screen equipment
AU2013206192B2 (en) Touch and gesture input-based control method and terminal therefor
RU2632144C1 (en) Computer method for creating content recommendation interface
CN102981728B (en) Semantic zoom
US20170068739A1 (en) Queryless search based on context
US8966395B2 (en) Mobile terminal and control method thereof
US9934254B2 (en) Terminal apparatus, information processing system, and information processing method
KR101019039B1 (en) Terminal having touch-screen and method for searching data thereof
JP6479079B2 (en) Extension activation for related documents
KR101875805B1 (en) Device, method, and graphical user interface for presenting and installing applications
EP2715499B1 (en) Invisible control
US8060841B2 (en) Method and device for touchless media searching
US9727348B2 (en) Providing a context-aware help content using a transparent overlay on a touch sensitive screen
TWI611338B (en) Method for zooming screen and electronic apparatus and computer program product using the same
EP3289486A1 (en) Entity action suggestion on a mobile device
JP5347673B2 (en) Information processing apparatus, information processing method, and program
US8154428B2 (en) Gesture recognition control of electronic devices using a multi-touch device
US20150378446A1 (en) Method for selecting an entry for an application using a graphical user interface
CN105786930B (en) Based on the searching method and device for touching interaction

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant