WO2016091095A1

WO2016091095A1 - Searching method and system based on touch operation on terminal interface

Info

Publication number: WO2016091095A1
Application number: PCT/CN2015/096018
Authority: WO
Inventors: 谢军样; 张倩倩; 吴帅; 郑相振; 凌灵; 颜显进
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2014-12-12
Filing date: 2015-11-30
Publication date: 2016-06-16
Also published as: CN104536995A; CN105868385B; CN104536995B; CN105868385A

Abstract

A searching method and system based on a touch operation on a terminal interface relate to the technical field of searching. The method comprises: when a user triggers an interface touch searching request, performing screen capturing on a current interface display area of a terminal, so as to obtain a screenshot of the current interface display area of the terminal, and using the screenshot as a mask for covering the interface display area of the terminal (S101); receiving a touch operation of the user on the mask, and selecting a to-be-searched interface area from the mask according to the touch operation (S102); and identifying an element comprised in the to-be-searched interface area, and performing a search according to the identified element (S103). A touch operation of a user on a mask is received, a to-be-searched interface area is selected from the mask according to the touch operation, an element comprised in the to-be-searched interface area is identified, and a search is performed according to the identified element, so that the process in which the user tediously inputs a keyword in a search box is omitted, and the search is more convenient.

Description

Method and system for searching based on touch operation of terminal interface

Technical field

The present invention relates to the field of search technologies, and in particular, to a method and system for searching based on a touch operation of a terminal interface.

Background technique

The search service on the terminal (for example, a smart phone) is input based on the search box, and the user needs to input keywords into the search box cumbersomely, so that the search result related to the keyword can be displayed on the terminal display interface by the search engine. , but the search method is very inefficient and the search experience is very poor.

In particular, when the user is using the terminal, when there is an immediate search requirement for characters, images, and the like on the terminal display interface, the search application needs to be opened first, and after the application pops up in the search box, the search box is further Entering keywords is very inconvenient.

Summary of the invention

In view of the above problems, the present invention has been made in order to provide a method for searching based on a terminal interface touch operation that overcomes the above problems or at least partially solves the above problems, and a corresponding system for searching based on a touch interface operation of a terminal interface. .

According to an aspect of the present invention, a method for performing a search based on a touch operation of a terminal interface is provided, and the method includes:

When the user triggers the interface touch search request, the current interface display area of the terminal is screened to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the display area of the terminal interface;

Receiving a touch operation of the user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;

Identifying elements included in the to-be-searched interface area, and searching according to the identified elements.

According to another aspect of the present invention, a system for searching based on a touch operation of a terminal interface is provided, the system comprising:

The mask generator is adapted to screen the current interface display area of the terminal when the user triggers the interface touch search request, to obtain a screenshot of the current interface display area of the terminal, and the screenshot As a mask covering the display area of the terminal interface;

The touch receiver is adapted to receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

The recognition searcher is adapted to identify an element included in the interface area to be searched, and perform a search according to the identified element.

According to still another aspect of the present invention, a computer program comprising computer readable code, when the computer readable code is run on a computing device, causes the computing device to perform a terminal based interface touch as described above Control the method of searching for operations.

According to still another aspect of the present invention, there is provided a computer readable medium storing the above computer program.

The invention selects a to-be-searched interface area on the mask according to the touch operation, and identifies an element included in the to-be-searched interface area, according to the identified element, by receiving a touch operation of the user on the mask. The search omits the process of the user cumbersomely entering keywords into the search box, making the search more convenient.

The above description is only an overview of the technical solutions of the present invention, and the above-described and other objects, features and advantages of the present invention can be more clearly understood. Specific embodiments of the invention are set forth below.

DRAWINGS

Various other advantages and benefits will become apparent to those skilled in the art from a The drawings are only for the purpose of illustrating the preferred embodiments and are not to be construed as limiting. Throughout the drawings, the same reference numerals are used to refer to the same parts. In the drawing:

1 is a flow chart showing the steps of a method for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention;

2 is a flow chart showing the steps of a method for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention;

3 is a diagram showing an example of an interface area to be searched according to an embodiment of the present invention;

4 is a diagram showing an example of a terminal interface display area after element push according to an embodiment of the present invention;

FIG. 5 is a flow chart showing the steps of a method for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; FIG.

6 is a diagram showing an example of display of a search result item according to an embodiment of the present invention;

7 is a structural block diagram of a system for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention;

FIG. 8 is a structural block diagram of a system for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; FIG.

Figure 9 shows a block diagram of a computing device for performing a method in accordance with the present invention;

Figure 10 shows a storage unit for holding or carrying program code implementing the method according to the invention.

Specific embodiment

The specific embodiments of the present invention are further described in detail below with reference to the drawings and embodiments. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

1 is a flow chart of steps of a method for searching based on a touch operation of a terminal interface according to an embodiment of the present invention; referring to FIG. 1, the method includes:

S101: When the user triggers the interface touch search request, the current interface display area of the terminal is screened to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the display area of the terminal interface;

It should be noted that the user can trigger the interface touch search request in multiple ways, for example, the user can trigger the search floating window on the screen, or trigger the interface touch search request through shortcuts such as buttons or gestures. This example does not limit this.

It can be understood that the current interface display area of the terminal is screened first, and then the screenshot is used as a mask covering the display area of the terminal interface, so that the application or program running in the background of the terminal is not affected, and after the entire search interaction ends, Can return to the original browsing interface, and thus improve the user experience to a certain extent.

Of course, if the screenshot is only used as a pure transparent mask covering the display area of the terminal interface, the content may be misidentified by the user as the terminal does not generate a response because the mask is consistent with the content displayed on the display interface of the terminal interface. In order to avoid this problem, in the embodiment, the mask is set to be semi-transparent, and the user can be effectively presented.

S102: Receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

The touch operation of the user on the mask, such as touching the touch point controlled by the screen by the user's finger or the sensor pen, and the selection method can be selected by sliding, or circleing on the screen with a finger/stylus, etc., thereby selecting The interface area to be searched and the like.

S103: Identify an element included in the to-be-searched interface area, and perform a search according to the identified element.

It should be noted that, in the normal search situation, the interface to be searched only contains one type of element, such as a piece of text, or a picture, and of course, may also contain multiple types of elements, such as containing both text and The embodiment of the present invention does not limit this, and the types of the elements include, but are not limited to, characters, pictures, and symbols.

In this embodiment, by receiving a touch operation on the mask, the user selects an interface to be searched on the mask according to the touch operation, and identifies an element included in the interface to be searched. There are many ways to identify them. For example, OCR optical character recognition technology can be used to identify text elements. You can also recognize text elements by calling controls supported by the operating system, such as the Uiautomater control. You can also identify the search by face recognition technology. The elements contained in the interface area are not image faces, and other pictures can be identified by similar image recognition technology on the Internet. Of course, as well as other recognition technologies, multiple recognition technologies can be combined to improve the recognition. degree. In this way, the identified element directly jumps to the search interface, thereby omitting the process of the user inputting the keyword into the search box cumbersomely, or the user needs to copy the page content first, and then open the tedious process of the search client pasteing into the search box. Make the entire search interaction more convenient.

2 is a flow chart of steps of a method for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; the method of this embodiment includes:

S201: When the user triggers the interface touch search request, the current interface display area of the terminal is screened to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the display area of the terminal interface;

S202: Detecting a touch trajectory generated by a touch operation performed by the user on the mask, displaying an interface area to be searched corresponding to the touch trajectory on the mask, and displaying a difference in display manner of the interface area to be searched And other areas on the mask;

It should be noted that, when the interface to be searched is selected on the mask, if the presentation manner of the interface to be searched is not distinguished from other regions on the mask, it may be difficult for the user to determine the to-be-searched. In order to avoid the problem, in the embodiment, the presentation manner of the interface area to be searched is distinguished from other areas on the mask.

Therefore, step S202 is substantially a preferred embodiment of step S102 in the embodiment shown in FIG. 1. Way of application.

It can be understood that, in order to realize the difference of the presentation manner, a plurality of presentation manners can be adopted. In this embodiment, the display manner of the interface region to be searched may be displayed in a highlighted or fully transparent form, and the mask is displayed. The other areas on the top may still be displayed in a semi-transparent form, or may be displayed in the form of gray scales. Referring to FIG. 3, other areas A on the mask are displayed in grayscale or fuzzy form, and the The search interface area B is displayed in a fully transparent form. Of course, the difference in the manner of presentation may be implemented in other manners, which is not limited by the embodiment of the present invention.

S203: Identify an element included in the interface area to be searched, and remove the mask. Referring to FIG. 4, the element is pushed to a search box C located in the display area of the terminal interface; if the user clicks on the The first icon D in the terminal interface display area is searched according to the element.

It should be noted that after the elements included in the interface to be searched are identified, the elements need to be pushed to the search box located in the display area of the terminal interface, and if the mask is still retained, it is difficult to use. The elements that are pushed into the search box are seen, so the mask needs to be removed after identifying the elements contained in the interface area to be searched.

Therefore, step S203 is substantially a preferred embodiment of step S103 in the embodiment shown in FIG. 1.

It can be understood that, since the element is to be pushed to the search box located in the display area of the terminal interface, the search box needs to be popped up in the display area of the terminal interface.

In order to facilitate the user to perform the search after confirming the element, after the user clicks the first icon that triggers the search, the search is performed according to the element.

FIG. 5 is a flowchart of a method for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; the method of this embodiment includes:

S501: When the user triggers the interface touch search request, the current interface display area of the terminal is screened to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the display area of the terminal interface;

S502: Receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

S503: Identify an element included in the to-be-searched interface area, and perform a search according to the identified element.

S504: Display a search result item related to the element in the terminal interface display area.

It should be noted that steps S501 to S503 are substantially the same as S101 to S103 of the embodiment shown in FIG. 1, and thus are not described herein again.

It should be noted that the search result item may be displayed in various forms. In this embodiment, the element related to the element is displayed in the form of a combination of an application card, a text item, and a graphic in the terminal interface display area. The search result item, FIG. 6 is a display manner of the search result item, and of course, it can also be displayed in other forms, which is not limited by the embodiment of the present invention.

It can be understood that, in order to facilitate the user to confirm the search interface area, the elements included in the search interface area are identified, optionally, based on the embodiments shown in FIG. 1 and FIG. Before identifying the element included in the to-be-searched interface area, the method further includes: if the user clicks on the second icon (ie, “E” in FIG. 3) disposed in the mask, triggering to identify the to-be-searched interface The elements contained within the area.

Of course, other icons may be disposed in the mask, such as a repaint icon for reselecting the interface region to be searched (ie, "F" in FIG. 3), a return icon for exiting (ie, a map) The "G" in the third embodiment and the like may be increased as needed, and the embodiment of the present invention does not limit this.

It is to be understood that the main body of the method of the embodiment shown in FIG. 1 and FIG. 2 is a terminal, and the terminal may be a desktop computer with a touch screen, a notebook, a mobile phone, a tablet computer, etc., in the embodiment of the present invention. There is no restriction on this.

For the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the embodiments of the present invention are not limited by the described action sequence, because the embodiment according to the present invention Some steps can be performed in other orders or at the same time. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

7 is a structural block diagram of a system for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; referring to FIG. 7, the system includes:

The mask generator 701 is adapted to screen the current interface display area of the terminal when the user triggers the interface touch search request, to obtain a screenshot of the current interface display area of the terminal, and use the screenshot as the coverage of the terminal interface. a mask of the display area;

The touch receiver 702 is adapted to receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

The identification searcher 703 is adapted to identify an element included in the interface area to be searched, and perform a search according to the identified element.

In an optional embodiment of the present invention, the mask generator is further adapted to: use the screenshot as a mask in a semi-transparent state covering the display interface of the terminal interface.

In an optional embodiment of the present invention, the display manner of the interface area to be searched is highlighted. Or in a fully transparent form;

and / or,

Other areas on the mask are displayed in grayscale, blurred or translucent form.

In an optional embodiment of the present invention, the touch receiver is further configured to detect a touch trajectory generated based on a touch operation of the user on the mask, and display the same on the mask The interface area to be searched corresponding to the touch track is displayed, and the display manner of the interface area to be searched is different from other areas on the mask.

In an optional embodiment of the present invention, the identification searcher is further adapted to remove the mask, and push the element to a search box located in a display area of the terminal interface;

When the user clicks on the first icon located in the display area of the terminal interface, the recognition searcher is further adapted to perform a search according to the element.

FIG. 8 is a structural block diagram of a system for performing a search based on a touch operation of a terminal interface according to an embodiment of the present invention; referring to FIG. 8, the system includes:

The mask generator 801 is adapted to take a screenshot of the current interface display area of the terminal when the user triggers the interface touch search request, to obtain a screenshot of the current interface display area of the terminal, and use the screenshot as the coverage of the terminal interface. a mask of the display area;

The touch receiver 802 is adapted to receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

The identification searcher 803 is adapted to identify an element included in the interface area to be searched, and perform a search according to the identified element.

A search presenter 804 is adapted to display search result items related to the element in the terminal interface display area.

In an optional embodiment of the present invention, the search presenter 804 is further adapted to display a search related to the element in a combination of an application card, a text entry, and a graphic in the terminal interface display area. Result item.

In an optional embodiment of the present invention, the element includes at least one of a character, a picture, and a symbol.

In an optional embodiment of the present invention, when the user clicks on the second icon disposed in the mask, the identification searcher is further adapted to trigger identification of an element included in the to-be-searched interface area.

For the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

It should be noted that in the various components of the system of the present invention, depending on the function to be implemented The components therein are logically divided, but the present invention is not limited thereto, and the respective components may be re-divided or combined as needed. For example, some components may be combined into a single component, or some components may be further decomposed into More subcomponents.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the components of the system for searching based on terminal interface touch operations in accordance with embodiments of the present invention. Or all features. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, Figure 9 shows a block diagram of a computing device for performing the method in accordance with the present invention. Referring to Figure 9, the computing device conventionally includes a computer program product or computer readable medium in the form of a processor 910 and a memory 920. The memory 920 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. The memory 920 has a storage space 930 that stores program code 931 for performing any of the method steps described above. For example, storage space 930 storing program code may include various program code 931 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such a computer program product is typically a portable or fixed storage unit as described with reference to FIG. The storage unit may have storage segments, storage spaces, and the like that are similarly arranged to memory 920 in the computing device of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit comprises computer readable code 931' for performing the steps of the method according to the invention, ie code that can be read by a processor such as 910, which causes the calculation when the code is run by the computing device The device performs the various steps in the methods described above.

"an embodiment," or "an embodiment," or "an embodiment," In addition, it is noted that the phrase "in one embodiment" is not necessarily referring to the same embodiment.

In the description provided herein, numerous specific details are set forth. However, can understand, this The embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of the description.

It is to be noted that the above-described embodiments are illustrative of the invention and are not intended to be limiting, and that the invention may be devised without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word "comprising" does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

In addition, it should be noted that the language used in the specification has been selected for the purpose of readability and teaching, and is not intended to be construed or limited. Therefore, many modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The disclosure of the present invention is intended to be illustrative, and not restrictive, and the scope of the invention is defined by the appended claims.

The above embodiments are only intended to be illustrative of the present invention, and are not to be construed as limiting the scope of the invention. Equivalent technical solutions are also within the scope of the invention, and the scope of the invention is defined by the claims.

Claims

A method for searching based on a touch operation of a terminal interface, the method comprising:

When the user triggers the interface touch search request, the current interface display area of the terminal is screened to obtain a screenshot of the current interface display area of the terminal, and the screenshot is used as a mask covering the display area of the terminal interface;

Receiving a touch operation of the user on the mask, and selecting an interface area to be searched on the mask according to the touch operation;

Identifying elements included in the to-be-searched interface area, and searching according to the identified elements.
The method of claim 1, wherein the using the screenshot as a mask covering the display area of the terminal interface further comprises:

The screenshot is used as a mask in a semi-transparent state covering the display area of the terminal interface.
The method of claim 2, wherein the receiving a user's touch operation on the mask and selecting an interface area to be searched on the mask according to the touch operation further includes:

Detecting a touch trajectory generated by a touch operation of the user on the mask, and displaying an interface region to be searched corresponding to the touch trajectory on the mask, the display manner of the interface to be searched is different from Other areas on the mask.
The method according to claim 3, wherein the display manner of the interface area to be searched is displayed in a highlighted or fully transparent form;

and / or,

Other areas on the mask are displayed in grayscale, blurred or translucent form.
The method of claim 1 wherein said searching based on the identified elements further comprises:

Removing the mask, pushing the element to a search box located in a display area of the terminal interface;

If the user clicks on the first icon located in the display area of the terminal interface, the search is performed according to the element.
The method according to any one of claims 1 to 5, wherein before the identifying the elements included in the to-be-searched interface area, the method further includes:

If the user clicks on the second icon disposed in the mask, triggering to identify the to-be-searched interface area The elements contained within the domain.
The method according to any one of claims 1 to 5, wherein after the searching according to the identified element, the method further comprises:

A search result item related to the element is displayed in the terminal interface display area.
The method of claim 7, wherein the displaying the search result item related to the element in the terminal interface display area further comprises:

Search result items related to the element are displayed in the terminal interface display area in the form of a combination of an application card, a text entry, and a graphic.
The method according to any one of claims 1 to 5, wherein the element comprises at least one of a character, a picture and a symbol.
A system for searching based on a touch operation of a terminal interface, wherein the system comprises:

The mask generator is adapted to screen the current interface display area of the terminal when the user triggers the interface touch search request, to obtain a screenshot of the current interface display area of the terminal, and display the screenshot as an overlay of the terminal interface. Mask of the area;

The touch receiver is adapted to receive a touch operation of the user on the mask, and select an interface area to be searched on the mask according to the touch operation;

The recognition searcher is adapted to identify an element included in the interface area to be searched, and perform a search according to the identified element.
The system of claim 10, wherein the mask generator is further adapted to: use the screenshot as a mask in a semi-transparent state covering the display interface of the terminal interface.
The system of claim 11, wherein the touch receiver is further adapted to detect a touch trajectory generated based on a touch operation of the user on the mask, and display on the mask The touch track corresponding to the interface area to be searched, and the display manner of the interface area to be searched is different from other areas on the mask.
The system according to claim 12, wherein the display manner of the interface area to be searched is displayed in a highlighted or fully transparent form;

and / or,

Other areas on the mask are displayed in grayscale, blurred or translucent form.
The system according to claim 10, wherein said identification searcher is further adapted to remove said mask and push said element to a search box located in said terminal interface display area;

When the user clicks on the first icon located in the display area of the terminal interface, the recognition searcher is further adapted to perform a search according to the element.
The system according to any one of claims 10 to 14, wherein the identification searcher is further adapted to trigger the identification of the to-be-searched when the user clicks on the second icon provided in the mask The elements contained within the interface area.
The system of any of claims 10 to 14, wherein the system further comprises:

A search presenter adapted to display search result items related to the element in the terminal interface display area.
The system of claim 16, wherein the search presenter is further adapted to display a search related to the element in a combination of an application card, a text entry, and a graphic in the terminal interface display area. Result item.
The system according to any one of claims 10 to 14, wherein the element comprises at least one of a character, a picture and a symbol.
A computer program comprising computer readable code, when the computer readable code is run on a computing device, causing the computing device to perform the terminal based interface touch according to any one of claims 1-9 The method of performing a search.
A computer readable medium storing the computer program of claim 19.