CN104778194A - Search method and device based on touch operation - Google Patents
Search method and device based on touch operation Download PDFInfo
- Publication number
- CN104778194A CN104778194A CN201410826801.3A CN201410826801A CN104778194A CN 104778194 A CN104778194 A CN 104778194A CN 201410826801 A CN201410826801 A CN 201410826801A CN 104778194 A CN104778194 A CN 104778194A
- Authority
- CN
- China
- Prior art keywords
- touch
- content
- searched
- search
- touch operation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides a search method and a search device based on touch operation, which mainly relates to the field of information search techniques and mainly aims to provide a technical scheme of quickly inputting and searching to-be-searched words. The method comprises the steps of obtaining a screen shooting picture corresponding to screen shooting operation and generating a touch search interface with same contents as the screen shooting picture according to the screen shooting picture when the screen shooting operation of a user is detected; receiving touch operation of the user for selecting to-be-searched contents from at least one part of the contents through the touch search interface; determining the to-be-searched contents according to the touch operation; searching by using the to-be-searched contents. According to the search method, the user does not need to perform complex operation of starting a search app and pasting shorn or copied contents in a search column of the search app, so as to be quick and convenient; the contents of the screen shooting picture are kept on the touch search interface, so that the user can conveniently select the to-be-searched contents on the touch search interface, so as to be quick and accurate.
Description
Technical field
The present invention relates to information search technique field, in particular to a kind of searching method based on touch operation and device.
Background technology
At present, search service has been applied on mobile terminal, such as, smart mobile phone has often been installed various search app (application program) for searching for.
Search service on existing mobile terminal, all inputs based on search column.And due to the touch-screen input not problem easily of the mobile terminals such as smart mobile phone, cause the non-constant of search experience, efficiency is very low.Especially when user has various instant search need when using mobile phone based on the character on screen, image etc., then opening search app, ejecting in search column and inputting again, very not convenient.
Summary of the invention
In view of the above problems, the present invention is proposed to provide a kind of overcoming the problems referred to above or the searching method based on touch operation solved the problem at least in part and device.
According to one aspect of the present invention, provide a kind of searching method based on touch operation, it comprises: when detecting that user carries out screenshotss operation, obtain the screenshot picture that the operation of described screenshotss is corresponding, and generate the touch search interface with described screenshot picture with identical content according to described screenshot picture; Receive the touch operation carrying out content choice to be searched at least partially to described content that described user is undertaken by described touch search interface; Described content to be searched is determined according to described touch operation; Described content to be searched is used to search for.
Alternatively, aforesaid method, the touch search interface with described screenshot picture with identical content is generated according to described screenshot picture, also comprise: described touch search interface is set to translucent mode, and cover formation illiteracy plate in current display area, show through described touch search interface to make the content of described current display area.
Alternatively, aforesaid method, determines described content to be searched according to described touch operation, specifically comprises: the touch area corresponding according to described touch operation, and described touch search interface is selected the region comprising described content to be searched; Content in the described region comprising described content to be searched is identified, determines described content to be searched according to recognition result.
Alternatively, aforesaid method, before determining described content to be searched according to described touch operation, also comprise: the display mode changing touch area corresponding to described touch operation and/or non-touch area, so that described touch area and described non-touch area are distinguished.
Alternatively, aforesaid method, uses described content to be searched to search for, specifically comprises: call the mounted application program for searching for and perform search, and show the Search Results of described application program.
Alternatively, aforesaid method, call the mounted application program for searching for and perform search, and show the Search Results of described application program, specifically comprise: remove described touch search interface from described current display area, and show the interface of described application program, described content to be searched and described Search Results are presented on described interface.
Alternatively, aforesaid method, described content to be searched comprises following at least one: word, picture, symbol.
According to another aspect of the present invention, additionally provide a kind of searcher based on touch operation, it comprises: touch search interface generation module, for when detecting that user carries out screenshotss operation, obtain the screenshot picture that the operation of described screenshotss is corresponding, and generate the touch search interface with described screenshot picture with identical content according to described screenshot picture; Touch operation receiver module, for receiving the touch operation carrying out content choice to be searched at least partially to described content that described user is undertaken by described touch search interface; Content determination module to be searched, for determining described content to be searched according to described touch operation; Search module, searches for for using described content to be searched.
Alternatively, aforesaid device, described touch search interface is set to translucent mode by described touch search interface generation module, and covers formation illiteracy plate in current display area, shows through described touch search interface to make the content of described current display area.
Alternatively, aforesaid device, the touch area that described content determination module to be searched is corresponding according to described touch operation, described touch search interface is selected the region comprising described content to be searched, and the content in the described region comprising described content to be searched is identified, determine described content to be searched according to recognition result.
Alternatively, aforesaid device, also comprises: display mode changes module, for changing the display mode of touch area corresponding to described touch operation and/or non-touch area, to be distinguished in described touch area and described non-touch area.
Alternatively, aforesaid device, described search module calls the mounted application program for searching for and performs search, and shows the Search Results of described application program.
Alternatively, aforesaid device, described search module removes described touch search interface from described current display area, and shows the interface of described application program, described content to be searched and described Search Results is presented on described interface.
Alternatively, aforesaid device, described content to be searched comprises following at least one: word, picture, symbol.
According to a large amount of experience, the operations such as user carries out copying on the mobile terminals such as mobile phone, shearing, normally in order to the word, image etc. that will shear or copy is as content to be searched, to be copied in the search column in search app interface, then perform search operation; According to technical scheme of the present invention, when detecting that user carries out shot operation, automatically provide touch search interface according to the picture intercepted for user, fast select content to be searched to go forward side by side line search exactly for user; The medium loaded down with trivial details operation of search column that user carries out opening search app, the content sheared or copy pasted search app is not needed in this process, fast convenient; Touch content search interface remaining sectional drawing, facilitate user at touch search interface in the selection carrying out content to be searched, fast and accurately.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of instructions, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 shows the process flow diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 2 A shows the operating diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 2 B shows the operating diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 2 C shows the operating diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 2 D shows the operating diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 3 shows the process flow diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 4 shows the operating diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 5 shows the process flow diagram of the searching method based on touch operation according to an embodiment of the invention;
Fig. 6 shows the block diagram of the searcher based on touch operation according to an embodiment of the invention.
Embodiment
Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
As shown in Figure 1, An embodiment provides a kind of searching method based on touch operation, it comprises:
Step 110, when detecting that user carries out screenshotss operation, obtaining the screenshot picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Step 120, receives the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.
User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Step 130, determines content to be searched according to touch operation.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, generate selected zone picture according to the touch area obtained based on touch operation, then the elemental recognitions such as characters/graphic are carried out to selected zone picture.Here to identifying that from picture the method for the elements such as characters/graphic does not limit; Such as, picture OCR (Optical Character Recognition, optical character identification) recognition technology, that is, backstage is identified by OCR and extract Word message from picture; Again such as, UiAutomator automatization testing technique: UiAutomator is that android carries automated test tool, can be used for extracting current page text message, and this technology can obtain 100% correct word.There is different applicable scenes in each recognition technology, wherein, if UiAutomator and OCR identifies identical content, represent this content accuracy very strong, so determine content to be searched by the common factor calculating UiAutomator and OCR recognition result, greatly can improve recognition accuracy.
Step 140, uses content to be searched to search for.
This step comprise further trigger according to user carry out the instruction of searching for based on content to be searched, initiate the searching request of carrying content to be searched.Described searching request further can by having adjusted the search module (search modules in such as 360 bodyguards) in mounted application for searching for (such as 360 search for app) or a certain application, described content to be searched is issued described application, treat search content search by the search module of described application or function, and provide Search Results and be shown to user.
According to the technical scheme of the present embodiment, do not need to open search app when user searches for, in search column, input word to be searched, word to be searched is pasted in search column, the troublesome operation such as triggering searches; In the present embodiment, when detecting that user carries out shot operation, automatically for user provides touch search interface, fast select content to be searched to go forward side by side line search exactly for user, save above-mentioned troublesome operation, fast convenient; Touch content search interface remaining sectional drawing, facilitate user at touch search interface in the selection carrying out content to be searched, fast and accurately, solving existing part searches app can only copying whole section content and can not the drawback of precise search single word or certain several discrete vocabulary, improves and chooses word accuracy to be searched.
According to Fig. 1, user uses mobile phone to carry out sectional drawing to its desktop; When backstage detects the shot operation of user, generate touch operation interface according to sectional drawing, touch operation interface is for floating layer or cover plate form, display state is translucent or gray scale, the content in corresponding sectional drawing can be shown, each icon on such as desktop and title, specifically as shown in Figure 2 A; User carries out touch operation on touch operation interface, and the region that touch operation slides over, as shown in curve wire frame in Fig. 2 B, selects the word touched as content to be searched in the intention of known user; Based on aforesaid pattern recognition technique, identify content to be searched for " 360 video display are complete works of "; Then use " 360 video display are complete works of " to search for, Search Results as shown in Figure 2 C.Realize fast choosing content and searching for by above-mentioned touch interactive mode, improve the overall interactive experience of user search completely.The present embodiment is applied to the mobile terminal of band touch-screen.
Additionally provide a kind of searching method based on touch operation in one embodiment of the present of invention, compared to aforesaid embodiment, in the searching method of the present embodiment, step 110, also comprises:
Touch search interface is set to translucent mode, and covers formation illiteracy plate in current display area, show through touch search interface to make the content of current display area.According to the technical scheme of the present embodiment, translucent touch operation interface is as illiteracy plate, user can either be made to see the change of current display area clearly, the content at touch operation interface can be seen again clearly, thus on touch operation interface, carry out the touch operation meeting user intent.Further, illiteracy plate can also be shown with gray scale mode, this is in order to distinguish the display interface at touch operation interface and intercepting, shows that current is carry out touch operation to touch operation interface to user.Such as, the touch operation interface of display shown in Fig. 2 A, just can be set to translucent form.
Additionally provide a kind of searching method based on touch operation in one embodiment of the present of invention, compared to aforesaid embodiment, in the searching method of the present embodiment, before step 130, also comprise:
Change the display mode of touch area corresponding to touch operation and/or non-touch area, to be distinguished in touch area and non-touch area.In the present embodiment, do not limit display mode, it comprises the change of brightness, color, contrast aspect.According to the technical scheme of the present embodiment, touch area and non-touch area are distinguished, is conducive to user and determines which content the touch operation of oneself has touched on earth.Such as, the user touch area according to Fig. 2 B, can realize effect as shown in Figure 2 D: highlighted display is carried out in user touch area; Non-touch area is obviously comparatively dark, is presented in figure 2d by oblique line effect.
As shown in Figure 3, An embodiment provides a kind of searching method based on touch operation, it comprises:
Step 310, when detecting that user carries out screenshotss operation, obtaining the picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Step 320, receives the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Step 330, the touch area corresponding according to touch operation, is touching region search interface being selected to comprise content to be searched.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, based on touch operation, extract limited region from touch operation interface and can obtain selected zone picture, identify based on aforesaid pattern recognition technique, can recognition effect be improved, further, the size comprising the region of content to be searched chosen should not be less than user touch area, such as, if it is inaccurate that user's finger touch operates the part of touching out, generating selected zone figure sector-meeting by touch area causes word can not the situation of complete acquisition, then based on user touch area, by certain for border extension threshold value, relative in strict accordance with touch area, the new selected zone picture that one bigger has just been had after border extension, the word of not complete for user touch can comprise by new selected zone picture, this addresses the problem user touch area word and obtain incomplete problem, ensure that the integrality of content obtaining to be searched.
Step 340, identifies the content comprised in the region of described content to be searched, determines content to be searched according to recognition result.
Step 350, uses content to be searched to search for.
This step comprise further trigger according to user carry out the instruction of searching for based on content to be searched, initiate the searching request of carrying content to be searched.Described searching request further can by having adjusted the search module (search modules in such as 360 bodyguards) in mounted application for searching for (such as 360 search for app) or a certain application, described content to be searched is issued described application, treat search content search by the search module of described application or function, and provide Search Results and be shown to user.
In conjunction with aforesaid embodiment, in Fig. 2 B, curve wire frame illustrates user touch area, then based on OCR recognition technology, the region the comprising content to be searched rectangle as shown in Figure 4 selected from touch operation interface, carries out sectional drawing to this rectangular area and carries out the word to be searched that figure identification obtains " 360 video display are complete works of "; It should be noted that, the information of user touch area not complete covering " 360 video display are complete works of ", so do not determine the length and width of rectangular area to be identified in the present embodiment in strict accordance with touch area, but carried out certain expansion, obtain the complete rectangular area containing " 360 video display are complete works of ".
In one embodiment of the invention, the recognition strategy touching word according to predetermined line feed identifies word in the sectional drawing that the region comprising content to be searched is corresponding, and this strategy is mainly used in word that user wants to touch out respectively in the mechanism of two row.Owing to touching, word identification mainly identifies on the border (left and right is (x, y) four points up and down) of the pixel covering the similar rectangle highlight regions that plate produces based on user's finger sliding.If but text belongs to two row, finger sliding twice, also still can according to upper and lower four pixels about twice merging back zone, the scope that such four pixels are irised out is just much bigger than finger sliding twice highlight regions, just make not have accurate on highlighted word, therefore the method solved is: consider that their registration height of word this twice is touched in line feed, if registration is very low by (such as less than 30%, threshold value can regulate again), just identify respectively as two sectional drawings, which improves precise degrees.
As shown in Figure 5, An embodiment provides a kind of searching method based on touch operation, it comprises:
Step 510, when detecting that user carries out screenshotss operation, obtaining the screenshot picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Step 520, receives the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.
User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Step 530, determines content to be searched according to touch operation.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, generate selected zone picture according to the touch area obtained based on touch operation, then the elemental recognitions such as characters/graphic are carried out to selected zone picture.Here to identifying that from picture the method for the elements such as characters/graphic does not limit; Such as, picture OCR (Optical Character Recognition, optical character identification) recognition technology, that is, backstage is identified by OCR and extract Word message from picture; Again such as, UiAutomator automatization testing technique: UiAutomator is that android carries automated test tool, can be used for extracting current page text message, and this technology can obtain 100% correct word.There is different applicable scenes in each recognition technology, wherein, if UiAutomator and OCR identifies identical content, represent this content accuracy very strong, so determine content to be searched by the common factor calculating UiAutomator and OCR recognition result, greatly can improve recognition accuracy.
Step 540, calls the mounted application program for searching for and performs search, and the Search Results of display application program.According to the technical scheme of the present embodiment, achieving the Automatically invoked to installing search app, not needing to open search app when avoiding user to search for, in search column, inputting word to be searched, word to be searched is pasted in search column, the troublesome operation such as triggering searches; In another embodiment, also can never call and app is installed, but will multiple Process Designs of search be comprised for be realized by an independent app.Such as, the Search Results shown in Fig. 2 C is exactly that " 360 " search of having installed in calling mobile phone realizes.
A kind of searching method based on touch operation is additionally provided in one embodiment of the present of invention, compared to aforesaid embodiment, in the searching method of the present embodiment, step 540, specifically comprise: remove from current display area and touch search interface, and the interface of display application program, content to be searched and Search Results are presented on interface.According to the technical scheme of the present embodiment, search interface will be touched in time and remove, be conducive to saving resource consumption, and avoid touching search interface carries out other operations interference to user.
As shown in Figure 6, An embodiment provides a kind of searcher based on touch operation, it comprises:
Touch search interface generation module 610, for when detecting that user carries out screenshotss operation, obtaining the screenshot picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Touch operation receiver module 620, for receiving the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.
User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Content determination module 630 to be searched, for determining content to be searched according to touch operation.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, generate selected zone picture according to the touch area obtained based on touch operation, then the elemental recognitions such as characters/graphic are carried out to selected zone picture.Here to identifying that from picture the method for the elements such as characters/graphic does not limit; Such as, picture OCR (Optical Character Recognition, optical character identification) recognition technology, that is, backstage is identified by OCR and extract Word message from picture; Again such as, UiAutomator automatization testing technique: UiAutomator is that android carries automated test tool, can be used for extracting current page text message, and this technology can obtain 100% correct word.There is different applicable scenes in each recognition technology, wherein, if UiAutomator and OCR identifies identical content, represent this content accuracy very strong, so determine content to be searched by the common factor calculating UiAutomator and OCR recognition result, greatly can improve recognition accuracy.
Search module 640, searches for for using content to be searched.
This step comprise further trigger according to user carry out the instruction of searching for based on content to be searched, initiate the searching request of carrying content to be searched.Described searching request further can by having adjusted the search module (search modules in such as 360 bodyguards) in mounted application for searching for (such as 360 search for app) or a certain application, described content to be searched is issued described application, treat search content search by the search module of described application or function, and provide Search Results and be shown to user.
According to the technical scheme of the present embodiment, do not need to open search app when user searches for, in search column, input word to be searched, word to be searched is pasted in search column, the troublesome operation such as triggering searches; In the present embodiment, when detecting that user carries out shot operation, automatically for user provides touch search interface, fast select content to be searched to go forward side by side line search exactly for user, save above-mentioned troublesome operation, fast convenient; Touch content search interface remaining sectional drawing, facilitate user at touch search interface in the selection carrying out content to be searched, fast and accurately, solving existing part searches app can only copying whole section content and can not the drawback of precise search single word or certain several discrete vocabulary, improves and chooses word accuracy to be searched.
According to Fig. 6, user uses mobile phone to carry out sectional drawing to its desktop; When backstage detects the shot operation of user, generate touch operation interface according to sectional drawing, touch operation interface is for floating layer or cover plate form, display state is translucent or gray scale, the content in corresponding sectional drawing can be shown, each icon on such as desktop and title, specifically as shown in Figure 2 A; User carries out touch operation on touch operation interface, and the region that touch operation slides over, as shown in curve wire frame in Fig. 2 B, selects the word touched as content to be searched in the intention of known user; Based on aforesaid pattern recognition technique, identify content to be searched for " 360 video display are complete works of "; Then use " 360 video display are complete works of " to search for, Search Results as shown in Figure 2 C.Realize fast choosing content and searching for by above-mentioned touch interactive mode, improve the overall interactive experience of user search completely.The present embodiment is applied to the mobile terminal of band touch-screen.
A kind of searcher based on touch operation is additionally provided in one embodiment of the present of invention, compared to aforesaid embodiment, in the searcher of the present embodiment, touch search interface generation module 610 and touch search interface is set to translucent mode, and cover formation illiteracy plate in current display area, show through touch search interface to make the content of current display area.According to the technical scheme of the present embodiment, translucent touch operation interface is as illiteracy plate, user can either be made to see the change of current display area clearly, the content at touch operation interface can be seen again clearly, thus on touch operation interface, carry out the touch operation meeting user intent.Further, illiteracy plate can also be shown with gray scale mode, this is in order to distinguish the display interface at touch operation interface and intercepting, shows that current is carry out touch operation to touch operation interface to user.Such as, the touch operation interface of display shown in Fig. 2 A, just can be set to translucent form.
Additionally provide a kind of searcher based on touch operation in one embodiment of the present of invention, compared to aforesaid embodiment, in the searcher of the present embodiment, also comprise:
Display mode changes module, for changing the display mode of touch area corresponding to touch operation and/or non-touch area, to be distinguished in touch area and non-touch area.In the present embodiment, do not limit display mode, it comprises the change of brightness, color, contrast aspect.According to the technical scheme of the present embodiment, touch area and non-touch area are distinguished, is conducive to user and determines which content the touch operation of oneself has touched on earth.Such as, the user touch area according to Fig. 2 B, can realize effect as shown in Figure 2 D: highlighted display is carried out in user touch area; Non-touch area is obviously comparatively dark, is presented in figure 2d by oblique line effect.
An embodiment provides a kind of searcher based on touch operation, it comprises:
Touch search interface generation module 610, for when detecting that user carries out screenshotss operation, obtaining the screenshot picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Touch operation receiver module 620, for receiving the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.
User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Content determination module 630 to be searched, for the touch area corresponding according to touch operation, touch region search interface being selected to comprise content to be searched, and the content comprised in the region of described content to be searched is being identified, determine content to be searched according to recognition result.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, based on touch operation, extract limited region from touch operation interface and can obtain selected zone picture, identify based on aforesaid pattern recognition technique, can recognition effect be improved, further, the size comprising the region of content to be searched chosen should not be less than user touch area, such as, if it is inaccurate that user's finger touch operates the part of touching out, generating selected zone figure sector-meeting by touch area causes word can not the situation of complete acquisition, then based on user touch area, by certain for border extension threshold value, relative in strict accordance with touch area, the new selected zone picture that one bigger has just been had after border extension, the word of not complete for user touch can comprise by new selected zone picture, this addresses the problem user touch area word and obtain incomplete problem, ensure that the integrality of content obtaining to be searched.
Search module 640, searches for for using content to be searched.
This step comprise further trigger according to user carry out the instruction of searching for based on content to be searched, initiate the searching request of carrying content to be searched.Described searching request further can by having adjusted the search module (search modules in such as 360 bodyguards) in mounted application for searching for (such as 360 search for app) or a certain application, described content to be searched is issued described application, treat search content search by the search module of described application or function, and provide Search Results and be shown to user.
In conjunction with aforesaid embodiment, in Fig. 2 B, curve wire frame illustrates user touch area, then based on OCR recognition technology, the region the comprising content to be searched rectangle as shown in Figure 4 selected from touch operation interface, carries out sectional drawing to this rectangular area and carries out the word to be searched that figure identification obtains " 360 video display are complete works of "; It should be noted that, the information of user touch area not complete covering " 360 video display are complete works of ", so do not determine the length and width of rectangular area to be identified in the present embodiment in strict accordance with touch area, but carried out certain expansion, obtain the complete rectangular area containing " 360 video display are complete works of ".
In one embodiment of the invention, the recognition strategy touching word according to predetermined line feed identifies word in the sectional drawing that the region comprising content to be searched is corresponding, and this strategy is mainly used in word that user wants to touch out respectively in the mechanism of two row.Owing to touching, word identification mainly identifies on the border (left and right is (x, y) four points up and down) of the pixel covering the similar rectangle highlight regions that plate produces based on user's finger sliding.If but text belongs to two row, finger sliding twice, also still can according to upper and lower four pixels about twice merging back zone, the scope that such four pixels are irised out is just much bigger than finger sliding twice highlight regions, just make not have accurate on highlighted word, therefore the method solved is: consider that their registration height of word this twice is touched in line feed, if registration is very low by (such as less than 30%, threshold value can regulate again), just identify respectively as two sectional drawings, which improves precise degrees.
An embodiment provides a kind of searcher based on touch operation, it comprises:
Touch search interface generation module 610, for when detecting that user carries out screenshotss operation, obtaining the screenshot picture that screenshotss operation is corresponding, and generating the touch search interface with screenshot picture with identical content according to screenshot picture.
In the present embodiment, the mode for the detection sectional drawing of different systems employing is also different, for Android system, can directly be operated by the FileObserver services listen system screenshotss of Android system.The present invention is not limited to Andriod system, can contain in other operating systems.
Sectional drawing may be for certain webpage, may be the picture for certain animation, may be certain the frequency image for video, it may be the application interface for certain app, may be the system desktop for terminal or operation interface, may be the picture in the picture library of user or photo, etc.Further, content to be searched comprises following at least one: word, picture, symbol.
Described touch search interface represents with the layer generated or eject or floating window shape formula, can receive the touch operation of user to identify touch area.
Touch operation receiver module 620, for receiving the touch operation carrying out content choice to be searched at least partially to content that user is undertaken by touching search interface.
User's touch operation can comprise and clicks or slide, and described touch search interface responds based on user's touch operation, and indicates touch area in modes such as different colors, wire frames.
Content determination module 630 to be searched, for determining content to be searched according to touch operation.
In the present embodiment, described touch search interface receives user's touch operation and carries out touch area mark at least partially to foregoing, and described touch area is as the basis identifying content to be searched.
In the present embodiment, generate selected zone picture according to the touch area obtained based on touch operation, then the elemental recognitions such as characters/graphic are carried out to selected zone picture.Here to identifying that from picture the method for the elements such as characters/graphic does not limit; Such as, picture OCR (Optical Character Recognition, optical character identification) recognition technology, that is, backstage is identified by OCR and extract Word message from picture; Again such as, UiAutomator automatization testing technique: UiAutomator is that android carries automated test tool, can be used for extracting current page text message, and this technology can obtain 100% correct word.There is different applicable scenes in each recognition technology, wherein, if UiAutomator and OCR identifies identical content, represent this content accuracy very strong, so determine content to be searched by the common factor calculating UiAutomator and OCR recognition result, greatly can improve recognition accuracy.
Search module 640, performs search for calling the mounted application program for searching for, and the Search Results of display application program.According to the technical scheme of the present embodiment, achieving the Automatically invoked to installing search app, not needing to open search app when avoiding user to search for, in search column, inputting word to be searched, word to be searched is pasted in search column, the troublesome operation such as triggering searches; In another embodiment, also can never call and app is installed, but will multiple Process Designs of search be comprised for be realized by an independent app.Such as, the Search Results shown in Fig. 2 C is exactly that " 360 " search of having installed in calling mobile phone realizes.
A kind of searcher based on touch operation is additionally provided in one embodiment of the present of invention, compared to aforesaid embodiment, in the searcher of the present embodiment, search module 640 specifically comprises: remove from current display area and touch search interface, and the interface of display application program, content to be searched and Search Results are presented on interface.According to the technical scheme of the present embodiment, search interface will be touched in time and remove, be conducive to saving resource consumption, and avoid touching search interface carries out other operations interference to user.
Intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with display at this algorithm provided.Various general-purpose system also can with use based on together with this teaching.According to description above, the structure constructed required by this type systematic is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.
In instructions provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as claims below reflect, all features of disclosed single embodiment before inventive aspect is to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the equipment in embodiment and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or unit be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) can by providing identical, alternative features that is equivalent or similar object replaces.
In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in the following claims, the one of any of embodiment required for protection can use with arbitrary array mode.
All parts embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions based on the some or all parts in the searcher of touch operation that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the embodiment of the present invention.The present invention can also be embodied as part or all equipment for performing method as described herein or device program (such as, computer program and computer program).Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.
The present invention will be described instead of limit the invention to it should be noted above-described embodiment, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and does not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computing machine of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order.Can be title by these word explanations.
Claims (10)
1., based on a searching method for touch operation, it comprises:
When detecting that user carries out screenshotss operation, obtaining the screenshot picture that the operation of described screenshotss is corresponding, and generating the touch search interface with described screenshot picture with identical content;
Receive the touch operation carrying out content choice to be searched at least partially to described content that described user is undertaken by described touch search interface;
Described content to be searched is determined according to described touch operation;
Described content to be searched is used to search for.
2. method according to claim 1, wherein, generates the touch search interface with described screenshot picture with identical content, also comprises according to described screenshot picture:
Described touch search interface is set to translucent mode, and covers formation illiteracy plate in current display area, show through described touch search interface to make the content of described current display area.
3. the method according to any one of claim 1-2, wherein, determine described content to be searched according to described touch operation, specifically comprise:
The touch area corresponding according to described touch operation, described touch search interface is selected the region comprising described content to be searched;
Content in the described region comprising described content to be searched is identified, determines described content to be searched according to recognition result.
4. the method according to any one of claim 1-3, wherein, before determining described content to be searched according to described touch operation, also comprises:
Change the display mode of touch area corresponding to described touch operation and/or non-touch area, to be distinguished in described touch area and described non-touch area.
5. the method according to any one of claim 1-4, wherein, uses described content to be searched to search for, specifically comprises:
Call the mounted application program for searching for and perform search, and show the Search Results of described application program.
6. the method according to any one of claim 1-5, wherein, call the mounted application program for searching for and perform search, and show the Search Results of described application program, specifically comprise:
Remove described touch search interface from described current display area, and show the interface of described application program, described content to be searched and described Search Results are presented on described interface.
7. according to the method for any one of claim 1-6, wherein, described content to be searched comprises following at least one:
Word, picture, symbol.
8., based on a searcher for touch operation, it comprises:
Touch search interface generation module, for when detecting that user carries out screenshotss operation, obtaining the screenshot picture that the operation of described screenshotss is corresponding, and generating the touch search interface with described screenshot picture with identical content according to described screenshot picture;
Touch operation receiver module, for receiving the touch operation carrying out content choice to be searched at least partially to described content that described user is undertaken by described touch search interface;
Content determination module to be searched, for determining described content to be searched according to described touch operation;
Search module, searches for for using described content to be searched.
9. device according to claim 8, wherein,
Described touch search interface is set to translucent mode by described touch search interface generation module, and covers formation illiteracy plate in current display area, shows through described touch search interface to make the content of described current display area.
10. the device according to Claim 8 described in-9 any one, wherein,
The touch area that described content determination module to be searched is corresponding according to described touch operation, described touch search interface is selected the region comprising described content to be searched, and the content in the described region comprising described content to be searched is identified, determine described content to be searched according to recognition result.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410826801.3A CN104778194A (en) | 2014-12-26 | 2014-12-26 | Search method and device based on touch operation |
| PCT/CN2015/095863 WO2016101768A1 (en) | 2014-12-26 | 2015-11-27 | Terminal and touch operation-based search method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410826801.3A CN104778194A (en) | 2014-12-26 | 2014-12-26 | Search method and device based on touch operation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104778194A true CN104778194A (en) | 2015-07-15 |
Family
ID=53619660
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410826801.3A Pending CN104778194A (en) | 2014-12-26 | 2014-12-26 | Search method and device based on touch operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104778194A (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104516632A (en) * | 2014-12-30 | 2015-04-15 | 北京奇虎科技有限公司 | Method and device for determining touch characters for search |
| CN105224674A (en) * | 2015-10-16 | 2016-01-06 | 惠州Tcl移动通信有限公司 | A kind of intelligent search method based on mobile device and system |
| CN105354207A (en) * | 2015-09-02 | 2016-02-24 | 百度在线网络技术（北京）有限公司 | Search method and system for pictures in webpage |
| CN105653193A (en) * | 2015-12-31 | 2016-06-08 | 宇龙计算机通信科技(深圳)有限公司 | Searching method and terminal |
| WO2016101768A1 (en) * | 2014-12-26 | 2016-06-30 | 北京奇虎科技有限公司 | Terminal and touch operation-based search method and device |
| CN105824552A (en) * | 2015-07-29 | 2016-08-03 | 维沃移动通信有限公司 | Text information recognition method and device |
| WO2017078632A1 (en) * | 2015-11-05 | 2017-05-11 | Punyagupta Napone | Methods for processing information based on content being displayed by computing device, and systems and devices for processing information based on content being displayed by computing device |
| CN106814964A (en) * | 2016-12-19 | 2017-06-09 | 广东小天才科技有限公司 | A kind of method and content search device that content search is carried out in mobile terminal |
| CN106897291A (en) * | 2015-12-18 | 2017-06-27 | 北京奇虎科技有限公司 | Searching method and device based on screenshotss operation |
| CN107025304A (en) * | 2017-04-27 | 2017-08-08 | 福建中金在线信息科技有限公司 | A kind of searching method and device |
| CN109002759A (en) * | 2018-06-07 | 2018-12-14 | Oppo广东移动通信有限公司 | text recognition method, device, mobile terminal and storage medium |
| WO2024012415A1 (en) * | 2022-07-13 | 2024-01-18 | 华为技术有限公司 | Text excerpting method and related device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130174023A1 (en) * | 2011-12-30 | 2013-07-04 | Microsoft Corporation | Presentation of rich search results in delineated areas |
| CN103455590A (en) * | 2013-08-29 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Method and device for retrieving in touch-screen device |
| CN104239313A (en) * | 2013-06-09 | 2014-12-24 | 百度在线网络技术（北京）有限公司 | Method for searching for characters displayed in screen and based on mobile terminal and mobile terminal |
-
2014
- 2014-12-26 CN CN201410826801.3A patent/CN104778194A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130174023A1 (en) * | 2011-12-30 | 2013-07-04 | Microsoft Corporation | Presentation of rich search results in delineated areas |
| CN104239313A (en) * | 2013-06-09 | 2014-12-24 | 百度在线网络技术（北京）有限公司 | Method for searching for characters displayed in screen and based on mobile terminal and mobile terminal |
| CN103455590A (en) * | 2013-08-29 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Method and device for retrieving in touch-screen device |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016101768A1 (en) * | 2014-12-26 | 2016-06-30 | 北京奇虎科技有限公司 | Terminal and touch operation-based search method and device |
| CN104516632A (en) * | 2014-12-30 | 2015-04-15 | 北京奇虎科技有限公司 | Method and device for determining touch characters for search |
| CN105824552B (en) * | 2015-07-29 | 2019-05-17 | 维沃移动通信有限公司 | A kind of recognition methods of text information and device |
| CN105824552A (en) * | 2015-07-29 | 2016-08-03 | 维沃移动通信有限公司 | Text information recognition method and device |
| CN105354207B (en) * | 2015-09-02 | 2019-05-03 | 百度在线网络技术（北京）有限公司 | The searching method and system of picture in webpage |
| CN105354207A (en) * | 2015-09-02 | 2016-02-24 | 百度在线网络技术（北京）有限公司 | Search method and system for pictures in webpage |
| CN105224674B (en) * | 2015-10-16 | 2019-03-26 | 惠州Tcl移动通信有限公司 | A kind of mobile device-based intelligent search method and system |
| CN105224674A (en) * | 2015-10-16 | 2016-01-06 | 惠州Tcl移动通信有限公司 | A kind of intelligent search method based on mobile device and system |
| US10606900B2 (en) | 2015-10-16 | 2020-03-31 | Huizhou Tcl Mobile Communication Co., Ltd. | Intelligent searching method and system based on mobile device |
| WO2017078632A1 (en) * | 2015-11-05 | 2017-05-11 | Punyagupta Napone | Methods for processing information based on content being displayed by computing device, and systems and devices for processing information based on content being displayed by computing device |
| CN106897291A (en) * | 2015-12-18 | 2017-06-27 | 北京奇虎科技有限公司 | Searching method and device based on screenshotss operation |
| CN106897291B (en) * | 2015-12-18 | 2020-10-02 | 北京奇虎科技有限公司 | Searching method and device based on screen capture operation |
| CN105653193A (en) * | 2015-12-31 | 2016-06-08 | 宇龙计算机通信科技(深圳)有限公司 | Searching method and terminal |
| CN106814964A (en) * | 2016-12-19 | 2017-06-09 | 广东小天才科技有限公司 | A kind of method and content search device that content search is carried out in mobile terminal |
| CN107025304A (en) * | 2017-04-27 | 2017-08-08 | 福建中金在线信息科技有限公司 | A kind of searching method and device |
| CN109002759A (en) * | 2018-06-07 | 2018-12-14 | Oppo广东移动通信有限公司 | text recognition method, device, mobile terminal and storage medium |
| WO2024012415A1 (en) * | 2022-07-13 | 2024-01-18 | 华为技术有限公司 | Text excerpting method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104778194A (en) | Search method and device based on touch operation | |
| CN104778195A (en) | Terminal and touch operation-based searching method | |
| US10489047B2 (en) | Text processing method and device | |
| EP3407221B1 (en) | Methods and devices for searching and displaying information on a terminal | |
| US10496267B2 (en) | Operation method and terminal device | |
| CN105786930A (en) | Touch interaction based search method and apparatus | |
| CN104731509A (en) | Searching method and device based on touch operation and terminal | |
| CN104462437A (en) | Recognizing and searching method and recognizing and searching system based on repeated touch operations of interface of terminal | |
| US20170139575A1 (en) | Data entering method and terminal | |
| CN103500066A (en) | Screenshot device and method suitable for touch screen devices | |
| CN104536995A (en) | Method and system both for searching based on terminal interface touch operation | |
| CN105786294A (en) | Page access path return method and apparatus | |
| CN104537051A (en) | Terminal and searching method based on touch operation | |
| CN104869469A (en) | Method and apparatus for displaying program contents | |
| CN107220377B (en) | Search method, electronic device, and computer storage medium | |
| CN109359582A (en) | Information search method, information search device and mobile terminal | |
| CN107015722A (en) | page display method and device | |
| CN111897607A (en) | Application interface loading and interaction method, device and storage medium | |
| CN106970899B (en) | Text processing method and device | |
| CN104536688A (en) | Searching method and device based on touch operation | |
| CN104503679A (en) | Searching method and searching device based on terminal interface touch operation | |
| CN105094668B (en) | Information processing method and electronic equipment | |
| CN104915138A (en) | Information processing method and electronic equipment | |
| CN113342222B (en) | Application classification method and device and electronic equipment | |
| CN104407763A (en) | Content input method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150715 |