CN108595107A - A kind of interface content processing method and mobile terminal - Google Patents
A kind of interface content processing method and mobile terminal Download PDFInfo
- Publication number
- CN108595107A CN108595107A CN201810409053.7A CN201810409053A CN108595107A CN 108595107 A CN108595107 A CN 108595107A CN 201810409053 A CN201810409053 A CN 201810409053A CN 108595107 A CN108595107 A CN 108595107A
- Authority
- CN
- China
- Prior art keywords
- content
- sub
- target
- mobile terminal
- search result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
Abstract
A kind of interface content processing method of present invention offer and mobile terminal, this method are applied to mobile terminal, including：If receiving the preset touch operation to the target location of the mobile terminal display interface, judges whether the content shown by the corresponding target widget in the target location is supported to replicate and operate；It is operated if it is determined that the content shown by the corresponding target widget in the target location is not supported to replicate, then obtains the screenshotss image of the display interface, and by the Content Transformation in the screenshotss image at editable content；Some or all of extract in the editable content content.Due to when display interface is not supported to replicate and be operated, the screenshotss image of acquisition display interface can be passed through, and by the Content Transformation in screenshotss image at editable content, to realize the extraction to the content in display interface, so as to keep the interface content extractability of mobile terminal more preferable.
Description
Technical field
The present invention relates to field of communication technology more particularly to a kind of interface content processing method and mobile terminals.
Background technology
It is universal with mobile terminal, in more and more people tend to obtain and oneself want by mobile terminal
Hold, it is interested in some when user carries out interface browsing (for example, web page browsing, electronic-book reading) on mobile terminals
For example peculiar appellation of content, historical personage or place etc. may want to extract, further to search for or to record.
Current mobile terminal usually provides user content copy function, i.e., is met during interface browses as user
When to oneself interested object content, object content can be extracted by being replicated in display interface.However, by multiple
The applicability for making the method for the object content to extract display interface is poor, is mainly reflected in：When display interface is multiple for content
Technology barrier is manufactured, i.e., when display interface is not supported to replicate, user can not just extract the object content on the interface.
In summary, since the method by replicating the object content to extract display interface is difficult to be suitable for display interface
The situation for not supporting copy function, it is poor so as to cause the interface content extractability of mobile terminal.
Invention content
A kind of interface content processing method of offer of the embodiment of the present invention and mobile terminal, to solve due to being carried by replicating
The method for taking the object content of display interface is difficult to be suitable for the situation that display interface does not support copy function, so as to cause movement
The poor problem of the interface content extractability of terminal.
In order to solve the above technical problems, the invention is realized in this way：
In a first aspect, an embodiment of the present invention provides a kind of interface content processing method, it is applied to mobile terminal, including：
If receiving the preset touch operation to the target location of the mobile terminal display interface, the target is judged
Whether the content shown by the corresponding target widget in position, which is supported to replicate, operates；
Operated if it is determined that the content shown by the corresponding target widget in the target location is not supported to replicate, then obtain described in
The screenshotss image of display interface, and by the Content Transformation in the screenshotss image at editable content；
Some or all of extract in the editable content content.
Second aspect, the embodiment of the present invention also provide a kind of mobile terminal, including：
Judgment module, if for receiving the preset touch operation to the target location of the mobile terminal display interface,
Then judge whether the content shown by the corresponding target widget in the target location is supported to replicate to operate；
Conversion module, for if it is determined that the content shown by the corresponding target widget in the target location is not supported to replicate behaviour
Make, then obtains the screenshotss image of the display interface, and by the Content Transformation in the screenshotss image at editable content；
Extraction module, for some or all of extracting in the editable content content.
The third aspect, the embodiment of the present invention also provide a kind of mobile terminal, including processor, memory and are stored in described
It is real when the computer program is executed by the processor on memory and the computer program that can run on the processor
The step of existing above-mentioned interface content processing method.
Fourth aspect, the embodiment of the present invention also provide a kind of computer readable storage medium, the computer-readable storage
Computer program is stored on medium, the computer program realizes above-mentioned interface content processing method when being executed by processor
Step.
It is as follows in the advantageous effects of the present invention：
In embodiments of the present invention, if receiving the preset touch operation to the target location of mobile terminal display interface,
Then judge whether the content shown by the corresponding target widget in the target location is supported to replicate to operate；If it is determined that the target position
It sets the content shown by corresponding target widget not support to replicate operation, then obtains the screenshotss image of the display interface, and will
Content Transformation in the screenshotss image is at editable content；In some or all of extracting in the editable content
Hold.In this way, due to when display interface is not supported to replicate and be operated, it can be by obtaining the screenshotss image of display interface, and will cut
Content Transformation in screen image is at editable content, to realize the extraction to the content in display interface, so as to make shifting
The interface content extractability of dynamic terminal is more preferable.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, needed in being described below to the embodiment of the present invention
Attached drawing to be used is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention,
For those of ordinary skill in the art, without having to pay creative labor, it can also obtain according to these attached drawings
Obtain other attached drawings.
Fig. 1 is the flow chart for the interface content processing method that one embodiment of the invention provides；
Fig. 2 is one of the exemplary graph for the interface content processing method that one embodiment of the invention provides；
Fig. 3 is the two of the exemplary graph for the interface content processing method that one embodiment of the invention provides；
Fig. 4 is the three of the exemplary graph for the interface content processing method that one embodiment of the invention provides；
Fig. 5 is the flow chart for the interface content processing method that another embodiment of the present invention provides；
Fig. 6 is one of the exemplary graph for the interface content processing method that another embodiment of the present invention provides；
Fig. 7 is the two of the exemplary graph for the interface content processing method that another embodiment of the present invention provides；
Fig. 8 is one of the structure chart of mobile terminal that one embodiment of the invention provides；
Fig. 9 is the two of the structure chart for the mobile terminal that one embodiment of the invention provides；
Figure 10 is the structure chart of the search module for the mobile terminal that one embodiment of the invention provides；
Figure 11 is the structure chart of the search submodule in the search module for the mobile terminal that one embodiment of the invention provides；
Figure 12 is the structure chart of the extraction module for the mobile terminal that one embodiment of the invention provides；
Figure 13 is the structure chart for the mobile terminal that another embodiment of the present invention provides.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained without creative efforts
Example, shall fall within the protection scope of the present invention.
As shown in Figure 1, a kind of interface content processing method, is applied to mobile terminal, includes the following steps：
If step 101 is received to the operation of the preset touch of the target location of the mobile terminal display interface, judge
Whether the content shown by the corresponding target widget in the target location, which is supported to replicate, operates；
Wherein, above-mentioned mobile terminal can be mobile phone, it is tablet computer (Tablet Personal Computer), on knee
Computer (Laptop Computer), personal digital assistant (personal digital assistant, abbreviation PDA), in movement
Net device (Mobile Internet Device, MID) or wearable device (Wearable Device) etc..
Above-mentioned preset touch operation can be clicking operation, double click operation or long press operation etc., when above-mentioned preset touch is grasped
When as long press operation, which can refer to that compressing time is more than the pressing behaviour of the general length of mobile terminal system temporally
Make.The above can be word, phonetic, letter, number, symbol or picture etc..
Whether the above-mentioned content judged shown by target widget, which is supported to replicate, operates, and can be the attribute according to target widget
Judge whether the content shown by target widget is supported to replicate to operate, for example, when the attribute of target widget includes text attribute,
Then determine that the content shown by target widget is supported to replicate operation；When the attribute of target widget does not include text attribute, then really
The content shown by control that sets the goal is not supported to replicate and be operated.Whether the above-mentioned content judged shown by target widget is supported to replicate
Operation can also be to execute to replicate operation to the content shown by target widget, when execution, which replicates, to be operated successfully, it is determined that mesh
The content shown by control is marked to support to replicate operation；When executing duplication operation failure, it is determined that interior shown by target widget
Appearance is not supported to replicate and be operated.
Step 102, if it is determined that the content shown by the corresponding target widget in the target location do not support replicate operate, then
The screenshotss image of the display interface is obtained, and by the Content Transformation in the screenshotss image at editable content；
Wherein, the screenshotss image of the above-mentioned acquisition display interface can directly acquire pre-existing display interface
Screenshotss image, and the screenshotss image of signified pre-existing display interface herein, can judge the target location pair
While whether the content shown by target widget answered is supported to replicate operation, the obtained screenshotss of screenshotss are carried out to display interface
Image.The screenshotss image of the above-mentioned acquisition display interface can also be to determine the corresponding target widget institute in the target location
The content of display is not supported after replicating the step of operating, and the screenshotss image obtained to display interface progress screenshotss is passed through.Its
In, the aforementioned time carried out needed for screenshotss to display interface can be less than the general length of mobile terminal system temporally.
The above-mentioned Content Transformation by the screenshotss image can pass through optical character identification at editable content
(Optical Character Recognition, abbreviation OCR) technology is by the Content Transformation in screenshotss image at editable interior
Hold.Above-mentioned editable content can refer to the selected content selected, be replicated, be sheared or be deleted.
In addition, however, it is determined that the content shown by the corresponding target widget in the target location supports to replicate operation, then directly
Replicate the content shown by the corresponding target widget in target location.
Content some or all of in step 103, the extraction editable content.
Wherein, said extracted can be replicated or shear etc..
It should be pointed out that can be deleted after content some or all of in the editable content described in said extracted
Except the screenshotss image, to achieve the effect that timely releasing memory, save memory space.
In this way, in embodiments of the present invention, it, can be by obtaining display interface when display interface, which is not supported to replicate, to be operated
Screenshotss image, and by the Content Transformation in screenshotss image at editable content, to realize to the content in display interface
Extraction, so as to keep the interface content extractability of mobile terminal more preferable.
Optionally, content some or all of in editable content described in said extracted, can be can according to user couple
The selection operation of content some or all of in the content of editor some or all of extracts in editable content content.
Wherein, it is above-mentioned according to user to the selection operation of content some or all of in editable content, extraction can compile
Content some or all of in the content collected, may be used following implementations：
After by the Content Transformation in the screenshotss image at editable content, editable content is subjected to branch
Frame selects mark to handle, and shows branch frame choosing mark treated editable content, then receives user to part or all of
The selection operation of marking frame extracts the editable content corresponding to the selected part or all of marking frame of user.For example, with
For the be shown as snapshot pictures of Fig. 2, first by the Content Transformation in screenshotss image shown in Fig. 2 at editable content, so
Editable content, which is carried out branch frame, afterwards selects mark to handle, and shows branch's frame choosing mark treated editable content
(the branch frame choosing mark through interface display treated editable content is as shown in Figure 3), then receives user in Fig. 3
The selection operation of part or all of marking frame, and extract the editable content corresponding to the selected marking frame of user.
Specifically, aforementioned user can be clicking operation to the selection operation of part or all of marking frame, for example, user is first
Part or all of marking frame is clicked to choose the editable content corresponding to the marking frame being clicked, then clicks confirming button
To complete selection；User can also be sliding plus clicking operation to the selection operation of part or all of marking frame, for example, user is first
Then slipper or whole marking frames click confirming button to choose the editable content corresponding to the marking frame slided
To complete selection.In addition, as shown in figure 3, user may also mean that user first clicks or slides to the selection operation of whole marking frames
Dynamic the complete of display interface that be suspended in selects button to choose the editable content corresponding to whole marking frames, then clicks determination and presses
Button is to complete to select.
Optionally, content some or all of in the extraction editable content, including：
If receiving the selection operation to the second object content in the editable content, by second target
Content splits into M sub- contents；
Show the M sub- contents；
Receive selection operation of the user to the sub- content in the M sub- contents；
Extract the selected sub- content of user in the M sub- contents；
Wherein, the M is positive integer.
Wherein, if receiving the selection operation to the second object content in the editable content, by described
Two object contents split into M sub- contents, if can receive user to the second object content pair in editable content
The second object content corresponding to second identifier frame is then split into M sub- contents by the selection operation for the second identifier frame answered.
It is above-mentioned that second object content is split into M sub- contents, can be according to the fixed semantic structure of minimum by the
Two object contents split into M sub- contents, and the fixed semantic structure of signified minimum can be minimal geographical location name, people herein
Name, complete vocabulary, phrase, network address, time or email address etc., for example, when the second object content is " this is a tiger ",
Then following 4 sub- contents can be split into according to the fixed semantic structure of minimum：" this ", "Yes", " one ", Tiger.
The above-mentioned display M sub- contents can show the M with marking frame sub- contents, for example, when M sub- contents
For " good ", " " 2 sub- contents when, the sub- content in 2 with marking frame of interface display can be as shown in Figure 4.
Above-mentioned reception user can receive user to M son to the selection operation of the sub- content in the M sub- contents
The selection operation of the corresponding marking frame of sub- content in content.In M described in said extracted sub- contents in the selected son of user
Hold, can be the selection operation according to user to the corresponding marking frame of sub- content in M sub- contents, extraction user is selected
The corresponding sub- content of marking frame.
It should be pointed out that after M sub- contents of display, user can also be carried out the sub- contents of M by interface operation
It is further to split, for example, it may be M sub- contents are further split into individually respectively by the fractionation button for clicking interface
Word, phonetic, letter, number or symbol.
In this way, since the second object content is further split into M sub- contents, so as to be carried out with smaller unit
Contents extraction, so as to further enhance flexibility and the convenience of interface content extraction.
As shown in figure 5, a kind of interface content processing method, is applied to mobile terminal, includes the following steps：
If step 501 is received to the operation of the preset touch of the target location of the mobile terminal display interface, judge
Whether the content shown by the corresponding target widget in the target location, which is supported to replicate, operates；
Wherein, about above-mentioned mobile terminal, the operation of above-mentioned preset touch, the above and above-mentioned judgement target widget institute
Whether the content of display supports the explanation for replicating operation etc. to be referred to the explanation of corresponding portion in Fig. 1 corresponding embodiments,
Therefore details are not described herein again.
Step 502, if it is determined that the content shown by the corresponding target widget in the target location do not support replicate operate, then
The screenshotss image of the display interface is obtained, and by the Content Transformation in the screenshotss image at editable content；
Wherein, turn about the screenshotss image of the above-mentioned acquisition display interface, the above-mentioned content by the screenshotss image
The explanation for changing editable content and above-mentioned editable content etc. into is referred to corresponding portion in Fig. 1 corresponding embodiments
The explanation divided, therefore details are not described herein again.
In addition, however, it is determined that the content shown by the corresponding target widget in the target location supports to replicate operation, then directly
Replicate the content shown by the corresponding target widget in target location.
If step 503 receives selection operation to the first object content in the editable content, institute is extracted
State the first object content in editable content；
Wherein, said extracted can be replicated or shear etc..
It should be pointed out that can be deleted after content some or all of in the editable content described in said extracted
Except the screenshotss image, to achieve the effect that timely releasing memory, save memory space.
It, can described in extraction if the above-mentioned selection operation received to the first object content in the editable content
First object content in the content of editor, if can receive user to the first object content pair in editable content
The selection operation for the first identifier frame answered then extracts the corresponding first object content of first identifier frame.
Step 504 is scanned for according to the first object content, obtains search result information；
It is above-mentioned to be scanned for according to the first object content, search result information is obtained, can use first object
Content carries out internet retrieval as keyword, obtains corresponding search result information, for example, when first object content is " China
It when the time ", then uses " Chinese kungfu " to carry out internet retrieval as keyword, obtains tying about the corresponding retrieval of " Chinese kungfu "
Fruit information.
Step 505, display described search result information.
In this way, in embodiments of the present invention, it, can be by obtaining display interface when display interface, which is not supported to replicate, to be operated
Screenshotss image, and by the Content Transformation in screenshotss image at editable content, to realize to the content in display interface
Extraction, so as to keep the interface content extractability of mobile terminal more preferable；Meanwhile it also can be in editable content
One object content scans for and shows search result information automatically, eliminates user and is replicated, in search engine in display interface
Interface is pasted and multiple operations such as search, that is, enormously simplifies the operation of user, improve ease of use.
Optionally, described to be scanned for according to the first object content, search result information is obtained, including：
The first object content is split into N number of sub- content；
Respectively according to perhaps all sub- content scans in part in N number of sub- content, search result is obtained
Information；
Wherein, the N is positive integer.
It is above-mentioned that the first object content is split into N number of sub- content, can be according to the fixed semantic structure of minimum by the
One object content splits into N number of sub- content, and the fixed semantic structure of signified minimum can be minimal geographical location name, people herein
Name, complete vocabulary, phrase, network address, time or email address etc., for example, when the second object content is " tomorrow morning 9:30 have
Evaluation, you will participate in down " when, then it can be split into following 9 sub- contents according to the fixed semantic structure of minimum：" tomorrow ",
" morning 9:30 ", " having ", " a ", " evaluation ", ", ", " you want ", " participation ", "lower".
It is above-mentioned to be scanned for respectively according to perhaps whole sub- contents in part in N number of sub- content, obtain search result
Information can be understood to, and be carried out in turn as keyword using the single sub- content in perhaps whole sub- contents in of part
Search, obtains corresponding search result information.For example, when perhaps all sub- content includes " China " and " time " two in of part
" China " and " time " when a sub- content, is then respectively adopted to scan for as keyword, obtains the search knot about " China "
Fruit information and search result information about " time ".
In this way, first object content to be split into the sub- content of more subsection, then scanned for as unit of sub- content, energy
Search is enough easily facilitated, and search can be made more comprehensively and thorough.
Optionally, described respectively according to perhaps all sub- content scans in part in N number of sub- content, it obtains
To search result information, including：
According to the correspondence between sub- content and content type, every sub- content in N number of sub- content is judged respectively
With the presence or absence of at least one corresponding content type；
It is scanned for according to the sub- content of target, obtains search result information, wherein the sub- content of target is to exist at least
The sub- content of one corresponding content type.
Wherein, the above type can be place, personage, animal, plant, fruit, books, video display, express delivery number, electricity
Words, network address, date, time or item etc..The above type can be added as needed on, be deleted or modified.
The above-mentioned sub- content of target is there are the sub- content of at least one corresponding content type, can refer to above-mentioned target
There are one, two or more corresponding content types for content, for example, when the sub- content of target is " China ", it can
To be this content type of corresponding place；When the sub- content of target is " panda ", can be corresponding animal and video display this two
A content type；Can be corresponding plant, fruit and name these three content types when the sub- content of target is " orange ".
In this way, due to only in N number of sub- content there are the sub- contents of at least one corresponding content type to scan for,
And to there is no the sub- content of any content type without search, it is thus possible to filter out certain determinations, there is no search valence
The sub- content of value, so as to further save in-fighting, while can also improve efficiency.
Optionally, described to be scanned for according to the sub- content of target, search result information is obtained, including：
According to the sub- content of the target in the corresponding database of the corresponding each content type of the sub- content of the target into
Row search, obtains search result information；
The display described search result information, including：
Show the corresponding each content type of the sub- content of the target and described search result information, wherein the target
The search result that search obtains in the sub- corresponding each content type of content and the corresponding database of each content type exists
It is corresponded when display.
With the be shown as snapshot pictures of Fig. 6 and in content shown in Fig. 6 " At 9 tomorrow morning 30 has a evaluation, you want
Under participation " it is used as first object content for example, the display interface of above-mentioned display search result information can be as shown in Figure 7
Display interface.
In this way, due in the corresponding each content type of the sub- content of target and the corresponding database of each content type
It searches for obtained search result to correspond in display, thus easily facilitates user and check, can improve using just
Profit.
As shown in figure 8, a kind of mobile terminal 800, including：
Judgment module 801, if for receiving the preset touch behaviour to the target location of the mobile terminal display interface
Make, then judges whether the content shown by the corresponding target widget in the target location is supported to replicate and operate；
Conversion module 802, for if it is determined that the content shown by the corresponding target widget in the target location is not supported again
System operation, then obtain the screenshotss image of the display interface, and by the Content Transformation in the screenshotss image at editable interior
Hold；
Extraction module 803, for some or all of extracting in the editable content content.
Optionally, if as shown in figure 9, the extraction module 803 is used to receive to the in the editable content
The selection operation of one object content then extracts the first object content in the editable content；
The mobile terminal 800 further includes：
Search module 804 obtains search result information for being scanned for according to the first object content；
Display module 805, for showing described search result information.
Optionally, as shown in Figure 10, described search module 804 includes：
Submodule 8041 is split, for the first object content to be split into N number of sub- content；
Search for submodule 8042, for respectively according in part in N number of sub- content perhaps the sub- contents of whole into
Row search, obtains search result information；
Wherein, the N is positive integer.
Optionally, as shown in figure 11, described search submodule 8042 includes：
Judging unit 80421, for according to the correspondence between sub- content and content type, judging respectively described N number of
Every sub- content whether there is at least one corresponding content type in sub- content；
Search unit 80422 obtains search result information, wherein the mesh for being scanned for according to the sub- content of target
It is that there are the sub- contents of at least one corresponding content type to mark sub- content.
Optionally, described search unit 80422 is used for corresponding in the sub- content of the target according to the sub- content of the target
It is scanned in the corresponding database of each content type, obtains search result information；
The display module 805 is for showing the corresponding each content type of the sub- content of the target and described search result
Information, wherein searched in the corresponding each content type of the sub- content of target and the corresponding database of each content type
The search result that rope obtains is corresponded in display.
Optionally, as shown in figure 12, the extraction module 803 includes：
Split cells 8031, if for receiving the behaviour of the selection to the second object content in the editable content
Make, then second object content is split into M sub- contents；
Display unit 8032, for showing the M sub- contents；
Selecting unit 8033, the selection operation for receiving user to the sub- content in the M sub- contents；
Extraction unit 8034, for extracting the selected sub- content of user in the M sub- contents；
Wherein, the M is positive integer.
Mobile terminal 800 can realize each process that mobile terminal is realized in the embodiment of the method for Fig. 1 to Fig. 7, to keep away
Exempt to repeat, which is not described herein again.
The mobile terminal 400 of the embodiment of the present invention can be shown when display interface, which is not supported to replicate, to be operated by obtaining
The screenshotss image at interface, and by the Content Transformation in screenshotss image at editable content, to realize in display interface
The extraction of appearance, so as to keep the interface content extractability of mobile terminal more preferable.
A kind of hardware architecture diagram of Figure 13 mobile terminals of each embodiment to realize the present invention, the mobile terminal
1300 include but not limited to：Radio frequency unit 1301, network module 1302, audio output unit 1303, input unit 1304, sensing
Device 1305, display unit 1306, user input unit 1307, interface unit 1308, memory 1309, processor 1310 and
The components such as power supply 1311.It will be understood by those skilled in the art that mobile terminal structure shown in Figure 13 is not constituted to movement
The restriction of terminal, mobile terminal may include either combining certain components or different than illustrating more or fewer components
Component is arranged.In embodiments of the present invention, mobile terminal includes but not limited to mobile phone, tablet computer, laptop, palm electricity
Brain, car-mounted terminal, wearable device and pedometer etc..
Wherein, processor 1310 is used for：
If receiving the preset touch operation to the target location of the mobile terminal display interface, the target is judged
Whether the content shown by the corresponding target widget in position, which is supported to replicate, operates；
Operated if it is determined that the content shown by the corresponding target widget in the target location is not supported to replicate, then obtain described in
The screenshotss image of display interface, and by the Content Transformation in the screenshotss image at editable content；
Some or all of extract in the editable content content.
Optionally, content some or all of in the extraction editable content that processor 1310 executes, packet
It includes：
If receiving the selection operation to the first object content in the editable content, the editable is extracted
Content in first object content；
Processor 1310 is additionally operable to：
It is scanned for according to the first object content, obtains search result information；
Show described search result information.
Optionally, described being scanned for according to the first object content of the execution of processor 1310, obtains search result
Information, including：
The first object content is split into N number of sub- content；
Respectively according to perhaps all sub- content scans in part in N number of sub- content, search result is obtained
Information；
Wherein, the N is positive integer.
Optionally, what processor 1310 executed is described respectively according to perhaps whole in part in N number of sub- content
Sub- content scans for, and obtains search result information, including：
According to the correspondence between sub- content and content type, every sub- content in N number of sub- content is judged respectively
With the presence or absence of at least one corresponding content type；
It is scanned for according to the sub- content of target, obtains search result information, wherein the sub- content of target is to exist at least
The sub- content of one corresponding content type.
Optionally, described being scanned for according to the sub- content of target of the execution of processor 1310, obtains search result information, wraps
It includes：
According to the sub- content of the target in the corresponding database of the corresponding each content type of the sub- content of the target into
Row search, obtains search result information；
The display described search result information that processor 1310 executes, including：
Show the corresponding each content type of the sub- content of the target and described search result information, wherein the target
The search result that search obtains in the sub- corresponding each content type of content and the corresponding database of each content type exists
It is corresponded when display.
Optionally, part or full content in the extraction editable content that processor 1310 executes, including：
If receiving the selection operation to the second object content in the editable content, by second target
Content splits into M sub- contents；
Show the M sub- contents；
Receive selection operation of the user to the sub- content in the M sub- contents；
Extract the selected sub- content of user in the M sub- contents；
Wherein, the M is positive integer.
Mobile terminal 1300 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, this
In repeat no more.
In this way, in embodiments of the present invention, it, can be by obtaining display interface when display interface, which is not supported to replicate, to be operated
Screenshotss image, and by the Content Transformation in screenshotss image at editable content, to realize to the content in display interface
Extraction, so as to keep the interface content extractability of mobile terminal more preferable.
It should be understood that the embodiment of the present invention in, radio frequency unit 1301 can be used for receiving and sending messages or communication process in, signal
Send and receive, specifically, by from base station downlink data receive after, to processor 1310 handle；In addition, by uplink
Data are sent to base station.In general, radio frequency unit 1301 includes but not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 1301 can also by radio communication system and network and other
Equipment communicates.
Mobile terminal has provided wireless broadband internet to the user by network module 1302 and has accessed, and such as user is helped to receive
Send e-mails, browse webpage and access streaming video etc..
It is that audio output unit 1303 can receive radio frequency unit 1301 or network module 1302 or in memory
The audio data stored in 1309 is converted into audio signal and exports to be sound.Moreover, audio output unit 1303 can be with
The relevant audio output of specific function executed with mobile terminal 1300 is provided (for example, call signal receives sound, message sink
Sound etc.).Audio output unit 1303 includes loud speaker, buzzer and receiver etc..
Input unit 1304 is for receiving audio or video signal.Input unit 1304 may include graphics processor
(Graphics Processing Unit, GPU) 13041 and microphone 13042, graphics processor 13041 in video to capturing
In pattern or image capture mode by image capture apparatus (such as camera) obtain static images or video image data into
Row processing.Treated, and picture frame may be displayed on display unit 1306.Through treated the picture frame of graphics processor 13041
It can be stored in memory 1309 (or other storage mediums) or be carried out via radio frequency unit 1301 or network module 1302
It sends.Microphone 13042 can receive sound, and can be audio data by such acoustic processing.Audio that treated
Data can be converted to the lattice that mobile communication base station can be sent to via radio frequency unit 1301 in the case of telephone calling model
Formula exports.
Mobile terminal 1300 further includes at least one sensor 1305, for example, optical sensor, motion sensor and other
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ring
The light and shade of border light adjusts the brightness of display panel 13061, proximity sensor can when mobile terminal 1300 is moved in one's ear,
Close display panel 13061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions
The size of (generally three axis) acceleration, can detect that size and the direction of gravity, can be used to identify mobile terminal appearance when static
State (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion)
Deng；Sensor 1305 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, gas
Meter, hygrometer, thermometer, infrared sensor etc. are pressed, details are not described herein.
Display unit 1306 is for showing information input by user or being supplied to the information of user.Display unit 1306 can
Including display panel 13061, liquid crystal display (Liquid Crystal Display, LCD), organic light-emitting diodes may be used
Forms such as (Organic Light-Emitting Diode, OLED) are managed to configure display panel 13061.
User input unit 1307 can be used for receiving the number or character information of input, and generate the use with mobile terminal
Family is arranged and the related key signals input of function control.Specifically, user input unit 1307 include touch panel 13071 with
And other input equipments 13072.Touch panel 13071, also referred to as touch screen collect user on it or neighbouring touch are grasped
Make (for example user uses any suitable objects or attachment such as finger, stylus on touch panel 13071 or in touch panel
Operation near 13071).Touch panel 13071 may include both touch detecting apparatus and touch controller.Wherein, it touches
The touch orientation of detection device detection user is touched, and detects the signal that touch operation is brought, transmits a signal to touch controller；
Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 1310,
It receives the order that processor 1310 is sent and is executed.Furthermore, it is possible to using resistance-type, condenser type, infrared ray and surface
The multiple types such as sound wave realize touch panel 13071.In addition to touch panel 13071, user input unit 1307 can also include
Other input equipments 13072.Specifically, other input equipments 13072 can include but is not limited to physical keyboard, function key (ratio
Such as volume control button, switch key), trace ball, mouse, operating lever, details are not described herein.
Further, touch panel 13071 can be covered on display panel 13061, when touch panel 13071 detects
After touch operation on or near it, processor 1310 is sent to determine the type of touch event, is followed by subsequent processing device 1310
Corresponding visual output is provided on display panel 13061 according to the type of touch event.Although in fig. 13, touch panel
13071 with display panel 13061 be realize the function that outputs and inputs of mobile terminal as two independent components, but
In some embodiments, touch panel 13071 can be integrated with display panel 13061 and realize outputting and inputting for mobile terminal
Function does not limit specifically herein.
Interface unit 1308 is the interface that external device (ED) is connect with mobile terminal 1300.For example, external device (ED) may include
Wired or wireless headphone port, external power supply (or battery charger) port, wired or wireless data port, storage card
Port, the port for connecting the device with identification module, the port audio input/output (I/O), video i/o port, earphone
Port etc..Interface unit 1308 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) simultaneously
And by one or more elements that the input received is transferred in mobile terminal 1300 or it can be used in mobile terminal
Transmission data between 1300 and external device (ED).
Memory 1309 can be used for storing software program and various data.Memory 1309 can include mainly storage program
Area and storage data field, wherein storing program area can storage program area, needed at least one function application program (such as
Sound-playing function, image player function etc.) etc.；Storage data field can be stored uses created data (ratio according to mobile phone
Such as audio data, phone directory) etc..In addition, memory 1309 may include high-speed random access memory, can also include non-
Volatile memory, for example, at least a disk memory, flush memory device or other volatile solid-state parts.
Processor 1310 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the software program and/or module that are stored in memory 1309, and calls and is stored in storage
Data in device 1309 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.Place
Reason device 1310 may include one or more processing units；Preferably, processor 1310 can integrate application processor and modulation /demodulation
Processor, wherein the main processing operation system of application processor, user interface and application program etc., modem processor master
Handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 1310.
Mobile terminal 1300 can also include the power supply 1311 (such as battery) powered to all parts, it is preferred that power supply
1311 can be logically contiguous by power-supply management system and processor 1310, to realize that management is filled by power-supply management system
The functions such as electricity, electric discharge and power managed.
In addition, mobile terminal 1300 includes some unshowned function modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 1310, memory 1309, storage
On memory 1309 and the computer program that can be run on the processor 1310, the computer program is by processor 1310
Each process of above-mentioned interface content processing method embodiment is realized when execution, and can reach identical technique effect, to avoid
It repeats, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the computer program realize each process of above-mentioned interface content processing method embodiment when being executed by processor,
And identical technique effect can be reached, to avoid repeating, which is not described herein again.Wherein, the computer readable storage medium,
Such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, letter
Claim RAM), magnetic disc or CD etc..
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements include not only those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
There is also other identical elements in the process of element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be expressed in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal (can be mobile phone, computer, service
Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited in above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form belongs within the protection of the present invention.
Claims (12)
1. a kind of interface content processing method is applied to mobile terminal, which is characterized in that including：
If receiving the preset touch operation to the target location of the mobile terminal display interface, the target location is judged
Whether the content shown by corresponding target widget, which is supported to replicate, operates；
It is operated if it is determined that the content shown by the corresponding target widget in the target location is not supported to replicate, then obtains the display
The screenshotss image at interface, and by the Content Transformation in the screenshotss image at editable content；
Some or all of extract in the editable content content.
2. according to the method described in claim 1, it is characterized in that, the part extracted in the editable content or complete
Portion's content, including：
If receiving the selection operation to the first object content in the editable content, extract described editable interior
First object content in appearance；
Some or all of in the extraction editable content after content, the method further includes：
It is scanned for according to the first object content, obtains search result information；
Show described search result information.
3. according to the method described in claim 2, it is characterized in that, described scan for according to the first object content, obtain
To search result information, including：
The first object content is split into N number of sub- content；
Respectively according to perhaps all sub- content scans in part in N number of sub- content, search result information is obtained；
Wherein, the N is positive integer.
4. according to the method described in claim 3, it is characterized in that, described respectively according to part in N number of sub- content
Inside perhaps all sub- content scans for, and obtains search result information, including：
According to the correspondence between sub- content and content type, judge in N number of sub- content whether is every sub- content respectively
There are at least one corresponding content types；
It is scanned for according to the sub- content of target, obtains search result information, wherein the sub- content of target is that there are at least one
The sub- content of corresponding content type.
5. according to the method described in claim 4, it is characterized in that, described scan for according to the sub- content of target, searched for
Result information, including：
It is searched in the corresponding database of the corresponding each content type of the sub- content of the target according to the sub- content of the target
Rope obtains search result information；
The display described search result information, including：
Show the corresponding each content type of the sub- content of the target and described search result information, wherein in target
Hold the search result that search obtains in corresponding each content type and the corresponding database of each content type showing
When correspond.
6. according to the method described in claim 1, it is characterized in that, in the extraction editable content partly or entirely
Content, including：
If receiving the selection operation to the second object content in the editable content, by second object content
Split into M sub- contents；
Show the M sub- contents；
Receive selection operation of the user to the sub- content in the M sub- contents；
Extract the selected sub- content of user in the M sub- contents；
Wherein, the M is positive integer.
7. a kind of mobile terminal, which is characterized in that including：
If judgment module is sentenced for receiving the preset touch operation to the target location of the mobile terminal display interface
Whether the content shown by the corresponding target widget in the target location of breaking, which is supported to replicate, operates；
Conversion module, for if it is determined that the content shown by the corresponding target widget in the target location do not support replicate operate,
The screenshotss image of the display interface is then obtained, and by the Content Transformation in the screenshotss image at editable content；
Extraction module, for some or all of extracting in the editable content content.
8. mobile terminal according to claim 7, which is characterized in that if the extraction module for receive to it is described can
The selection operation of first object content in the content of editor then extracts the first object content in the editable content；
The mobile terminal further includes：
Search module obtains search result information for being scanned for according to the first object content；
Display module, for showing described search result information.
9. mobile terminal according to claim 8, which is characterized in that described search module includes：
Submodule is split, for the first object content to be split into N number of sub- content；
Submodule is searched for, for according to perhaps all sub- content scans in part in N number of sub- content, obtaining respectively
To search result information；
Wherein, the N is positive integer.
10. mobile terminal according to claim 9, which is characterized in that described search submodule includes：
Judging unit, it is every in N number of sub- content for according to the correspondence between sub- content and content type, judging respectively
A sub- content whether there is at least one corresponding content type；
Search unit obtains search result information for being scanned for according to the sub- content of target, wherein the sub- content of target
For there are the sub- contents of at least one corresponding content type.
11. mobile terminal according to claim 10, which is characterized in that described search unit is used for according to target
Content scans in the corresponding database of the corresponding each content type of the sub- content of the target, obtains search result letter
Breath；
The display module for showing the corresponding each content type of the sub- content of the target and described search result information,
In, in the corresponding each content type of the sub- content of target and the corresponding database of each content type search obtain
Search result is corresponded in display.
12. mobile terminal according to claim 7, which is characterized in that the extraction module includes：
Split cells, if for receiving the selection operation to the second object content in the editable content, by institute
It states the second object content and splits into M sub- contents；
Display unit, for showing the M sub- contents；
Selecting unit, the selection operation for receiving user to the sub- content in the M sub- contents；
Extraction unit, for extracting the selected sub- content of user in the M sub- contents；
Wherein, the M is positive integer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810409053.7A CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810409053.7A CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108595107A true CN108595107A (en) | 2018-09-28 |
| CN108595107B CN108595107B (en) | 2020-10-16 |
Family
ID=63620382
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810409053.7A Active CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108595107B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634703A (en) * | 2018-12-13 | 2019-04-16 | 北京旷视科技有限公司 | Image processing method, device, system and storage medium based on canvas label |
| CN109635683A (en) * | 2018-11-27 | 2019-04-16 | 维沃移动通信有限公司 | Method for extracting content and terminal device in a kind of image |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103838501A (en) * | 2012-11-20 | 2014-06-04 | 联想(北京)有限公司 | Information processing method and electronic device |
| US8787690B2 (en) * | 2008-11-12 | 2014-07-22 | Abbyy Development Llc | Binarizing an image |
| CN104636322A (en) * | 2015-03-03 | 2015-05-20 | 广东欧珀移动通信有限公司 | Text copying method and text copying device |
| CN106202269A (en) * | 2016-06-28 | 2016-12-07 | 广东欧珀移动通信有限公司 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
| CN107256109A (en) * | 2017-05-27 | 2017-10-17 | 北京小米移动软件有限公司 | Method for information display, device and terminal |
-
2018
- 2018-05-02 CN CN201810409053.7A patent/CN108595107B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8787690B2 (en) * | 2008-11-12 | 2014-07-22 | Abbyy Development Llc | Binarizing an image |
| CN103838501A (en) * | 2012-11-20 | 2014-06-04 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104636322A (en) * | 2015-03-03 | 2015-05-20 | 广东欧珀移动通信有限公司 | Text copying method and text copying device |
| CN106202269A (en) * | 2016-06-28 | 2016-12-07 | 广东欧珀移动通信有限公司 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
| CN107256109A (en) * | 2017-05-27 | 2017-10-17 | 北京小米移动软件有限公司 | Method for information display, device and terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109635683A (en) * | 2018-11-27 | 2019-04-16 | 维沃移动通信有限公司 | Method for extracting content and terminal device in a kind of image |
| CN109634703A (en) * | 2018-12-13 | 2019-04-16 | 北京旷视科技有限公司 | Image processing method, device, system and storage medium based on canvas label |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108595107B (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104123316B (en) | Resource collecting method, device and equipment | |
| CN108470041A (en) | A kind of information search method and mobile terminal | |
| CN109445894A (en) | A kind of screenshot method and electronic equipment | |
| CN108337374A (en) | A kind of message prompt method and mobile terminal | |
| CN107948428A (en) | A kind of message treatment method and mobile terminal | |
| CN110233931A (en) | A kind of unread message management method and terminal device | |
| CN108966004A (en) | A kind of method for processing video frequency and terminal | |
| CN108733800A (en) | A kind of global search method, terminal and computer readable storage medium | |
| CN109032719A (en) | A kind of object recommendation method and terminal | |
| CN109561211A (en) | A kind of information display method and mobile terminal | |
| CN110046015A (en) | Using sharing method and terminal | |
| CN109857494A (en) | A kind of message prompt method and terminal device | |
| CN108255372A (en) | A kind of desktop application icon method for sorting and mobile terminal | |
| CN109947650A (en) | Script step process methods, devices and systems | |
| CN109165320A (en) | A kind of information collection method and mobile terminal | |
| CN109739402A (en) | Fast application processing method and terminal device | |
| CN107957994A (en) | A kind of interpretation method, terminal and computer-readable recording medium | |
| CN108595107A (en) | A kind of interface content processing method and mobile terminal | |
| CN108763540A (en) | A kind of file browsing method and terminal | |
| CN110471589A (en) | Information display method and terminal device | |
| CN109495638A (en) | A kind of information display method and terminal | |
| CN108279833A (en) | A kind of reading interactive approach and mobile terminal | |
| CN108345424A (en) | A kind of method for information display and mobile terminal | |
| CN109947988A (en) | A kind of information processing method, device, terminal device and server | |
| CN109992753A (en) | A kind of translation processing method and terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |