CN108595107B - Interface content processing method and mobile terminal - Google Patents
Interface content processing method and mobile terminal Download PDFInfo
- Publication number
- CN108595107B CN108595107B CN201810409053.7A CN201810409053A CN108595107B CN 108595107 B CN108595107 B CN 108595107B CN 201810409053 A CN201810409053 A CN 201810409053A CN 108595107 B CN108595107 B CN 108595107B
- Authority
- CN
- China
- Prior art keywords
- content
- sub
- target
- contents
- editable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/543—User-generated data transfer, e.g. clipboards, dynamic data exchange [DDE], object linking and embedding [OLE]
Abstract
The invention provides an interface content processing method and a mobile terminal, wherein the method is applied to the mobile terminal and comprises the following steps: if a preset touch operation on a target position of a display interface of the mobile terminal is received, judging whether the content displayed by a target control corresponding to the target position supports a copy operation or not; if the content displayed by the target control corresponding to the target position does not support the copying operation, acquiring a screen capture image of the display interface, and converting the content in the screen capture image into editable content; and extracting part or all of the editable content. When the display interface does not support the copying operation, the content in the display interface can be extracted by acquiring the screenshot image of the display interface and converting the content in the screenshot image into the editable content, so that the interface content extraction capability of the mobile terminal is better.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to an interface content processing method and a mobile terminal.
Background
With the popularization of mobile terminals, more and more people tend to acquire contents wanted by themselves through the mobile terminals, and when a user conducts interface browsing (e.g., web browsing, e-book browsing) on the mobile terminals, some interested contents such as specific titles, historical characters or places, etc. may want to be extracted for further searching or recording.
The current mobile terminal generally provides a user content copying function, that is, when a user encounters target content in which the user is interested in during the interface browsing process, the target content can be extracted by copying in a display interface. However, the method for extracting the target content of the display interface by copying has poor applicability, which is mainly reflected in that: when the display interface is technically obstructed in terms of content copying, namely the display interface does not support copying, the user cannot extract the target content on the interface.
In summary, the method for extracting the target content of the display interface by copying is difficult to be applied to the situation that the display interface does not support the copy function, so that the interface content extracting capability of the mobile terminal is poor.
Disclosure of Invention
The embodiment of the invention provides an interface content processing method and a mobile terminal, and aims to solve the problem that interface content extraction capability of the mobile terminal is poor due to the fact that a method for extracting target content of a display interface by copying is difficult to be suitable for the situation that the display interface does not support a copying function.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an interface content processing method applied to a mobile terminal, including:
if a preset touch operation on a target position of a display interface of the mobile terminal is received, judging whether the content displayed by a target control corresponding to the target position supports a copy operation or not;
if the content displayed by the target control corresponding to the target position does not support the copying operation, acquiring a screen capture image of the display interface, and converting the content in the screen capture image into editable content;
and extracting part or all of the editable content.
In a second aspect, an embodiment of the present invention further provides a mobile terminal, including:
the judging module is used for judging whether the content displayed by the target control corresponding to the target position supports the copying operation or not if the preset touch operation of the target position of the display interface of the mobile terminal is received;
the conversion module is used for acquiring a screen capture image of the display interface and converting the content in the screen capture image into editable content if the fact that the content displayed by the target control corresponding to the target position does not support the copying operation is determined;
and the extracting module is used for extracting part or all of the editable contents.
In a third aspect, an embodiment of the present invention further provides a mobile terminal, including a processor, a memory, and a computer program stored on the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the steps of the interface content processing method described above.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the interface content processing method are implemented.
The beneficial technical effects of the invention are as follows:
in the embodiment of the invention, if a preset touch operation on a target position of a display interface of a mobile terminal is received, whether the content displayed by a target control corresponding to the target position supports a copy operation is judged; if the content displayed by the target control corresponding to the target position does not support the copying operation, acquiring a screen capture image of the display interface, and converting the content in the screen capture image into editable content; and extracting part or all of the editable content. In this way, when the display interface does not support the copying operation, the content in the display interface can be extracted by acquiring the screenshot image of the display interface and converting the content in the screenshot image into the editable content, so that the interface content extraction capability of the mobile terminal can be better.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
FIG. 1 is a flowchart of an interface content processing method according to an embodiment of the present invention;
fig. 2 is a diagram illustrating an example of an interface content processing method according to an embodiment of the present invention;
fig. 3 is a second example of the interface content processing method according to the embodiment of the present invention;
fig. 4 is a third example diagram of an interface content processing method according to an embodiment of the present invention;
FIG. 5 is a flowchart of a method for processing interface content according to another embodiment of the present invention;
FIG. 6 is a diagram illustrating an example of a method for processing interface content according to another embodiment of the present invention;
FIG. 7 is a second example of an interface content processing method according to another embodiment of the present invention;
fig. 8 is one of the structural diagrams of a mobile terminal according to an embodiment of the present invention;
fig. 9 is a second block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 10 is a block diagram of a search module of a mobile terminal according to an embodiment of the present invention;
fig. 11 is a block diagram of a search submodule in a search module of a mobile terminal according to an embodiment of the present invention;
fig. 12 is a block diagram of an extracting module of a mobile terminal according to an embodiment of the present invention;
fig. 13 is a block diagram of a mobile terminal according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an interface content processing method applied to a mobile terminal includes the following steps:
the Mobile terminal may be a Mobile phone, a Tablet Personal Computer (Tablet Personal Computer), a Laptop Computer (Laptop Computer), a Personal Digital Assistant (PDA), a Mobile Internet Device (MID), a Wearable Device (Wearable Device), or the like.
The preset touch operation may be a click operation, a double click operation, a long press operation, or the like, and when the preset touch operation is the long press operation, the long press operation may be a press operation with a press time longer than a general long press time of the mobile terminal system. The content can be characters, pinyin, letters, numbers, symbols, pictures or the like.
The above determining whether the content displayed by the target control supports the copy operation may be determining whether the content displayed by the target control supports the copy operation according to the attribute of the target control, for example, when the attribute of the target control includes a text attribute, determining that the content displayed by the target control supports the copy operation; and when the attribute of the target control does not contain the text attribute, determining that the content displayed by the target control does not support the copying operation. The above-mentioned judging the content that the target control reveals supports the copy operation, can also be to the content that the target control reveals carries out the copy operation, when carrying out the copy operation and succeeding, confirm the content that the target control reveals supports the copy operation; and when the copy operation fails to be executed, determining that the content displayed by the target control does not support the copy operation.
the above-mentioned screen capture image for acquiring the display interface may be a screen capture image for directly acquiring a pre-existing display interface, and the screen capture image for the pre-existing display interface referred to here may be a screen capture image obtained by performing screen capture on the display interface while judging whether the content displayed by the target control corresponding to the target position supports the copy operation. The screen capture image of the display interface may be obtained by capturing the screen of the display interface after the step of determining that the content displayed by the target control corresponding to the target position does not support the copy operation is performed. The time required for screen capture of the display interface can be less than the universal long press time of the mobile terminal system.
The content in the screenshot image may be converted into the editable content by an Optical Character Recognition (OCR) technique. The editable content may refer to content that can be selected, copied, cut, or deleted.
In addition, if it is determined that the content displayed by the target control corresponding to the target position supports the copy operation, directly copying the content displayed by the target control corresponding to the target position.
And 103, extracting part or all of the editable contents.
Wherein, the extraction can be copying or cutting.
It should be noted that after some or all of the editable contents are extracted, the screenshot image may be deleted, so as to achieve the effects of releasing the memory in time and saving the storage space.
Thus, in the embodiment of the invention, when the display interface does not support the copy operation, the extraction of the content in the display interface can be realized by acquiring the screenshot image of the display interface and converting the content in the screenshot image into the editable content, so that the interface content extraction capability of the mobile terminal can be better.
Optionally, the extracting of the part or all of the editable content may be extracting the part or all of the editable content according to a selection operation of the user on the part or all of the editable content.
Wherein, the extracting of the part or all of the editable contents according to the selection operation of the user on the part or all of the editable contents may be implemented by the following methods:
after the contents in the screenshot images are converted into editable contents, the editable contents are subjected to frame division identification processing, the editable contents subjected to frame division identification processing are displayed, then the selection operation of a user on part or all of the identification frames is received, and the editable contents corresponding to the part or all of the identification frames selected by the user are extracted. For example, as shown in fig. 2, for the screenshot image, firstly, the content in the screenshot image shown in fig. 2 is converted into an editable content, then the editable content is subjected to the frame division identification processing, the editable content after the frame division identification processing is displayed (the editable content after the frame division identification processing displayed on the interface is shown in fig. 3), then, the selection operation of the user on part or all of the identification frames in fig. 3 is received, and the editable content corresponding to the identification frame selected by the user is extracted.
Specifically, the selection operation of the user on part or all of the identification boxes may be a click operation, for example, the user firstly clicks part or all of the identification boxes to select editable content corresponding to the clicked identification box, and then clicks a determination button to complete the selection; the user's selection operation of some or all of the identification boxes may also be a sliding and clicking operation, for example, the user slides some or all of the identification boxes to select the editable content corresponding to the slid identification boxes, and then clicks the ok button to complete the selection. In addition, as shown in fig. 3, the selection operation of the user on all the identification boxes may also be that the user firstly clicks or slides a full selection button hovering on the display interface to select editable contents corresponding to all the identification boxes, and then clicks a determination button to complete the selection.
Optionally, the extracting part or all of the editable content includes:
splitting a second target content into M sub-contents if a selection operation of the second target content in the editable content is received;
displaying the M pieces of sub-content;
receiving a selection operation of a user on a sub-content in the M sub-contents;
extracting sub-content selected by a user in the M sub-contents;
wherein M is a positive integer.
If a selection operation on a second target content in the editable content is received, splitting the second target content into M sub-contents, or splitting the second target content corresponding to a second identification frame into M sub-contents if a selection operation on the second identification frame corresponding to the second target content in the editable content is received.
The splitting of the second target content into M pieces of sub-content may be splitting the second target content into M pieces of sub-content according to a minimum fixed semantic structure, where the minimum fixed semantic structure referred to herein may be a minimum geographic location name, a name of a person, a complete vocabulary, a phrase, a web address, a time, or an address of a mailbox, and so on, for example, when the second target content is "this is a tiger", it may be split into the following 4 pieces of sub-content according to the minimum fixed semantic structure: "this", "is", "one", and "tiger".
The above displaying the M pieces of sub-content may be displaying the M pieces of sub-content with the identification box, for example, when the M pieces of sub-content are "good" and "2 pieces of sub-content, the 2 pieces of sub-content with the identification box displayed on the interface may be as shown in fig. 4.
The receiving of the selection operation of the user on the sub-content in the M sub-contents may be receiving the selection operation of the user on an identification frame corresponding to the sub-content in the M sub-contents. The extracting of the sub-content selected by the user in the M sub-contents may be extracting the sub-content corresponding to the identification box selected by the user according to a selection operation of the user on the identification box corresponding to the sub-content in the M sub-contents.
It should be noted that after the M sub-contents are displayed, the user may further split the M sub-contents through an interface operation, for example, the M sub-contents may be further split into single characters, pinyin, letters, numbers or symbols by clicking a split button of the interface.
In this way, since the second target content is further split into M sub-contents, content extraction can be performed in smaller units, and thus the flexibility and convenience of interface content extraction can be further enhanced.
As shown in fig. 5, an interface content processing method applied to a mobile terminal includes the following steps:
the explanation on the aspects of the mobile terminal, the preset touch operation, the content, whether the content displayed by the determination target control supports the copy operation, and the like, may refer to the explanation of the corresponding part in the corresponding embodiment of fig. 1, and therefore, details are not repeated here.
for the above explanation on the aspects of acquiring the screenshot image of the display interface, the above explanation on the aspects of converting the content in the screenshot image into the editable content and the above editable content, and the like, reference may be made to the explanation of corresponding parts in the corresponding embodiment of fig. 1, and thus details are not described here.
In addition, if it is determined that the content displayed by the target control corresponding to the target position supports the copy operation, directly copying the content displayed by the target control corresponding to the target position.
wherein, the extraction can be copying or cutting.
It should be noted that after some or all of the editable contents are extracted, the screenshot image may be deleted, so as to achieve the effects of releasing the memory in time and saving the storage space.
The extracting of the first target content of the editable content when receiving the selection operation on the first target content of the editable content may be extracting the first target content corresponding to the first identification frame when receiving the selection operation on the first identification frame corresponding to the first target content of the editable content by the user.
the searching according to the first target content to obtain the search result information may be to perform online retrieval by using the first target content as a keyword to obtain corresponding search result information, for example, when the first target content is "chinese kungfu", performing online retrieval by using "chinese kungfu" as a keyword to obtain corresponding search result information about "chinese kungfu".
And 505, displaying the search result information.
Thus, in the embodiment of the invention, when the display interface does not support the copy operation, the extraction of the content in the display interface can be realized by acquiring the screenshot image of the display interface and converting the content in the screenshot image into the editable content, so that the interface content extraction capability of the mobile terminal can be better; meanwhile, the first target content in the editable content can be automatically searched and the search result information is displayed, so that a plurality of operations of copying on a display interface, pasting on a search engine interface, searching and the like of a user are omitted, namely, the operation of the user is greatly simplified, and the use convenience is improved.
Optionally, the searching according to the first target content to obtain search result information includes:
splitting the first target content into N sub-contents;
searching according to part of or all of the N sub-contents respectively to obtain search result information;
wherein N is a positive integer.
The splitting of the first target content into N sub-contents may be splitting the first target content into N sub-contents according to a minimum fixed semantic structure, where the minimum fixed semantic structure referred to herein may be a minimum geographic location name, a name of a person, a complete vocabulary, a phrase, a web address, a time, or an address of a mailbox, and the like, and for example, when the second target content is "9: 30 reviews in the morning, and you want to participate in the next", the second target content may be split into the following 9 sub-contents according to the minimum fixed semantic structure: tomorrow, morning 9:30, with, individual, review,', "you about", "attended", and "down".
The above-mentioned searching is performed according to part of the sub-contents or all of the N sub-contents to obtain the search result information, which may be understood as that the search is performed in sequence by using a single sub-content in the part of the sub-contents or all of the sub-contents as a keyword to obtain the corresponding search result information. For example, when part of or all of the sub-content includes two sub-content, namely "china" and "kungfu", the search is performed by respectively using the "china" and the "kungfu" as keywords, so as to obtain search result information about the "china" and search result information about the "kungfu".
Therefore, the first target content is divided into the sub-content with smaller units, and then the sub-content is used as the unit for searching, so that the searching is more convenient, and the searching is more comprehensive and thorough.
Optionally, the searching according to part of or all of the N sub-contents respectively to obtain search result information includes:
respectively judging whether each sub-content in the N sub-contents has at least one corresponding content type according to the corresponding relation between the sub-contents and the content types;
and searching according to the target sub-content to obtain search result information, wherein the target sub-content is the sub-content with at least one corresponding content type.
The content type may be a place, a person, an animal, a plant, a fruit, a book, a movie, an express number, a telephone, a website, a date, a time or an event, etc. The above content types may be added, deleted or modified as desired.
The target sub-content is a sub-content having at least one corresponding content type, which may mean that the target sub-content has one, two, or more than two corresponding content types, for example, when the target sub-content is "china", it may be a content type corresponding to a place; when the target sub-content is "panda", it may be two content types, corresponding to an animal and a movie; when the target sub-content is "orange", it may be three content types corresponding to plants, fruits, and names of people.
In this way, since only the sub-content with at least one corresponding content type in the N sub-contents is searched, but the sub-content without any content type is not searched, certain determined sub-content without search value can be filtered, thereby further saving internal consumption and improving efficiency.
Optionally, the searching according to the target sub-content to obtain search result information includes:
searching in a database corresponding to each content type corresponding to the target sub-content according to the target sub-content to obtain search result information;
the displaying the search result information includes:
and displaying each content type corresponding to the target sub-content and the search result information, wherein each content type corresponding to the target sub-content corresponds to a search result searched in the database corresponding to each content type one by one when displaying.
The display interface displaying the search result information may be, for example, the display interface shown in fig. 7, in which "9 am in tomorrow has a review and you want to participate" in the content shown in fig. 6 as the first target content, as the screen shot image shown in fig. 6.
In this way, each content type corresponding to the target sub-content corresponds to the search result obtained by searching in the database corresponding to each content type one to one when being displayed, so that the user can check the content more conveniently, and the use convenience can be improved.
As shown in fig. 8, a mobile terminal 800 includes:
a determining module 801, configured to determine whether content displayed by a target control corresponding to a target position supports a copy operation if a preset touch operation on the target position of a display interface of the mobile terminal is received;
a conversion module 802, configured to, if it is determined that the content displayed by the target control corresponding to the target position does not support the copy operation, obtain a screenshot image of the display interface, and convert the content in the screenshot image into editable content;
an extracting module 803, configured to extract part or all of the editable content.
Optionally, as shown in fig. 9, the extracting module 803 is configured to, if a selection operation on a first target content in the editable content is received, extract the first target content in the editable content;
the mobile terminal 800 further includes:
the searching module 804 is configured to search according to the first target content to obtain search result information;
a display module 805, configured to display the search result information.
Optionally, as shown in fig. 10, the search module 804 includes:
a splitting sub-module 8041, configured to split the first target content into N pieces of sub-content;
the search sub-module 8042 is configured to perform search according to part of the sub-contents or all of the N sub-contents, respectively, to obtain search result information;
wherein N is a positive integer.
Optionally, as shown in fig. 11, the search submodule 8042 includes:
a determining unit 80421, configured to determine, according to a correspondence between sub-content and content type, whether each of the N sub-content has at least one corresponding content type;
the searching unit 80422 is configured to search according to the target sub-content to obtain search result information, where the target sub-content is a sub-content having at least one corresponding content type.
Optionally, the searching unit 80422 is configured to search, according to the target sub-content, in the database corresponding to each content type corresponding to the target sub-content, to obtain search result information;
the display module 805 is configured to display each content type corresponding to the target sub-content and the search result information, where each content type corresponding to the target sub-content and the search result obtained by searching in the database corresponding to each content type are in one-to-one correspondence when displaying.
Optionally, as shown in fig. 12, the extracting module 803 includes:
a splitting unit 8031, configured to split a second target content into M sub-contents if a selection operation on the second target content in the editable content is received;
a display unit 8032, configured to display the M sub-contents;
a selecting unit 8033, configured to receive a selection operation of a user on a sub-content of the M sub-contents;
an extracting unit 8034, configured to extract sub-content selected by a user in the M sub-contents;
wherein M is a positive integer.
The mobile terminal 800 can implement each process implemented by the mobile terminal in the method embodiments of fig. 1 to fig. 7, and is not described herein again to avoid repetition.
According to the mobile terminal 400 of the embodiment of the invention, when the display interface does not support the copy operation, the screenshot image of the display interface can be obtained, and the content in the screenshot image is converted into the editable content, so that the content in the display interface can be extracted, and the interface content extraction capability of the mobile terminal can be better.
Fig. 13 is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, where the mobile terminal 1300 includes, but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, a processor 1310, a power supply 1311, and the like. Those skilled in the art will appreciate that the mobile terminal architecture illustrated in fig. 13 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
Wherein the processor 1310 is configured to:
if a preset touch operation on a target position of a display interface of the mobile terminal is received, judging whether the content displayed by a target control corresponding to the target position supports a copy operation or not;
if the content displayed by the target control corresponding to the target position does not support the copying operation, acquiring a screen capture image of the display interface, and converting the content in the screen capture image into editable content;
and extracting part or all of the editable content.
Optionally, the extracting, performed by the processor 1310, part or all of the editable content includes:
if receiving a selection operation on a first target content in the editable content, extracting the first target content in the editable content;
the processor 1310 is further configured to:
searching according to the first target content to obtain search result information;
and displaying the search result information.
Optionally, the searching performed by the processor 1310 according to the first target content to obtain search result information includes:
splitting the first target content into N sub-contents;
searching according to part of or all of the N sub-contents respectively to obtain search result information;
wherein N is a positive integer.
Optionally, the searching performed by the processor 1310 according to part of or all of the N sub-contents respectively to obtain search result information includes:
respectively judging whether each sub-content in the N sub-contents has at least one corresponding content type according to the corresponding relation between the sub-contents and the content types;
and searching according to the target sub-content to obtain search result information, wherein the target sub-content is the sub-content with at least one corresponding content type.
Optionally, the searching performed by the processor 1310 according to the target sub-content to obtain the search result information includes:
searching in a database corresponding to each content type corresponding to the target sub-content according to the target sub-content to obtain search result information;
the displaying of the search result information performed by processor 1310 includes:
and displaying each content type corresponding to the target sub-content and the search result information, wherein each content type corresponding to the target sub-content corresponds to a search result searched in the database corresponding to each content type one by one when displaying.
Optionally, the extracting of part or all of the editable content performed by the processor 1310 includes:
splitting a second target content into M sub-contents if a selection operation of the second target content in the editable content is received;
displaying the M pieces of sub-content;
receiving a selection operation of a user on a sub-content in the M sub-contents;
extracting sub-content selected by a user in the M sub-contents;
wherein M is a positive integer.
The mobile terminal 1300 can implement each process implemented by the mobile terminal in the foregoing embodiments, and details are not repeated here to avoid repetition.
Thus, in the embodiment of the invention, when the display interface does not support the copy operation, the extraction of the content in the display interface can be realized by acquiring the screenshot image of the display interface and converting the content in the screenshot image into the editable content, so that the interface content extraction capability of the mobile terminal can be better.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 1301 may be configured to receive and transmit signals during a message transmission or call process, and specifically, receive downlink data from a base station and then process the received downlink data to the processor 1310; in addition, the uplink data is transmitted to the base station. In general, radio unit 1301 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 1301 can also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access through the network module 1302, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 1303 can convert audio data received by the radio frequency unit 1301 or the network module 1302 or stored in the memory 1309 into an audio signal and output as sound. Also, the audio output unit 1303 may also provide audio output related to a specific function performed by the mobile terminal 1300 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 1303 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1304 is used to receive audio or video signals. The input Unit 1304 may include a Graphics Processing Unit (GPU) 13041 and a microphone 13042, and the Graphics processor 13041 processes image data of still pictures or video obtained by an image capturing apparatus (such as a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit 1306. The image frames processed by the graphic processor 13041 may be stored in the memory 1309 (or other storage medium) or transmitted via the radio frequency unit 1301 or the network module 1302. The microphone 13042 can receive sounds and can process such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1301 in case of a phone call mode.
The mobile terminal 1300 also includes at least one sensor 1305, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 13061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 13061 and/or backlight when the mobile terminal 1300 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 1305 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described in detail herein.
The display unit 1306 is used to display information input by a user or information provided to the user. The Display unit 1306 may include a Display panel 13061, and the Display panel 13061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 1307 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 1307 includes a touch panel 13071 and other input devices 13072. Touch panel 13071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on touch panel 13071 or near touch panel 13071 using a finger, stylus, or any other suitable object or attachment). The touch panel 13071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1310, and receives and executes commands sent from the processor 1310. In addition, the touch panel 13071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 1307 may include other input devices 13072 in addition to the touch panel 13071. In particular, the other input devices 13072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 13071 can be overlaid on the display panel 13061, and when the touch panel 13071 detects a touch operation on or near the touch panel, the touch operation can be transmitted to the processor 1310 to determine the type of the touch event, and then the processor 1310 can provide a corresponding visual output on the display panel 13061 according to the type of the touch event. Although the touch panel 13071 and the display panel 13061 are shown in fig. 13 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 13071 and the display panel 13061 may be integrated to implement the input and output functions of the mobile terminal, and are not limited herein.
The interface unit 1308 is an interface through which an external device is connected to the mobile terminal 1300. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. Interface unit 1308 may be used to receive input from an external device (e.g., data information, power, etc.) and transmit the received input to one or more elements within mobile terminal 1300 or may be used to transmit data between mobile terminal 1300 and an external device.
The memory 1309 may be used to store software programs as well as various data. The memory 1309 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1309 can include high-speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 1310 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 1309 and calling data stored in the memory 1309, thereby performing overall monitoring of the mobile terminal. Processor 1310 may include one or more processing units; preferably, the processor 1310 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1310.
The mobile terminal 1300 may also include a power supply 1311 (e.g., a battery) for powering the various components, and preferably, the power supply 1311 may be logically coupled to the processor 1310 via a power management system that provides functionality for managing charging, discharging, and power consumption via the power management system.
In addition, the mobile terminal 1300 includes some functional modules that are not shown, and are not described herein again.
Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 1310, a memory 1309, and a computer program stored in the memory 1309 and capable of running on the processor 1310, where the computer program, when executed by the processor 1310, implements each process of the above-mentioned interface content processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, no further description is given here.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the interface content processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (4)
1. An interface content processing method is applied to a mobile terminal, and is characterized by comprising the following steps:
if a preset touch operation on a target position of a display interface of the mobile terminal is received, judging whether the content displayed by a target control corresponding to the target position supports a copy operation or not;
if the content displayed by the target control corresponding to the target position does not support the copying operation, acquiring a screen capture image of the display interface, and converting the content in the screen capture image into editable content;
extracting part or all of the editable content;
wherein the judging whether the content displayed by the target control corresponding to the target position supports the copy operation includes: judging whether the content displayed by the target control supports the copy operation or not according to the attribute of the target control; when the attribute of the target control does not contain the text attribute, determining that the content displayed by the target control does not support the copy operation;
the extracting of part or all of the editable content comprises:
if receiving a selection operation on a first target content in the editable content, extracting the first target content in the editable content;
after the extracting some or all of the editable content, the method further comprises:
searching according to the first target content to obtain search result information;
displaying the search result information; the searching according to the first target content to obtain search result information includes:
splitting the first target content into N sub-contents;
searching according to part of or all of the N sub-contents respectively to obtain search result information;
wherein N is a positive integer;
the searching according to part of or all of the N sub-contents respectively to obtain search result information includes:
respectively judging whether each sub-content in the N sub-contents has at least one corresponding content type according to the corresponding relation between the sub-contents and the content types;
searching according to the target sub-content to obtain search result information, wherein the target sub-content is a sub-content with at least one corresponding content type;
the searching according to the target sub-content to obtain the search result information comprises the following steps:
searching in a database corresponding to each content type corresponding to the target sub-content according to the target sub-content to obtain search result information;
the displaying the search result information includes:
displaying each content type corresponding to the target sub-content and the search result information, wherein each content type corresponding to the target sub-content corresponds to a search result searched in a database corresponding to each content type one by one when displaying;
the extracting of part or all of the editable content comprises:
after the contents in the screenshot images are converted into editable contents, the editable contents are subjected to frame division identification processing, the editable contents subjected to frame division identification processing are displayed, then the selection operation of a user on part or all of the identification frames is received, and the editable contents corresponding to the part or all of the identification frames selected by the user are extracted.
2. The method of claim 1, wherein extracting some or all of the editable content comprises:
splitting a second target content into M sub-contents if a selection operation of the second target content in the editable content is received;
displaying the M pieces of sub-content;
receiving a selection operation of a user on a sub-content in the M sub-contents;
extracting sub-content selected by a user in the M sub-contents;
wherein M is a positive integer.
3. A mobile terminal, comprising:
the judging module is used for judging whether the content displayed by the target control corresponding to the target position supports the copying operation or not if the preset touch operation of the target position of the display interface of the mobile terminal is received;
the conversion module is used for acquiring a screen capture image of the display interface and converting the content in the screen capture image into editable content if the fact that the content displayed by the target control corresponding to the target position does not support the copying operation is determined;
the extracting module is used for extracting part or all of the editable contents;
wherein the judging whether the content displayed by the target control corresponding to the target position supports the copy operation includes: judging whether the content displayed by the target control supports the copy operation or not according to the attribute of the target control; when the attribute of the target control does not contain the text attribute, determining that the content displayed by the target control does not support the copy operation;
the extracting module is used for extracting a first target content in the editable content if the selecting operation of the first target content in the editable content is received;
the mobile terminal further includes:
the searching module is used for searching according to the first target content to obtain searching result information;
the display module is used for displaying the search result information;
the search module comprises:
a splitting sub-module, configured to split the first target content into N pieces of sub-content;
the searching sub-module is used for searching according to partial sub-content or all sub-content in the N pieces of sub-content respectively to obtain searching result information;
wherein N is a positive integer;
the search submodule includes:
the judging unit is used for respectively judging whether each sub-content in the N sub-contents has at least one corresponding content type according to the corresponding relation between the sub-contents and the content types;
the searching unit is used for searching according to the target sub-content to obtain searching result information, wherein the target sub-content is a sub-content with at least one corresponding content type;
the searching unit is used for searching in the database corresponding to each content type corresponding to the target sub-content according to the target sub-content to obtain searching result information;
the display module is used for displaying each content type corresponding to the target sub-content and the search result information, wherein each content type corresponding to the target sub-content corresponds to a search result searched in the database corresponding to each content type one by one when being displayed;
the extraction module is further configured to:
after the contents in the screenshot images are converted into editable contents, the editable contents are subjected to frame division identification processing, the editable contents subjected to frame division identification processing are displayed, then the selection operation of a user on part or all of the identification frames is received, and the editable contents corresponding to the part or all of the identification frames selected by the user are extracted.
4. The mobile terminal of claim 3, wherein the extraction module comprises:
the splitting unit is used for splitting a second target content into M sub-contents if the selection operation of the second target content in the editable content is received;
a display unit for displaying the M sub-contents;
the selection unit is used for receiving the selection operation of the user on the sub-content in the M sub-contents;
an extracting unit, configured to extract sub-content selected by a user in the M sub-contents;
wherein M is a positive integer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810409053.7A CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810409053.7A CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108595107A CN108595107A (en) | 2018-09-28 |
| CN108595107B true CN108595107B (en) | 2020-10-16 |
Family
ID=63620382
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810409053.7A Active CN108595107B (en) | 2018-05-02 | 2018-05-02 | Interface content processing method and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108595107B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109635683A (en) * | 2018-11-27 | 2019-04-16 | 维沃移动通信有限公司 | Method for extracting content and terminal device in a kind of image |
| CN109634703A (en) * | 2018-12-13 | 2019-04-16 | 北京旷视科技有限公司 | Image processing method, device, system and storage medium based on canvas label |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8787690B2 (en) * | 2008-11-12 | 2014-07-22 | Abbyy Development Llc | Binarizing an image |
| CN103838501A (en) * | 2012-11-20 | 2014-06-04 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104636322B (en) * | 2015-03-03 | 2018-01-23 | 广东欧珀移动通信有限公司 | The method and device that a kind of text replicates |
| CN106202269A (en) * | 2016-06-28 | 2016-12-07 | 广东欧珀移动通信有限公司 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
| CN107256109B (en) * | 2017-05-27 | 2021-03-16 | 北京小米移动软件有限公司 | Information display method and device and terminal |
-
2018
- 2018-05-02 CN CN201810409053.7A patent/CN108595107B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108595107A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108470041B (en) | Information searching method and mobile terminal | |
| CN109561211B (en) | Information display method and mobile terminal | |
| CN110830362B (en) | Content generation method and mobile terminal | |
| CN109165320B (en) | Information collection method and mobile terminal | |
| CN111274416A (en) | Chat information searching method and electronic equipment | |
| CN108733800A (en) | A kind of global search method, terminal and computer readable storage medium | |
| CN108595107B (en) | Interface content processing method and mobile terminal | |
| CN109388456B (en) | Head portrait selection method and mobile terminal | |
| CN109495638B (en) | Information display method and terminal | |
| CN109286728B (en) | Call content processing method and terminal equipment | |
| CN110989847A (en) | Information recommendation method and device, terminal equipment and storage medium | |
| CN107992615B (en) | Website recommendation method, server and terminal | |
| CN111143614A (en) | Video display method and electronic equipment | |
| CN110990679A (en) | Information searching method and electronic equipment | |
| JP2021532492A (en) | Character input method and terminal | |
| CN105095161B (en) | Method and device for displaying rich text information | |
| CN108459813A (en) | A kind of searching method and mobile terminal | |
| CN109922199B (en) | Contact information processing method and terminal | |
| CN109063076B (en) | Picture generation method and mobile terminal | |
| CN110045892B (en) | Display method and terminal equipment | |
| CN108804615B (en) | Sharing method and server | |
| CN111125307A (en) | Chat record query method and electronic equipment | |
| CN107562332B (en) | Information searching method, mobile terminal and computer readable storage medium | |
| WO2019076375A1 (en) | Short message interface display method, mobile terminal and readable storage medium | |
| CN111277675B (en) | Group member sorting method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |