CN107977652A - The extracting method and mobile terminal of a kind of screen display content - Google Patents
The extracting method and mobile terminal of a kind of screen display content Download PDFInfo
- Publication number
- CN107977652A CN107977652A CN201711395840.2A CN201711395840A CN107977652A CN 107977652 A CN107977652 A CN 107977652A CN 201711395840 A CN201711395840 A CN 201711395840A CN 107977652 A CN107977652 A CN 107977652A
- Authority
- CN
- China
- Prior art keywords
- screenshot picture
- pixel
- picture
- mobile terminal
- display content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/413—Classification of content, e.g. text, photographs or tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides the extracting method and mobile terminal of a kind of screen display content, this method includes：Screen printing display content, obtains screenshot picture；According to the pixel value of the screenshot picture, the content of the screenshot picture is identified；If identifying, the screenshot picture includes image, preserves the part or all of content of the screenshot picture.The present invention identifies image content according to the pixel value of screenshot picture, so that rapid saving picture, simplifies the operating process for preserving picture, improves the degree of intelligence of mobile terminal.
Description
Technical field
The present invention relates to the technical field of communications applications, more particularly to a kind of extracting method of screen display content and movement
Terminal.
Background technology
As the content on intelligent terminal is increasingly abundanter, user is frequently encountered the field for needing to extract content in screen
Scape, as extracted picture or text in screen.Multifarious, the different boundary of the pattern of miscellaneous application rollouts content
The operation that face allows is also limited.
For example, when needing to preserve the picture in current interface, it usually needs long-press current interface, and select to preserve picture
Option, it is cumbersome.
The content of the invention
It is an object of the invention to provide the extracting method and mobile terminal of a kind of screen display content, to solve existing carry
The problem of taking the mode of picture cumbersome.
In a first aspect, an embodiment of the present invention provides a kind of extracting method of screen display content, applied to mobile terminal,
Including：
Screen printing display content, obtains screenshot picture；
According to the pixel value of the screenshot picture, the content of the screenshot picture is identified；
If identifying, the screenshot picture includes image, preserves the part or all of content of the screenshot picture.
Second aspect, the embodiment of the present invention additionally provide a kind of mobile terminal, including：
Acquisition module, for screen printing display content, obtains screenshot picture；
First identification module, for the pixel value according to the screenshot picture, knows the content of the screenshot picture
Not；
Processing module, if identifying that the screenshot picture includes image for identification module, preserves the screenshot picture
Part or all of content.
The third aspect, the embodiment of the present invention additionally provide a kind of mobile terminal, including：Memory, processor and it is stored in
On memory and the computer program that can run on a processor, realized such as when the computer program is performed by the processor
The step of extracting method of the upper screen display content.
Fourth aspect, the embodiment of the present invention additionally provide a kind of computer-readable recording medium, described computer-readable to deposit
Computer program is stored with storage media, the computer program realizes screen display content as described above when being executed by processor
Extracting method the step of.
The embodiment of the present invention has the advantages that：
In the embodiment of the present invention, image content is identified according to the pixel value of screenshot picture, so that rapid saving picture, simplifies
The operating process of picture is preserved, improves the degree of intelligence of mobile terminal.
Brief description of the drawings
Fig. 1 is the flow chart of the extracting method of the screen display content of the embodiment of the present invention；
Fig. 2 is one of module diagram of mobile terminal of the embodiment of the present invention；
Fig. 3 is the two of the module diagram of the mobile terminal of the embodiment of the present invention；
Fig. 4 is the structure diagram of the mobile terminal of the embodiment of the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Described into ground, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts
Embodiment, belongs to the scope of protection of the invention.
As shown in Figure 1, the embodiment provides a kind of extracting method of screen display content, applied to mobile whole
End, including：
Step 101：Screen printing display content, obtains screenshot picture.
Specifically, when detecting the predetermined operation to the programmable button of mobile terminal, screen printing display content is triggered.
The programmable button includes at least one button of mobile terminal, can be according to user's need such as the volume key and power key of mobile terminal
Ask and pre-set above-mentioned predetermined key.
Here, screen content in advance being achieveed the purpose that to the intercept operation of screen content according to user, versatility is high, and
It is easy to operate.
Step 102：According to the pixel value of the screenshot picture, the content of the screenshot picture is identified.
Here, after obtaining above-mentioned screenshot picture, which is preserved, and obtains each picture in the screenshot picture
The rgb value (pixel value) of vegetarian refreshments, according to the rgb value of each pixel, identifies in the screenshot picture whether include image.
Step 103：If identifying, the screenshot picture includes image, preserves the part or all of interior of the screenshot picture
Hold.
It is assumed that only including image in above-mentioned screenshot picture, then the full content of the screenshot picture is preserved, if above-mentioned screenshotss
Image and word are included at the same time in picture, then preserves the snapshot target partial content, i.e., only preserves in the screenshot picture
Image section.
Here, when including image in identifying screenshot picture, can automatically to the image section in screenshot picture into
Row preserves, and realizes the purpose of rapid extraction picture.
In the embodiment of the present invention, image content is identified according to the pixel value of screenshot picture, so that rapid saving picture, simplifies
The operating process of picture is preserved, improves the degree of intelligence of mobile terminal.
Further, as a kind of optional implementation, above-mentioned steps 102 according to the pixel value of the screenshot picture,
The content of the screenshot picture is identified, including：
According to the pixel value of each pixel in the screenshot picture, judge to whether there is target picture in the screenshot picture
Plain block；If identify that the screenshot picture includes image there are the target pixel block in the screenshot picture；
Wherein, the difference of the pixel value of neighbor pixel is less than the first predetermined threshold value in the target pixel block, and forms
It is default that the ratio of the number of the pixel of the target pixel block and the number of total pixel in the screenshot picture is more than second
Threshold value.
In the embodiment of the present invention, it can determine whether the similar pixel of rgb value whether close to and the pixel that rgb value is similar
Whether the pixel region of composition is regular.If the similar pixel of rgb value close to and pixel region without rule, can sentence
Break as there are image in Target Photo.The similar pixel of rgb value refers to that the difference of rgb value is less than the pixel of the first predetermined threshold value
Point, the similar pixel of rgb value is close to referring to that the distance between similar pixel of rgb value is less than the 4th predetermined threshold value.
In a specific embodiment of the present invention, the corresponding color-values of minimum rgb value are background colour for most shallow color,
Each pixel of Target Photo is traveled through, picture is traveled through using the searching algorithm of depth-first to the pixel of each non-background colour
The adjacent non-background colour pixel of vegetarian refreshments, often gets a similar pixel point and counting is added one, every in calculating in Target Photo
The pixel quantity of a non-background colour similar pixel block, includes if the larger block of pixels of pixel quantity then may determine that
Picture, because if being not have larger block of pixels if text.
As another optional implementation, above-mentioned steps 102 are according to the pixel value of the screenshot picture, to described section
The content of screen picture is identified, including：
According to the pixel value of each pixel in the screenshot picture, the number of the corresponding color of the screenshot picture is determined
Amount, wherein, different pixel values corresponds to different colors；If it is default that the quantity of the corresponding color of the screenshot picture is more than the 3rd
Threshold value, it is determined that image is included in the screenshot picture.
Image in the implementation is coloured image, and in the embodiment of the present invention, all possible value of rgb value has 255*
255*255=16581375 kinds, the array for creating 16581375 sizes are denoted as a, and array value is initialized as 0, travels through target
Each pixel of picture, takes the rgb value of each pixel to be denoted as value, and corresponds to each and every one more pixels according to same rgb value
Point, sets the rgb value corresponding a [value] value, and such as the first rgb value corresponds to 5 pixels, then by the corresponding a of the first rgb value
[value] value is arranged to 5, the quantity of the corresponding pixel of recordable picture each color.Array is traveled through, array value is more than to 0 member
Prime number amount is as the corresponding number of colors of picture, if the quantity of color may determine that the picture is not coloured image less than 20.
Further, 101 screen printing display content of above-mentioned steps, after obtaining screenshot picture, further includes：
Identify whether the screenshot picture includes word；If the screenshot picture includes word, from the screenshot picture
Middle extraction word.
In a specific embodiment of the present invention, it can identify in screenshot picture whether include word by ocr technologies, specifically
, detection includes the region of word, such as carries out classification to the content in screenshot picture by faster-rcnn algorithms and find to include
The region of word, second step identify specific word by rnn/lstm/gru+ctc algorithms.Included in above-mentioned screenshot picture
During word, then it can extract out corresponding word and replicated, simplify the operation that user replicates text.
Further, screen printing display content in above-mentioned steps 101, obtains screenshot picture, including：
When detecting the predetermined operation to the programmable button of mobile terminal, the choice box inputted in screen is obtained；Interception
Display content in the choice box, obtains screenshot picture.
The programmable button includes at least one button of mobile terminal, can root such as the volume key and power key of mobile terminal
Above-mentioned predetermined key is pre-set according to user demand.For example, when user presses volume key and power key at the same time, screen increases by one layer
Transparent mask, to prompt user to enter screen content extraction pattern.
Wherein, user can input above-mentioned choice box from anywhere in screen, and user can adjust the big of the selection frame
Small and position.When user stops the size and location of adjustment choice box, the area of the choice box will be corresponded in the screen
Domain, is determined as the target area.
In the embodiment of the present invention, when detecting the predetermined operation to the programmable button of mobile terminal, triggering extraction screen
Content, has higher versatility.
The extracting method of the screen display content of the embodiment of the present invention, screen printing display content, obtains screenshot picture；Root
According to the pixel value of the screenshot picture, the content of the screenshot picture is identified；If identifying, the screenshot picture includes
Image, then preserve the part or all of content of the screenshot picture, and picture extracting method of the invention has higher versatility,
And the operation for preserving picture is greatly simplified, facilitate user's rapid extraction picture.
As shown in Fig. 2, the embodiment of the present invention additionally provides a kind of mobile terminal 200, including：
Acquisition module 201, for screen printing display content, obtains screenshot picture；
First identification module 202, for the pixel value according to the screenshot picture, carries out the content of the screenshot picture
Identification；
Processing module 203, if identifying that the screenshot picture includes image for identification module, preserves the snapshot
The part or all of content of piece.
The mobile terminal of the embodiment of the present invention, as shown in figure 3, first identification module 202 includes：
Judging submodule 2021, for the pixel value according to each pixel in the screenshot picture, judges the screenshotss
It whether there is target pixel block in picture；
Submodule 2022 is identified, if for, there are the target pixel block, identifying described cut in the screenshot picture
Screen picture includes image；
Wherein, the difference of the pixel value of neighbor pixel is less than the first predetermined threshold value in the target pixel block, and forms
It is default that the ratio of the number of the pixel of the target pixel block and the number of total pixel in the screenshot picture is more than second
Threshold value.
The mobile terminal of the embodiment of the present invention, first identification module 202 include：
First determination sub-module 2023, for the pixel value according to each pixel in the screenshot picture, determines described
The quantity of the corresponding color of screenshot picture, wherein, different pixel values corresponds to different colors；
Second determination sub-module 2024, if the quantity for the corresponding color of the screenshot picture is more than the 3rd default threshold
Value, it is determined that image is included in the screenshot picture.
The mobile terminal of the embodiment of the present invention, further includes：
Second identification module 204, for identifying whether the screenshot picture includes word；
Extraction module 205, if including word for the screenshot picture, word is extracted from the screenshot picture.
The mobile terminal of the embodiment of the present invention, the acquisition module 201 include：
Acquisition submodule 2011, during for detecting the predetermined operation to the programmable button of mobile terminal, obtains in screen
The choice box of middle input；
Submodule 2012 is intercepted, for intercepting the display content in the choice box, obtains screenshot picture.
It should be noted that the mobile terminal is mobile terminal corresponding with above method embodiment, the above method is implemented
All implementations can also reach identical technique effect suitable for the embodiment of the mobile terminal in example.
The mobile terminal of the embodiment of the present invention, identifies image content, so that rapid saving according to the pixel value of screenshot picture
Picture, simplifies the operating process for preserving picture, improves the degree of intelligence of mobile terminal.
Fig. 4 is a kind of hardware architecture diagram for the mobile terminal for realizing each embodiment of the present invention, the mobile terminal 400
Including but not limited to：It is radio frequency unit 401, mixed-media network modules mixed-media 402, audio output unit 403, input unit 404, sensor 405, aobvious
Show the components such as unit 406, user input unit 407, interface unit 408, memory 409, processor 410 and power supply 411.
It will be understood by those skilled in the art that the mobile terminal structure shown in Fig. 4 does not form the restriction to mobile terminal, it is mobile whole
End can be included than illustrating more or fewer components, either combine some components or different components arrangement.In the present invention
In embodiment, mobile terminal includes but not limited to mobile phone, tablet computer, laptop, palm PC, car-mounted terminal, can wear
Wear equipment and pedometer etc..
Wherein, processor 410, for screen printing display content, obtain screenshot picture；According to the picture of the screenshot picture
Element value, is identified the content of the screenshot picture；If identifying, the screenshot picture includes image, preserves the screenshotss
The part or all of content of picture.
The above-mentioned technical proposal of the embodiment of the present invention, screen printing display content, obtains screenshot picture；According to the screenshotss
The pixel value of picture, is identified the content of the screenshot picture；If identifying, the screenshot picture includes image, preserves
The part or all of content of the screenshot picture, picture extracting method of the invention have higher versatility, and greatly simple
Change the operation for preserving picture, facilitate user's rapid extraction picture.
It should be understood that in the embodiment of the present invention, radio frequency unit 401 can be used for receiving and sending messages or communication process in, signal
Reception and transmission, specifically, by from base station downlink data receive after, handled to processor 410；In addition, by uplink
Data sending is to base station.In general, radio frequency unit 401 includes but not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 401 can also by wireless communication system and network and other set
Standby communication.
Mobile terminal has provided wireless broadband internet to the user by mixed-media network modules mixed-media 402 and has accessed, and such as helps user to receive
Send e-mails, browse webpage and access streaming video etc..
Audio output unit 403 can be receiving by radio frequency unit 401 or mixed-media network modules mixed-media 402 or in memory 409
It is sound that the voice data of storage, which is converted into audio signal and exports,.Moreover, audio output unit 403 can also be provided and moved
The relevant audio output of specific function that dynamic terminal 400 performs is (for example, call signal receives sound, message sink sound etc.
Deng).Audio output unit 403 includes loudspeaker, buzzer and receiver etc..
Input unit 404 is used to receive audio or video signal.Input unit 404 can include graphics processor
(Graphics Processing Unit, GPU) 4041 and microphone 4042, graphics processor 4041 is in video acquisition mode
Or the static images or the view data of video obtained in image capture mode by image capture apparatus (such as camera) carry out
Reason.Picture frame after processing may be displayed on display unit 406.Picture frame after the processing of graphics processor 4041 can be deposited
Storage is transmitted in memory 409 (or other storage mediums) or via radio frequency unit 401 or mixed-media network modules mixed-media 402.Mike
Wind 4042 can receive sound, and can be voice data by such acoustic processing.Voice data after processing can be
The form output of mobile communication base station can be sent to via radio frequency unit 401 by being converted in the case of telephone calling model.
Mobile terminal 400 further includes at least one sensor 405, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 4061, and proximity sensor can close when mobile terminal 400 is moved in one's ear
Display panel 4061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axis) size of acceleration, size and the direction of gravity are can detect that when static, available for identification mobile terminal posture (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；Pass
Sensor 405 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet
Meter, thermometer, infrared ray sensor etc. are spent, details are not described herein.
Display unit 406 is used for the information for showing by information input by user or being supplied to user.Display unit 406 can wrap
Display panel 4061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used
Forms such as (Organic Light-Emitting Diode, OLED) configures display panel 4061.
User input unit 407 can be used for the numeral or character information for receiving input, and produce the use with mobile terminal
The key signals input that family is set and function control is related.Specifically, user input unit 407 include contact panel 4071 and
Other input equipments 4072.Contact panel 4071, also referred to as touch-screen, collect user on it or neighbouring touch operation
(for example user uses any suitable objects or annex such as finger, stylus on contact panel 4071 or in contact panel 4071
Neighbouring operation).Contact panel 4071 may include both touch detecting apparatus and touch controller.Wherein, touch detection
Device detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch controller；Touch control
Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 410, receiving area
Manage the order that device 410 is sent and performed.It is furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Type realizes contact panel 4071.Except contact panel 4071, user input unit 407 can also include other input equipments
4072.Specifically, other input equipments 4072 can include but is not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, operation lever, details are not described herein.
Further, contact panel 4071 can be covered on display panel 4061, when contact panel 4071 is detected at it
On or near touch operation after, send to processor 410 with determine touch event type, be followed by subsequent processing device 410 according to touch
The type for touching event provides corresponding visual output on display panel 4061.Although in Fig. 4, contact panel 4071 and display
Panel 4061 is the component independent as two to realize the function that outputs and inputs of mobile terminal, but in some embodiments
In, can be integrated by contact panel 4071 and display panel 4061 and realize the function that outputs and inputs of mobile terminal, it is specific this
Place does not limit.
Interface unit 408 is the interface that external device (ED) is connected with mobile terminal 400.For example, external device (ED) can include
Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end
Mouth, port, audio input/output (I/O) port, video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 408 can be used for receive the input (for example, data message, electric power etc.) from external device (ED) and
One or more elements that the input received is transferred in mobile terminal 400 can be used in 400 He of mobile terminal
Data are transmitted between external device (ED).
Memory 409 can be used for storage software program and various data.Memory 409 can mainly include storing program area
And storage data field, wherein, storing program area can storage program area, application program (such as the sound needed at least one function
Sound playing function, image player function etc.) etc.；Storage data field can store according to mobile phone use created data (such as
Voice data, phone directory etc.) etc..In addition, memory 409 can include high-speed random access memory, can also include non-easy
The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 410 is the control centre of mobile terminal, utilizes each of various interfaces and the whole mobile terminal of connection
A part, by running or performing the software program and/or module that are stored in memory 409, and calls and is stored in storage
Data in device 409, perform the various functions and processing data of mobile terminal, so as to carry out integral monitoring to mobile terminal.Place
Reason device 410 may include one or more processing units；Preferably, processor 410 can integrate application processor and modulatedemodulate is mediated
Device is managed, wherein, application processor mainly handles operating system, user interface and application program etc., and modem processor is main
Handle wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 410.
Mobile terminal 400 can also include the power supply 411 (such as battery) to all parts power supply, it is preferred that power supply 411
Can be logically contiguous by power-supply management system and processor 410, so as to realize management charging by power-supply management system, put
The function such as electricity and power managed.
In addition, mobile terminal 400 includes some unshowned function modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor, and memory, is stored in memory
Computer program that is upper and can running on the processor, the computer program realize that above-mentioned screen is shown when being executed by processor
Show each process of the extracting method embodiment of content, and identical technique effect can be reached, it is no longer superfluous here to avoid repeating
State.
The embodiment of the present invention also provides a kind of computer-readable recording medium, and meter is stored with computer-readable recording medium
Calculation machine program, the computer program realize each of the extracting method embodiment of above-mentioned screen display content when being executed by processor
Process, and identical technique effect can be reached, to avoid repeating, which is not described herein again.Wherein, the computer-readable storage
Medium, such as read-only storage (Read-Only Memory, abbreviation ROM), random access memory (Random Access
Memory, abbreviation RAM), magnetic disc or CD etc..
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements not only include those key elements, and
And other elements that are not explicitly listed are further included, or further include as this process, method, article or device institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there are other identical element in the process of key element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme substantially in other words does the prior art
Going out the part of contribution can be embodied in the form of software product, which is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used so that a station terminal (can be mobile phone, computer, services
Device, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
The embodiment of the present invention is described above in conjunction with attached drawing, but the invention is not limited in above-mentioned specific
Embodiment, above-mentioned embodiment is only schematical, rather than restricted, those of ordinary skill in the art
Under the enlightenment of the present invention, in the case of present inventive concept and scope of the claimed protection is not departed from, it can also make very much
Form, belongs within the protection of the present invention.
Claims (12)
- A kind of 1. extracting method of screen display content, applied to mobile terminal, it is characterised in that including：Screen printing display content, obtains screenshot picture；According to the pixel value of the screenshot picture, the content of the screenshot picture is identified；If identifying, the screenshot picture includes image, preserves the part or all of content of the screenshot picture.
- 2. the extracting method of screen display content according to claim 1, it is characterised in that described according to the snapshot The pixel value of piece, is identified the content of the screenshot picture, including：According to the pixel value of each pixel in the screenshot picture, judge to whether there is object pixel in the screenshot picture Block；If identify that the screenshot picture includes image there are the target pixel block in the screenshot picture；Wherein, the difference of the pixel value of neighbor pixel is less than the first predetermined threshold value in the target pixel block, and described in composition The number of the pixel of target pixel block and the ratio of the number of total pixel in the screenshot picture are more than the second predetermined threshold value.
- 3. the extracting method of screen display content according to claim 1, it is characterised in that described according to the snapshot The pixel value of piece, is identified the content of the screenshot picture, including：According to the pixel value of each pixel in the screenshot picture, the quantity of the corresponding color of the screenshot picture is determined, its In, different pixel values corresponds to different colors；If the quantity of the corresponding color of the screenshot picture is more than the 3rd predetermined threshold value, it is determined that figure is included in the screenshot picture Picture.
- 4. the extracting method of screen display content according to claim 1, it is characterised in that in the screen printing is shown Hold, after obtaining screenshot picture, further include：Identify whether the screenshot picture includes word；If the screenshot picture includes word, word is extracted from the screenshot picture.
- 5. the extracting method of screen display content according to claim 1, it is characterised in that in the screen printing is shown Hold, obtain screenshot picture, including：When detecting the predetermined operation to the programmable button of mobile terminal, the choice box inputted in screen is obtained；The display content in the choice box is intercepted, obtains screenshot picture.
- A kind of 6. mobile terminal, it is characterised in that including：Acquisition module, for screen printing display content, obtains screenshot picture；First identification module, for the pixel value according to the screenshot picture, is identified the content of the screenshot picture；Processing module, if identifying that the screenshot picture includes image for identification module, preserves the portion of the screenshot picture Point or full content.
- 7. mobile terminal according to claim 6, it is characterised in that first identification module includes：Judging submodule, for the pixel value according to each pixel in the screenshot picture, judge be in the screenshot picture It is no that there are target pixel block；Submodule is identified, if for, there are the target pixel block, identifying the screenshot picture bag in the screenshot picture Containing image；Wherein, the difference of the pixel value of neighbor pixel is less than the first predetermined threshold value in the target pixel block, and described in composition The number of the pixel of target pixel block and the ratio of the number of total pixel in the screenshot picture are more than the second predetermined threshold value.
- 8. mobile terminal according to claim 6, it is characterised in that first identification module includes：First determination sub-module, for the pixel value according to each pixel in the screenshot picture, determines the screenshot picture The quantity of corresponding color, wherein, different pixel values corresponds to different colors；Second determination sub-module, if the quantity for the corresponding color of the screenshot picture is more than the 3rd predetermined threshold value, it is determined that Image is included in the screenshot picture.
- 9. mobile terminal according to claim 6, it is characterised in that further include：Second identification module, for identifying whether the screenshot picture includes word；Extraction module, if including word for the screenshot picture, word is extracted from the screenshot picture.
- 10. mobile terminal according to claim 6, it is characterised in that the acquisition module includes：Acquisition submodule, during for detecting the predetermined operation to the programmable button of mobile terminal, obtains what is inputted in screen Choice box；Submodule is intercepted, for intercepting the display content in the choice box, obtains screenshot picture.
- A kind of 11. mobile terminal, it is characterised in that including：Memory, processor and storage are on a memory and can be in processor The computer program of upper operation, is realized such as any one of claim 1 to 5 when the computer program is performed by the processor The step of extracting method of the screen display content.
- 12. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program quilt Realized when processor performs as any one of claim 1 to 5 the step of the extracting method of screen display content.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711395840.2A CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711395840.2A CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107977652A true CN107977652A (en) | 2018-05-01 |
| CN107977652B CN107977652B (en) | 2020-08-28 |
Family
ID=62007279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711395840.2A Active CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107977652B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109358793A (en) * | 2018-09-27 | 2019-02-19 | 维沃移动通信有限公司 | A kind of screenshotss method and mobile terminal |
| CN109376658A (en) * | 2018-10-26 | 2019-02-22 | 信雅达系统工程股份有限公司 | A kind of OCR method based on deep learning |
| CN109684980A (en) * | 2018-09-19 | 2019-04-26 | 腾讯科技（深圳）有限公司 | Automatic marking method and device |
| CN109919157A (en) * | 2019-03-28 | 2019-06-21 | 北京易达图灵科技有限公司 | A kind of vision positioning method and device |
| CN109948495A (en) * | 2019-03-11 | 2019-06-28 | 河南发明哥知识产权代理有限公司 | A kind of screenshot method, terminal and computer readable storage medium |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
| CN110297681A (en) * | 2019-06-24 | 2019-10-01 | 腾讯科技（深圳）有限公司 | Image processing method, device, terminal and storage medium |
| CN110647878A (en) * | 2019-08-05 | 2020-01-03 | 紫光西部数据(南京)有限公司 | Data processing method based on screen shot picture |
| CN113221866A (en) * | 2021-04-30 | 2021-08-06 | 东方蓝天钛金科技有限公司 | Equipment data acquisition system and method based on image recognition |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103246572A (en) * | 2013-03-27 | 2013-08-14 | 东莞宇龙通信科技有限公司 | Method and system for synchronizing application messages |
| CN104657423A (en) * | 2015-01-16 | 2015-05-27 | 北京合辉信息技术有限公司 | Method and device thereof for sharing contents of applications |
| CN105204745A (en) * | 2015-09-30 | 2015-12-30 | 百度在线网络技术（北京）有限公司 | Screen capture method and device for mobile terminal |
| CN105224644A (en) * | 2015-09-28 | 2016-01-06 | 小米科技有限责任公司 | Information classification approach and device |
| CN106354482A (en) * | 2015-07-13 | 2017-01-25 | 西安中兴新软件有限责任公司 | Method and device for acquiring automated scripts and application method and device of automated scripts |
| WO2017146454A1 (en) * | 2016-02-26 | 2017-08-31 | 삼성전자 주식회사 | Method and device for recognising content |
-
2017
- 2017-12-21 CN CN201711395840.2A patent/CN107977652B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103246572A (en) * | 2013-03-27 | 2013-08-14 | 东莞宇龙通信科技有限公司 | Method and system for synchronizing application messages |
| CN104657423A (en) * | 2015-01-16 | 2015-05-27 | 北京合辉信息技术有限公司 | Method and device thereof for sharing contents of applications |
| CN106354482A (en) * | 2015-07-13 | 2017-01-25 | 西安中兴新软件有限责任公司 | Method and device for acquiring automated scripts and application method and device of automated scripts |
| CN105224644A (en) * | 2015-09-28 | 2016-01-06 | 小米科技有限责任公司 | Information classification approach and device |
| CN105204745A (en) * | 2015-09-30 | 2015-12-30 | 百度在线网络技术（北京）有限公司 | Screen capture method and device for mobile terminal |
| WO2017146454A1 (en) * | 2016-02-26 | 2017-08-31 | 삼성전자 주식회사 | Method and device for recognising content |
Non-Patent Citations (2)
| Title |
|---|
| FEI GAO等: "Fault Diagnosis for Snapshot Device through Identifying Image Abnormal Features", 《2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP 2012) 》 * |
| 郭华源等: "双视点 3D 视频文件的裸眼立体组合投影实时显示算法", 《计算机辅助设计与图形学学报》 * |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109684980A (en) * | 2018-09-19 | 2019-04-26 | 腾讯科技（深圳）有限公司 | Automatic marking method and device |
| CN109684980B (en) * | 2018-09-19 | 2022-12-13 | 腾讯科技（深圳）有限公司 | Automatic scoring method and device |
| CN109358793A (en) * | 2018-09-27 | 2019-02-19 | 维沃移动通信有限公司 | A kind of screenshotss method and mobile terminal |
| CN109376658A (en) * | 2018-10-26 | 2019-02-22 | 信雅达系统工程股份有限公司 | A kind of OCR method based on deep learning |
| CN109948495A (en) * | 2019-03-11 | 2019-06-28 | 河南发明哥知识产权代理有限公司 | A kind of screenshot method, terminal and computer readable storage medium |
| CN109919157A (en) * | 2019-03-28 | 2019-06-21 | 北京易达图灵科技有限公司 | A kind of vision positioning method and device |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
| CN110297681A (en) * | 2019-06-24 | 2019-10-01 | 腾讯科技（深圳）有限公司 | Image processing method, device, terminal and storage medium |
| CN110297681B (en) * | 2019-06-24 | 2024-06-11 | 腾讯科技（深圳）有限公司 | Image processing method, device, terminal and storage medium |
| CN110647878A (en) * | 2019-08-05 | 2020-01-03 | 紫光西部数据(南京)有限公司 | Data processing method based on screen shot picture |
| CN113221866A (en) * | 2021-04-30 | 2021-08-06 | 东方蓝天钛金科技有限公司 | Equipment data acquisition system and method based on image recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107977652B (en) | 2020-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107977652A (en) | The extracting method and mobile terminal of a kind of screen display content | |
| CN107798303A (en) | A kind of method and mobile terminal for adjusting screen backlight | |
| CN107608514A (en) | Information processing method and mobile terminal | |
| CN107908383A (en) | A kind of screen color method of adjustment, device and mobile terminal | |
| CN107665697A (en) | The adjusting method and mobile terminal of a kind of screen intensity | |
| CN108347759A (en) | A kind of anti-interference method and mobile terminal of flexible screen | |
| CN108415652A (en) | A kind of text handling method and mobile terminal | |
| CN107734260A (en) | A kind of image processing method and mobile terminal | |
| CN108492246A (en) | A kind of image processing method, device and mobile terminal | |
| CN108038827A (en) | Image processing method, mobile terminal and computer-readable recording medium | |
| CN107845057A (en) | One kind is taken pictures method for previewing and mobile terminal | |
| CN107845363B (en) | A kind of display control method and mobile terminal | |
| CN107895352A (en) | A kind of image processing method and mobile terminal | |
| CN110035149A (en) | A kind of multiple antennas optimization method and mobile terminal | |
| CN107958161A (en) | A kind of multitask display methods and mobile terminal | |
| CN108037966A (en) | A kind of interface display method, device and mobile terminal | |
| CN107911540A (en) | Profile switching method and terminal device | |
| CN109656437A (en) | A kind of information display method and terminal device | |
| CN108093306A (en) | A kind of barrage display methods and mobile terminal | |
| CN107888765A (en) | A kind of method of handoff scenario pattern, mobile terminal | |
| CN107864336A (en) | A kind of image processing method, mobile terminal | |
| CN108600544A (en) | A kind of Single-hand control method and terminal | |
| CN110096203A (en) | A kind of screenshot method and mobile terminal | |
| CN109727212A (en) | A kind of image processing method and mobile terminal | |
| CN108287745A (en) | A kind of display methods and terminal device at the interfaces WebApp |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |