CN107977652B - Method for extracting screen display content and mobile terminal - Google Patents
Method for extracting screen display content and mobile terminal Download PDFInfo
- Publication number
- CN107977652B CN107977652B CN201711395840.2A CN201711395840A CN107977652B CN 107977652 B CN107977652 B CN 107977652B CN 201711395840 A CN201711395840 A CN 201711395840A CN 107977652 B CN107977652 B CN 107977652B
- Authority
- CN
- China
- Prior art keywords
- picture
- screen
- mobile terminal
- display content
- screen capture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000875 corresponding Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 12
- 238000000605 extraction Methods 0.000 claims description 4
- 238000010845 search algorithm Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 description 10
- 239000003086 colorant Substances 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000003287 optical Effects 0.000 description 2
- 230000001960 triggered Effects 0.000 description 2
- 210000000554 Iris Anatomy 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000001413 cellular Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006011 modification reaction Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/40—Document-oriented image-based pattern recognition
- G06V30/41—Analysis of document content
- G06V30/413—Classification of content, e.g. text, photographs or tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
Abstract
The invention provides a method for extracting screen display content and a mobile terminal, wherein the method comprises the following steps: intercepting screen display content to obtain a screen shot picture; identifying the content of the screen shot picture according to the pixel value of the screen shot picture; and if the screen capture picture is identified to contain the image, saving part or all of the content of the screen capture picture. According to the method and the device, the picture content is identified according to the pixel value of the screenshot picture, so that the picture is stored quickly, the operation flow of storing the picture is simplified, and the intelligent degree of the mobile terminal is improved.
Description
Technical Field
The invention relates to the technical field of communication application, in particular to a method for extracting screen display content and a mobile terminal.
Background
As the content on the intelligent terminal becomes richer, the user often encounters a scene that needs to extract the content in the screen, such as extracting pictures or texts in the screen. Various application program display contents have different styles, and the allowed operation of different interfaces is limited.
For example, when a picture in the current interface needs to be saved, the current interface usually needs to be pressed for a long time, and an option for saving the picture is selected, which is cumbersome to operate.
Disclosure of Invention
The invention aims to provide a method for extracting screen display content and a mobile terminal, which aim to solve the problem that the conventional picture extraction mode is complicated to operate.
In a first aspect, an embodiment of the present invention provides a method for extracting screen display content, which is applied to a mobile terminal, and includes:
intercepting screen display content to obtain a screen shot picture;
identifying the content of the screen shot picture according to the pixel value of the screen shot picture;
and if the screen capture picture is identified to contain the image, saving part or all of the content of the screen capture picture.
In a second aspect, an embodiment of the present invention further provides a mobile terminal, including:
the acquisition module is used for intercepting screen display content to obtain a screen shot picture;
the first identification module is used for identifying the content of the screen capture picture according to the pixel value of the screen capture picture;
and the processing module is used for saving part or all of the contents of the screen capturing picture if the identification module identifies that the screen capturing picture contains the image.
In a third aspect, an embodiment of the present invention further provides a mobile terminal, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the method for extracting screen display content as described above.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements the steps of the method for extracting screen display content as described above.
The embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the picture content is identified according to the pixel value of the screenshot picture, so that the picture is rapidly stored, the operation flow of storing the picture is simplified, and the intelligent degree of the mobile terminal is improved.
Drawings
FIG. 1 is a flowchart illustrating a method for extracting screen display content according to an embodiment of the present invention;
fig. 2 is a block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 3 is a second block diagram of a mobile terminal according to the embodiment of the present invention;
fig. 4 is a block diagram of a mobile terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, an embodiment of the present invention provides a method for extracting screen display content, which is applied to a mobile terminal, and includes:
step 101: and intercepting the screen display content to obtain a screen shot picture.
Specifically, when the preset operation of a preset key of the mobile terminal is detected, the screen display content is triggered to be intercepted. The preset keys comprise at least one key of the mobile terminal, such as a volume key and a power key of the mobile terminal, and the preset keys can be preset according to user requirements.
The purpose of advancing the screen content is achieved according to the screen content intercepting operation of the user, the universality is high, and the operation is simple.
Step 102: and identifying the content of the screen shot picture according to the pixel value of the screen shot picture.
After the screen capture picture is obtained, the screen capture picture is stored, the RGB value (pixel value) of each pixel point in the screen capture picture is obtained, and whether the screen capture picture contains an image is identified according to the RGB value of each pixel point.
Step 103: and if the screen capture picture is identified to contain the image, saving part or all of the content of the screen capture picture.
If the screenshot picture only contains an image, all contents of the screenshot picture are saved, and if the screenshot picture contains the image and characters at the same time, partial contents of the screenshot icon are saved, namely only the image part in the screenshot picture is saved.
When the image included in the screenshot picture is identified, the image part in the screenshot picture can be automatically stored, and the purpose of quickly extracting the picture is achieved.
In the embodiment of the invention, the picture content is identified according to the pixel value of the screenshot picture, so that the picture is rapidly stored, the operation flow of storing the picture is simplified, and the intelligent degree of the mobile terminal is improved.
Further, as an optional implementation manner, the identifying, by the step 102, the content of the screenshot picture according to the pixel value of the screenshot picture includes:
judging whether a target pixel block exists in the screenshot picture according to the pixel value of each pixel point in the screenshot picture; if the target pixel block exists in the screen capture picture, identifying that the screen capture picture contains an image;
the difference value of the pixel values of the adjacent pixels in the target pixel block is smaller than a first preset threshold, and the ratio of the number of the pixels forming the target pixel block to the number of the total pixels in the screenshot picture is larger than a second preset threshold.
In the embodiment of the invention, whether the pixel points with similar RGB values are adjacent or not can be judged, and whether the pixel area formed by the pixel points with similar RGB values is regular or not can be judged. If the pixel points with similar RGB values are adjacent and the pixel areas have no rules, the target picture can be judged to have an image. The pixel points with similar RGB values refer to the pixel points with the difference value of the RGB values smaller than a first preset threshold, and the adjacent pixel points with similar RGB values refer to the pixel points with similar RGB values, wherein the distance between the pixel points with similar RGB values is smaller than a fourth preset threshold.
In the specific embodiment of the invention, the color value corresponding to the minimum RGB value is the lightest color, namely the background color, each pixel point of the target picture is traversed, a depth-first search algorithm is adopted for each pixel point with the non-background color to traverse the adjacent pixel points with the non-background color of the pixel points, the count is increased by one when one similar pixel point is taken, the number of the pixel points of each similar pixel block with the non-background color in the target picture is calculated, if the pixel block with the larger number of the pixel points exists, the picture can be judged to be contained, and if the pixel block with the larger number of the pixel points exists, the pixel block with the smaller number does not.
As another optional implementation manner, the identifying, by the step 102, the content of the screenshot picture according to the pixel value of the screenshot picture includes:
determining the number of colors corresponding to the screen capture picture according to the pixel value of each pixel point in the screen capture picture, wherein different pixel values correspond to different colors; and if the number of the colors corresponding to the screen capture picture is larger than a third preset threshold value, determining that the screen capture picture contains an image.
In the embodiment of the present invention, all possible values of RGB values are 255 × 255 — 16581375, a 16581375-sized array is created and recorded as a, the array value is initialized to 0, each pixel point of a target picture is traversed, the RGB value of each pixel point is taken and recorded as value, an a [ value ] value corresponding to the RGB value is set according to a plurality of pixel points corresponding to the same RGB value, and if the first RGB value corresponds to 5 pixel points, the a [ value ] value corresponding to the first RGB value is set to 5, and the number of pixels corresponding to each color of the picture is recorded. Traversing the array, taking the number of elements with the array value larger than 0 as the number of corresponding colors of the picture, and if the number of the colors is smaller than 20, judging that the picture is not a color image.
Further, the step 101 of capturing the screen display content to obtain the screen capture picture further includes:
identifying whether the screenshot picture contains characters; and if the screen capture picture contains characters, extracting the characters from the screen capture picture.
In an embodiment of the present invention, it is possible to identify whether the screenshot picture contains text or not by using ocr technology, and in particular, detect the area containing text, for example, classify the content in the screenshot picture by using the fast-rcnn algorithm to find the area containing text, and in the second step, identify the specific text by using the rnn/lstm/gru + ctc algorithm. When the screenshot picture contains the characters, the corresponding characters can be extracted and copied, and the operation of copying the text by the user is simplified.
Further, the capturing the screen display content in the step 101 to obtain the screen capture picture includes:
when the preset operation of a preset key of the mobile terminal is detected, a selection frame input in a screen is acquired; and intercepting the display content in the selection frame to obtain a screen shot picture.
The preset keys comprise at least one key of the mobile terminal, such as a volume key and a power key of the mobile terminal, and the preset keys can be preset according to user requirements. For example, when the user presses the volume key and the power key simultaneously, a transparent cover layer is added on the screen to prompt the user to enter the screen content extraction mode.
The user can input the selection box anywhere on the screen, and the user can adjust the size and the position of the selection box. And when the user stops adjusting the size and the position of the selection frame, determining the area corresponding to the selection frame in the screen as the target area.
In the embodiment of the invention, when the preset operation on the preset key of the mobile terminal is detected, the screen content is triggered and extracted, and the method and the device have higher universality.
The method for extracting the screen display content comprises the steps of intercepting the screen display content to obtain a screenshot picture; identifying the content of the screen shot picture according to the pixel value of the screen shot picture; if the screenshot picture is identified to contain the image, partial or all contents of the screenshot picture are stored.
As shown in fig. 2, an embodiment of the present invention further provides a mobile terminal 200, including:
the acquisition module 201 is configured to intercept screen display content to obtain a screen shot picture;
the first identification module 202 is configured to identify the content of the screenshot picture according to the pixel value of the screenshot picture;
and the processing module 203 is configured to store part or all of the contents of the screenshot picture if the identification module identifies that the screenshot picture contains an image.
As shown in fig. 3, the mobile terminal according to the embodiment of the present invention includes:
the judging submodule 2021 is configured to judge whether a target pixel block exists in the screenshot picture according to a pixel value of each pixel point in the screenshot picture;
the identifying submodule 2022 is configured to identify that the screenshot picture includes an image if the target pixel block exists in the screenshot picture;
the difference value of the pixel values of the adjacent pixels in the target pixel block is smaller than a first preset threshold, and the ratio of the number of the pixels forming the target pixel block to the number of the total pixels in the screenshot picture is larger than a second preset threshold.
In the mobile terminal of the embodiment of the present invention, the first identification module 202 includes:
the first determining submodule 2023 is configured to determine, according to a pixel value of each pixel point in the screenshot picture, the number of colors corresponding to the screenshot picture, where different pixel values correspond to different colors;
the second determining sub-module 2024 is configured to determine that the screenshot picture includes an image if the number of the colors corresponding to the screenshot picture is greater than a third preset threshold.
The mobile terminal of the embodiment of the invention also comprises:
the second identification module 204 is used for identifying whether the screenshot picture contains characters;
an extracting module 205, configured to extract the text from the screen capture picture if the screen capture picture includes the text.
In the mobile terminal of the embodiment of the present invention, the obtaining module 201 includes:
the obtaining sub-module 2011 is configured to, when a predetermined operation on a preset key of the mobile terminal is detected, obtain a selection box input in the screen;
and the capturing submodule 2012 is used for capturing the display content in the selection box to obtain a screen capture picture.
It should be noted that the mobile terminal is a mobile terminal corresponding to the above method embodiment, and all implementation manners in the above method embodiment are applicable to the embodiment of the mobile terminal, and the same technical effect can be achieved.
According to the mobile terminal provided by the embodiment of the invention, the picture content is identified according to the pixel value of the screenshot picture, so that the picture is rapidly stored, the operation flow of storing the picture is simplified, and the intelligence degree of the mobile terminal is improved.
Fig. 4 is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, where the mobile terminal 400 includes, but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor 410, and power supply 411. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 4 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 410 is configured to intercept screen display content to obtain a screen shot picture; identifying the content of the screen shot picture according to the pixel value of the screen shot picture; and if the screen capture picture is identified to contain the image, saving part or all of the content of the screen capture picture.
According to the technical scheme of the embodiment of the invention, the screen display content is intercepted to obtain the screenshot picture; identifying the content of the screen shot picture according to the pixel value of the screen shot picture; if the screenshot picture is identified to contain the image, partial or all contents of the screenshot picture are stored.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 410; in addition, the uplink data is transmitted to the base station. Typically, radio unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio unit 401 can also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access through the network module 402, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 may also provide audio output related to a specific function performed by the mobile terminal 400 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.
The input unit 404 is used to receive audio or video signals. The input Unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the Graphics processor 4041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 406. The image frames processed by the graphic processor 4041 may be stored in the memory 409 (or other storage medium) or transmitted via the radio frequency unit 401 or the network module 402. The microphone 4042 may receive sound, and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 401 in case of the phone call mode.
The mobile terminal 400 also includes at least one sensor 405, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 4061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 4061 and/or the backlight when the mobile terminal 400 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 405 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described in detail herein.
The display unit 406 is used to display information input by the user or information provided to the user. The Display unit 406 may include a Display panel 4061, and the Display panel 4061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 407 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. Touch panel 4071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 4071 using a finger, a stylus, or any suitable object or attachment). The touch panel 4071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 410, receives a command from the processor 410, and executes the command. In addition, the touch panel 4071 can be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 4071, the user input unit 407 may include other input devices 4072. Specifically, the other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 4071 can be overlaid on the display panel 4061, and when the touch panel 4071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 410 to determine the type of the touch event, and then the processor 410 provides a corresponding visual output on the display panel 4061 according to the type of the touch event. Although in fig. 4, the touch panel 4071 and the display panel 4061 are two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 4071 and the display panel 4061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 408 is an interface through which an external device is connected to the mobile terminal 400. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 400 or may be used to transmit data between the mobile terminal 400 and external devices.
The memory 409 may be used to store software programs as well as various data. The memory 409 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 409 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 410 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 409 and calling data stored in the memory 409, thereby integrally monitoring the mobile terminal. Processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.
The mobile terminal 400 may further include a power supply 411 (e.g., a battery) for supplying power to various components, and preferably, the power supply 411 may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the mobile terminal 400 includes some functional modules that are not shown, and thus, are not described in detail herein.
Preferably, an embodiment of the present invention further provides a mobile terminal, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements each process of the above-mentioned method for extracting screen display content, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned method for extracting screen display content, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (8)
1. A method for extracting screen display content is applied to a mobile terminal, and is characterized by comprising the following steps:
intercepting screen display content to obtain a screen shot picture;
identifying the content of the screen shot picture according to the pixel value of the screen shot picture;
if the screen capture picture is identified to contain the image, saving part or all of the content of the screen capture picture;
the identifying the content of the screen capture picture according to the pixel value of the screen capture picture comprises the following steps:
judging whether a target pixel block exists in the screenshot picture according to the pixel value of each pixel point in the screenshot picture;
if the target pixel block exists in the screen capture picture, identifying that the screen capture picture contains an image;
the difference value of the pixel values of adjacent pixels in the target pixel block is smaller than a first preset threshold, and the ratio of the number of the pixels forming the target pixel block to the number of the total pixels in the screenshot picture is larger than a second preset threshold;
wherein the target pixel block is obtained from a non-background pixel of the screenshot picture;
and traversing the non-background color pixel points adjacent to each non-background color pixel point by adopting a depth-first search algorithm, wherein the color value corresponding to the minimum RGB value is the lightest color, namely the background color.
2. The method for extracting screen display content according to claim 1, wherein after the screen display content is captured and a screen capture picture is obtained, the method further comprises:
identifying whether the screenshot picture contains characters;
and if the screen capture picture contains characters, extracting the characters from the screen capture picture.
3. The method for extracting screen display content according to claim 1, wherein the capturing the screen display content to obtain a screen capture picture comprises:
when the preset operation of a preset key of the mobile terminal is detected, a selection frame input in a screen is acquired;
and intercepting the display content in the selection frame to obtain a screen shot picture.
4. A mobile terminal, comprising:
the acquisition module is used for intercepting screen display content to obtain a screen shot picture;
the first identification module is used for identifying the content of the screen capture picture according to the pixel value of the screen capture picture;
the processing module is used for saving part or all of contents of the screen capturing picture if the identification module identifies that the screen capturing picture contains an image;
the first identification module comprises:
the judgment submodule is used for judging whether a target pixel block exists in the screenshot picture according to the pixel value of each pixel point in the screenshot picture;
the identification submodule is used for identifying that the screen capture picture contains an image if the target pixel block exists in the screen capture picture;
the difference value of the pixel values of adjacent pixels in the target pixel block is smaller than a first preset threshold, and the ratio of the number of the pixels forming the target pixel block to the number of the total pixels in the screenshot picture is larger than a second preset threshold;
wherein the target pixel block is obtained from a non-background pixel of the screenshot picture;
and traversing the non-background color pixel points adjacent to each non-background color pixel point by adopting a depth-first search algorithm, wherein the color value corresponding to the minimum RGB value is the lightest color, namely the background color.
5. The mobile terminal of claim 4, further comprising:
the second identification module is used for identifying whether the screenshot picture contains characters or not;
and the extraction module is used for extracting the characters from the screen capture picture if the screen capture picture contains the characters.
6. The mobile terminal of claim 4, wherein the obtaining module comprises:
the acquisition submodule is used for acquiring a selection frame input in a screen when the preset operation of a preset key of the mobile terminal is detected;
and the intercepting submodule is used for intercepting the display content in the selection frame to obtain a screen-shot picture.
7. A mobile terminal, comprising: memory, processor and computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the method for extracting screen display content according to any one of claims 1 to 3.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the extraction method of screen display content according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711395840.2A CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711395840.2A CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107977652A CN107977652A (en) | 2018-05-01 |
| CN107977652B true CN107977652B (en) | 2020-08-28 |
Family
ID=62007279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711395840.2A Active CN107977652B (en) | 2017-12-21 | 2017-12-21 | Method for extracting screen display content and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107977652B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109684980B (en) * | 2018-09-19 | 2022-12-13 | 腾讯科技（深圳）有限公司 | Automatic scoring method and device |
| CN109358793A (en) * | 2018-09-27 | 2019-02-19 | 维沃移动通信有限公司 | A kind of screenshotss method and mobile terminal |
| CN109376658B (en) * | 2018-10-26 | 2022-03-08 | 信雅达科技股份有限公司 | OCR method based on deep learning |
| CN109948495A (en) * | 2019-03-11 | 2019-06-28 | 河南发明哥知识产权代理有限公司 | A kind of screenshot method, terminal and computer readable storage medium |
| CN109919157A (en) * | 2019-03-28 | 2019-06-21 | 北京易达图灵科技有限公司 | A kind of vision positioning method and device |
| CN110276281A (en) * | 2019-06-10 | 2019-09-24 | 浙江工业大学 | A kind of screenshotss picture and text identification extracting method and system towards mobile terminal |
| CN110647878A (en) * | 2019-08-05 | 2020-01-03 | 紫光西部数据(南京)有限公司 | Data processing method based on screen shot picture |
| CN113221866B (en) * | 2021-04-30 | 2022-11-15 | 东方蓝天钛金科技有限公司 | Equipment data acquisition system and method based on image recognition |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103246572A (en) * | 2013-03-27 | 2013-08-14 | 东莞宇龙通信科技有限公司 | Method and system for synchronizing application messages |
| CN104657423B (en) * | 2015-01-16 | 2018-07-06 | 白天 | Using content share method and its device |
| CN106354482A (en) * | 2015-07-13 | 2017-01-25 | 西安中兴新软件有限责任公司 | Method and device for acquiring automated scripts and application method and device of automated scripts |
| CN105224644A (en) * | 2015-09-28 | 2016-01-06 | 小米科技有限责任公司 | Information classification approach and device |
| CN105204745B (en) * | 2015-09-30 | 2021-07-27 | 百度在线网络技术（北京）有限公司 | Screen capturing method and device for mobile terminal |
| WO2017146454A1 (en) * | 2016-02-26 | 2017-08-31 | 삼성전자 주식회사 | Method and device for recognising content |
-
2017
- 2017-12-21 CN CN201711395840.2A patent/CN107977652B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| Fault Diagnosis for Snapshot Device through Identifying Image Abnormal Features;Fei Gao等;《2012 5th International Congress on Image and Signal Processing (CISP 2012) 》;20121231;第1257-1261页 * |
| 双视点 3D 视频文件的裸眼立体组合投影实时显示算法;郭华源等;《计算机辅助设计与图形学学报》;20150930;第27卷(第9期);第1734-1742页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107977652A (en) | 2018-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107977652B (en) | Method for extracting screen display content and mobile terminal | |
| CN107908383B (en) | Screen color adjusting method and device and mobile terminal | |
| CN108845853B (en) | Application program starting method and mobile terminal | |
| CN108459797B (en) | Control method of folding screen and mobile terminal | |
| CN109078319B (en) | Game interface display method and terminal | |
| CN108491123B (en) | Method for adjusting application program icon and mobile terminal | |
| CN107749046B (en) | Image processing method and mobile terminal | |
| CN108616448B (en) | Information sharing path recommendation method and mobile terminal | |
| CN108174110B (en) | Photographing method and flexible screen terminal | |
| CN110944113B (en) | Object display method and electronic equipment | |
| CN110636225B (en) | Photographing method and electronic equipment | |
| CN110209324B (en) | Display method and terminal equipment | |
| CN108600544B (en) | Single-hand control method and terminal | |
| CN108664818B (en) | Unlocking control method and device | |
| CN108093119B (en) | Strange incoming call number marking method and mobile terminal | |
| KR20220157485A (en) | Detection result output method, electronic device and medium | |
| CN111432122B (en) | Image processing method and electronic equipment | |
| CN110740265B (en) | Image processing method and terminal equipment | |
| CN110309003B (en) | Information prompting method and mobile terminal | |
| CN110213437B (en) | Editing method and mobile terminal | |
| CN109819331B (en) | Video call method, device and mobile terminal | |
| CN109639981B (en) | Image shooting method and mobile terminal | |
| CN109491572B (en) | Screen capturing method of mobile terminal and mobile terminal | |
| CN109189517B (en) | Display switching method and mobile terminal | |
| CN108509126B (en) | Picture processing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |