CN111242116B - Screen positioning method and device - Google Patents
Screen positioning method and device Download PDFInfo
- Publication number
- CN111242116B CN111242116B CN202010072259.2A CN202010072259A CN111242116B CN 111242116 B CN111242116 B CN 111242116B CN 202010072259 A CN202010072259 A CN 202010072259A CN 111242116 B CN111242116 B CN 111242116B
- Authority
- CN
- China
- Prior art keywords
- screen
- picture
- pixel point
- boundary
- white background
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1417—2D bar codes
Abstract
The invention aims to provide a screen positioning method and a screen positioning device. In addition, segmenting the gray level image gray by specifying a preset pixel threshold value T1; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the plumpness s of the minimum external rotation rectangle of the continuous region of each reserved pixel point; and taking the continuous reserved pixel point region with the saturation s larger than the preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen, thereby accurately and reliably identifying the screen positions of various terminals.
Description
Technical Field
The invention relates to the field of computers, in particular to a screen positioning method and device.
Background
The existing positioning mode of screen positions of terminals such as mobile phones has the problems of complex positioning process and low positioning accuracy.
Disclosure of Invention
The invention aims to provide a screen positioning method and a screen positioning device.
According to an aspect of the present invention, there is provided a screen positioning method, including:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
and recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen.
Further, in the above method, recognizing a boundary of the white background picture from the photo, and using the boundary as a position of an outline of the screen includes:
converting the picture into a gray picture;
appointing a preset pixel threshold value T1 to segment the gray-scale picture, wherein the pixel value of a pixel point exceeding the preset pixel threshold value T1 in the picture is set to be 255, and the pixel value of a pixel point not exceeding the preset pixel threshold value T1 in the picture is set to be 0;
acquiring a continuous region of each pixel point with a pixel value of 255 in the gray-scale picture;
calculating the number of pixel points in each continuous region of the pixel points, and screening the continuous regions of the pixel points, wherein the continuous regions of the pixel points with the number of the pixel points smaller than a preset number threshold T2 are abandoned, and the continuous regions of the pixel points with the number of the pixel points larger than or equal to the preset number threshold T2 are reserved;
calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the saturation s of the minimum external rotation rectangle of the continuous region of each reserved pixel point, wherein the saturation s = the number of pixel points in the continuous region of a certain reserved pixel point/the area of the minimum external rotation rectangle of the continuous region of the reserved pixel point;
and taking the continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold value T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
Further, in the method, displaying the screen bright screen as a white background picture includes:
and the middle area of the white background picture is superposed with the image to be identified.
Further, in the above method, after recognizing the boundary of the white background picture from the photo, the method further includes:
acquiring an image to be identified in a range surrounded by the boundary of the white background picture;
and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
Further, in the above method, the image to be recognized includes a two-dimensional code or a barcode.
According to another aspect of the present invention, there is also provided a screen positioning apparatus, wherein the apparatus comprises:
the display module is used for displaying the bright screen of the screen as a white background picture;
a shooting module for shooting a picture of a screen including the white background picture;
and the recognition module is used for recognizing the boundary of the white background picture from the photo and taking the boundary as the position of the outline of the screen.
Further, in the above apparatus, the recognition module is configured to convert the photo into a grayscale picture; a preset pixel threshold value T1 is appointed to divide the gray-scale picture, wherein the pixel value of a pixel point which exceeds the preset pixel threshold value T1 in the picture is set to be 255, and the pixel value of a pixel point which does not exceed the preset pixel threshold value T1 in the picture is set to be 0; acquiring a continuous region of each pixel point with a pixel value of 255 in the gray-scale picture; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point, wherein the continuous region of the pixel points with the number smaller than a preset number threshold T2 is abandoned, and the continuous region of the pixel points with the number larger than or equal to the preset number threshold T2 is reserved; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the saturation s of the minimum external rotation rectangle of the continuous region of each reserved pixel point, wherein the saturation s = the number of pixel points in the continuous region of a certain reserved pixel point/the area of the minimum external rotation rectangle of the continuous region of the reserved pixel point; and taking a continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
Further, in the above apparatus, the display module is configured to display the image to be recognized in a middle area of the white background picture in an overlapping manner.
Further, in the above apparatus, the identification module is further configured to obtain an image to be identified within a range surrounded by a boundary of the white background picture; and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
Further, in the above apparatus, the image to be recognized includes a two-dimensional code or a barcode.
According to another aspect of the present invention, there is also provided a computing-based device, including:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
and recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen.
According to another aspect of the present invention, there is also provided a computer-readable storage medium having stored thereon computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
and recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen.
Compared with the prior art, the method and the device have the advantages that the screen bright screen is displayed as the white background picture, and the screen position of the device can be simply and accurately positioned based on the boundary of the white background picture. In addition, segmenting the gray level image gray by specifying a preset pixel threshold value T1; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the plumpness s of the minimum external rotation rectangle of the continuous region of each reserved pixel point; and taking the continuous reserved pixel point region with the saturation s larger than the preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen, thereby accurately and reliably identifying the screen positions of various terminals.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:
fig. 1 shows a flow chart of a screen positioning method according to an embodiment of the invention.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
The present invention is described in further detail below with reference to the attached drawing figures.
In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party each include one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both permanent and non-permanent, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include non-transitory computer readable media (transient media), such as modulated data signals and carrier waves.
As shown in fig. 1, the present invention provides a screen positioning method, including:
s1, displaying a bright screen of a screen as a white background picture;
here, the screen may be a terminal device with a display screen, such as a mobile phone or a PAD;
s2, shooting a picture of a screen comprising the white background picture;
when the screen is shot, the irrelevant area outside the screen area is shot at the same time, and the screen area needs to be identified subsequently;
and S3, recognizing the boundary of the white background picture from the picture, and taking the boundary as the position of the outline of the screen.
In the invention, the screen bright screen is displayed as the white background picture, and the screen position of the equipment can be simply and accurately positioned based on the boundary of the white background picture.
In an embodiment of the screen positioning method of the present invention, in step S3, recognizing a boundary of the white background picture from the photo, and taking the boundary as a position of an outline of the screen includes:
step S31, converting the picture src into a gray picture gray;
step S32, a preset pixel threshold value T1 is appointed to segment the gray level picture gray, wherein the pixel value of a pixel point exceeding the preset pixel threshold value T1 in the picture src is set to 255, and the pixel value of a pixel point not exceeding the preset pixel threshold value T1 in the picture src is set to 0;
step S33, obtaining a continuous region of each pixel point with the pixel value of 255 in the gray picture gray;
here, a certain pixel point is in the 8 neighborhoods of another pixel point, the two can be considered to be continuous, and 2 or more than 2 continuous pixel points can form a region with continuous pixel points;
black pixel points with the pixel value of 0, white pixel points with the pixel value of 255, and the connection region of the pixel points with the pixel value of 0 is not considered and is regarded as a background outside the screen region;
step S34, calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point, wherein the continuous region of the pixel points with the number of the pixel points smaller than a preset number threshold T2 is abandoned, and the continuous region of the pixel points with the number of the pixel points larger than or equal to the preset number threshold T2 is reserved;
step S35, calculating an area of the minimum circumscribed rectangle of each region where the retained pixels are continuous, and calculating a saturation S of the minimum circumscribed rectangle of each region where the retained pixels are continuous, where the saturation S = a number of pixels in a region where a retained pixel is continuous/the area of the minimum circumscribed rectangle of the region where the retained pixel is continuous;
and S36, taking a continuous region of the reserved pixel points with the saturation S larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
Here, the area where each reserved pixel point is continuous can be traversed, the area of the minimum external rotation rectangle is divided by the number of the pixel points of the area where each reserved pixel point is continuous, the saturation s of the area is obtained, if the value of the saturation s of the area where a certain reserved pixel point is continuous is larger than a preset saturation threshold value T3, the area is a screen area, and if the value of the saturation s is smaller than the preset saturation threshold value T3, the area is a non-screen area.
The implementation divides the gray level image gray by appointing a preset pixel threshold value T1; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point; calculating the area of the minimum circumscribed rotating rectangle of the continuous region of each reserved pixel point, and calculating the plumpness s of the minimum circumscribed rotating rectangle of the continuous region of each reserved pixel point; and taking the continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold value T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen, thereby accurately and reliably identifying the screen positions of various terminals.
In an embodiment of the screen positioning method of the present invention, step S1, displaying a bright screen of a screen as a white background picture, includes:
and the middle area of the white background picture is superposed with the image to be identified.
Here, the image to be recognized may be a two-dimensional code, a bar code or the like,
the image to be recognized is displayed in a non-boundary area of the screen in the middle of the white background picture in an overlapping mode, so that after the position of the screen is recognized automatically, the image to be recognized in the middle of the screen can be acquired, and information contained in the image to be recognized is further acquired efficiently and accurately.
The information included in the image to be recognized includes attribute information of the terminal device with the screen, such as information of a memory and a model of the terminal device.
In an embodiment of the screen positioning method of the present invention, after the step S3 of recognizing the boundary of the white background picture from the photo, the method further includes:
acquiring an image to be identified in a range surrounded by the boundary of the white background picture;
and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
The image to be recognized is superposed and displayed in the non-boundary area of the screen in the middle of the white background picture, so that the image to be recognized in the middle of the screen can be acquired after the position of the screen is automatically recognized, and the information contained in the image to be recognized is further efficiently and accurately acquired.
The invention provides a screen positioning device, comprising:
the display module is used for displaying the bright screen of the screen as a white background picture;
here, the screen may be a terminal device with a display screen, such as a mobile phone or a PAD;
the shooting module is used for shooting a picture of a screen comprising the white background picture;
when the screen is shot, the irrelevant area outside the screen area is shot at the same time, and the screen area needs to be identified subsequently;
and the recognition module is used for recognizing the boundary of the white background picture from the photo and taking the boundary as the position of the outline of the screen.
In the invention, the screen is displayed as the white background picture by the bright screen, and the screen position of the equipment can be simply and accurately positioned based on the boundary of the white background picture.
In an embodiment of the screen positioning device of the present invention, the identification module is configured to convert the photo src into a gray image gray; a preset pixel threshold value T1 is appointed to segment the gray level picture gray, wherein the pixel value of a pixel point which exceeds the preset pixel threshold value T1 in the picture src is set to be 255, and the pixel value of a pixel point which does not exceed the preset pixel threshold value T1 in the picture src is set to be 0; acquiring a continuous region of each pixel point with a pixel value of 255 in the gray level picture gray; calculating the number of pixel points in each continuous region of the pixel points, and screening the continuous regions of the pixel points, wherein the continuous regions of the pixel points with the number of the pixel points smaller than a preset number threshold T2 are abandoned, and the continuous regions of the pixel points with the number of the pixel points larger than or equal to the preset number threshold T2 are reserved; calculating the area of the minimum external rotation rectangle of each reserved pixel point continuous region, and calculating the fullness s of the minimum external rotation rectangle of each reserved pixel point continuous region, wherein the fullness s = the number of pixel points in a certain reserved pixel point continuous region/the area of the minimum external rotation rectangle of the reserved pixel point continuous region; and taking a continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
Here, a certain pixel point is in 8 neighborhoods of another pixel point, the two pixel points can be considered to be continuous, and 2 or more than 2 continuous pixel points can form a region with continuous pixel points;
black pixel points with the pixel value of 0, white pixel points with the pixel value of 255, and the connection region of the pixel points with the pixel value of 0 is not considered and is regarded as a background outside the screen region;
and traversing the continuous region of each reserved pixel point, dividing the number of the pixel points of the continuous region of each reserved pixel point by the area of the minimum external rotation rectangle to obtain the saturation s of the region, wherein if the value of the saturation s of the continuous region of a certain reserved pixel point is greater than a preset saturation threshold value T3, the continuous region is a screen region, and if the value of the saturation s is less than the preset saturation threshold value T3, the continuous region is a non-screen region.
The implementation divides the gray level image gray by specifying a preset pixel threshold T; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the plumpness s of the minimum external rotation rectangle of the continuous region of each reserved pixel point; and taking the continuous reserved pixel point region with the saturation s larger than the preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen, thereby accurately and reliably identifying the screen positions of various terminals.
In an embodiment of the screen positioning device of the present invention, the display module is configured to display the image to be recognized in a middle area of the white background picture in an overlapping manner.
Here, the image to be recognized may be a two-dimensional code, a bar code or the like,
the image to be recognized is displayed in a non-boundary area of the screen in the middle of the white background picture in an overlapping mode, so that after the position of the screen is recognized automatically, the image to be recognized in the middle of the screen can be acquired, and information contained in the image to be recognized is further acquired efficiently and accurately.
The information included in the image to be recognized includes attribute information of the terminal device with the screen, such as information of a memory and a model of the terminal device.
In an embodiment of the screen positioning device of the present invention, the identification module is further configured to obtain an image to be identified within a range surrounded by a boundary of the white background picture; and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
The image to be recognized is superposed and displayed in the non-boundary area of the screen in the middle of the white background picture, so that the image to be recognized in the middle of the screen can be acquired after the position of the screen is automatically recognized, and the information contained in the image to be recognized is further efficiently and accurately acquired.
According to another aspect of the present invention, there is also provided a computing-based device, including:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
and recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen.
According to another aspect of the present invention, there is also provided a computer-readable storage medium having stored thereon computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
and recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen.
For details of embodiments of each device and storage medium of the present invention, reference may be made to corresponding parts of each method embodiment, and details are not described herein again.
Compared with the prior art, the method and the device have the advantages that the screen bright screen is displayed as the white background picture, and the screen position of the device can be simply and accurately positioned based on the boundary of the white background picture. In addition, segmenting the gray level image gray by specifying a preset pixel threshold value T1; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the plumpness s of the minimum external rotation rectangle of the continuous region of each reserved pixel point; and taking the continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold value T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen, thereby accurately and reliably identifying the screen positions of various terminals.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
It should be noted that the present invention may be implemented in software and/or in a combination of software and hardware, for example, as an Application Specific Integrated Circuit (ASIC), a general purpose computer or any other similar hardware device. In one embodiment, the software program of the present invention may be executed by a processor to implement the steps or functions described above. Also, the software programs (including associated data structures) of the present invention can be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Further, some of the steps or functions of the present invention may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present invention can be applied as a computer program product, such as computer program instructions, which when executed by a computer, can invoke or provide the method and/or technical solution according to the present invention through the operation of the computer. Program instructions which invoke the methods of the present invention may be stored on fixed or removable recording media and/or transmitted via a data stream on a broadcast or other signal bearing medium and/or stored within a working memory of a computer device operating in accordance with the program instructions. An embodiment according to the invention herein comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or solution according to embodiments of the invention as described above.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.
Claims (10)
1. A method of screen positioning, wherein the method comprises:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen, wherein the recognizing comprises the following steps:
converting the picture into a gray picture; a preset pixel threshold value T1 is appointed to divide the gray-scale picture so as to obtain the gray-scale picture of a screen area; acquiring a continuous region of each pixel point in the gray level picture of the screen region; calculating the number of pixel points in each continuous pixel point region, and screening each continuous pixel point region to obtain the reserved continuous pixel point region; calculating the area of the minimum external rotation rectangle of each reserved pixel point continuous region, and calculating the fullness s of the minimum external rotation rectangle of each reserved pixel point continuous region, wherein the fullness s = the number of pixel points in a certain reserved pixel point continuous region/the area of the minimum external rotation rectangle of the reserved pixel point continuous region; and taking the continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold value T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
2. The method of claim 1, wherein displaying the screen highlight as a white background picture comprises:
and the middle area of the white background picture is superposed with the image to be identified.
3. The method of claim 2, wherein after identifying the boundary of the white background picture from the photograph, further comprising:
acquiring an image to be recognized in a range surrounded by the boundary of the white background picture;
and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
4. The method of claim 2 or 3, wherein the image to be identified comprises a two-dimensional code or a barcode.
5. A screen positioning device, wherein the device comprises:
the display module is used for displaying the bright screen of the screen as a white background picture;
a shooting module for shooting a picture of a screen including the white background picture;
the identification module is used for converting the photo into a gray picture; a preset pixel threshold value T1 is appointed to divide the gray-scale picture so as to obtain the gray-scale picture of a screen area; acquiring a continuous area of each pixel point in the gray level picture of the screen area; calculating the number of pixel points in each continuous pixel point region, and screening each continuous pixel point region to obtain the reserved continuous pixel point region; calculating the area of the minimum external rotation rectangle of each reserved pixel point continuous region, and calculating the fullness s of the minimum external rotation rectangle of each reserved pixel point continuous region, wherein the fullness s = the number of pixel points in a certain reserved pixel point continuous region/the area of the minimum external rotation rectangle of the reserved pixel point continuous region; and taking a continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
6. The device of claim 5, wherein the display module is configured to display the image to be recognized in a middle area of the white background picture in an overlapping manner.
7. The device according to claim 6, wherein the identifying module is further configured to obtain an image to be identified in a range surrounded by a boundary of the white background picture; and identifying the image to be identified to obtain the attribute information of the terminal equipment with the screen.
8. The apparatus of claim 6 or 7, wherein the image to be identified comprises a two-dimensional code or a barcode.
9. A computing-based device, comprising:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen, wherein the recognizing comprises the following steps:
converting the picture into a gray picture; a preset pixel threshold value T1 is appointed to divide the gray-scale picture so as to obtain the gray-scale picture of a screen area; acquiring a continuous region of each pixel point in the gray level picture of the screen region; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point to obtain the continuous region of the reserved pixel points; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the saturation s of the minimum external rotation rectangle of the continuous region of each reserved pixel point, wherein the saturation s = the number of pixel points in the continuous region of a certain reserved pixel point/the area of the minimum external rotation rectangle of the continuous region of the reserved pixel point; and taking a continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
10. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions, when executed by a processor, cause the processor to:
displaying the bright screen of the screen as a white background picture;
taking a picture of a screen including the white background picture;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen;
recognizing the boundary of the white background picture from the photo, and taking the boundary as the position of the outline of the screen, wherein the recognizing comprises the following steps:
converting the picture into a gray picture; a preset pixel threshold value T1 is appointed to divide the gray-scale picture so as to obtain the gray-scale picture of a screen area; acquiring a continuous region of each pixel point in the gray level picture of the screen region; calculating the number of pixel points in the continuous region of each pixel point, and screening the continuous region of each pixel point to obtain the continuous region of the reserved pixel points; calculating the area of the minimum external rotation rectangle of the continuous region of each reserved pixel point, and calculating the saturation s of the minimum external rotation rectangle of the continuous region of each reserved pixel point, wherein the saturation s = the number of pixel points in the continuous region of a certain reserved pixel point/the area of the minimum external rotation rectangle of the continuous region of the reserved pixel point; and taking a continuous region of the reserved pixel points with the saturation s larger than a preset saturation threshold T3 as the boundary of the white background picture, and taking the boundary as the position of the outline of the screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010072259.2A CN111242116B (en) | 2020-01-21 | 2020-01-21 | Screen positioning method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010072259.2A CN111242116B (en) | 2020-01-21 | 2020-01-21 | Screen positioning method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111242116A CN111242116A (en) | 2020-06-05 |
| CN111242116B true CN111242116B (en) | 2022-11-08 |
Family
ID=70865135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010072259.2A Active CN111242116B (en) | 2020-01-21 | 2020-01-21 | Screen positioning method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111242116B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020172190A1 (en) | 2019-02-18 | 2020-08-27 | Ecoatm, Llc | Neural network based physical condition evaluation of electronic devices, and associated systems and methods |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109741324A (en) * | 2019-01-10 | 2019-05-10 | 惠科股份有限公司 | A kind of detection method, detection device and terminal device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236784A (en) * | 2010-05-07 | 2011-11-09 | 株式会社理光 | Screen area detection method and system |
| CN105303189B (en) * | 2014-07-29 | 2019-08-20 | 阿里巴巴集团控股有限公司 | It is a kind of for detecting the method and device of specific identifier image in presumptive area |
| CN105138939B (en) * | 2015-07-31 | 2017-11-17 | 海信集团有限公司 | The method, apparatus and system of a kind of two-dimensional code display |
| CN106228541A (en) * | 2016-07-11 | 2016-12-14 | 广州视源电子科技股份有限公司 | The method and device of screen location in vision-based detection |
| CN106780521B (en) * | 2016-12-08 | 2020-01-07 | 广州视源电子科技股份有限公司 | Screen light leakage detection method, system and device |
| CN110211182B (en) * | 2019-05-31 | 2023-03-31 | 东北大学 | Liquid crystal backlight visual positioning method based on gray scale matching and target contour |
-
2020
- 2020-01-21 CN CN202010072259.2A patent/CN111242116B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109741324A (en) * | 2019-01-10 | 2019-05-10 | 惠科股份有限公司 | A kind of detection method, detection device and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111242116A (en) | 2020-06-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111292302B (en) | Screen detection method and device | |
| CN110689037B (en) | Method and system for automatic object annotation using deep networks | |
| CN106650662B (en) | Target object shielding detection method and device | |
| CN111325716A (en) | Screen scratch fragmentation detection method and equipment | |
| CN111210473A (en) | Mobile phone contour positioning method and equipment | |
| CN110675399A (en) | Screen appearance flaw detection method and equipment | |
| CN111291661B (en) | Method and equipment for identifying text content of icon in screen | |
| CN110796646A (en) | Method and device for detecting defects of screen area of electronic device | |
| CN107734353B (en) | Method and device for recording barrage video, readable storage medium and equipment | |
| CN111311556B (en) | Mobile phone defect position identification method and equipment | |
| JP2020533654A (en) | Holographic anti-counterfeit code inspection method and equipment | |
| CN111325717B (en) | Mobile phone defect position identification method and equipment | |
| CN111175318A (en) | Screen scratch fragmentation detection method and equipment | |
| CN109858542B (en) | Character recognition method and device | |
| CN112037129A (en) | Image super-resolution reconstruction method, device, equipment and storage medium | |
| CN112911281A (en) | Video quality evaluation method and device | |
| CN109271910A (en) | A kind of Text region, character translation method and apparatus | |
| CN109344824A (en) | A kind of line of text method for detecting area, device, medium and electronic equipment | |
| CN110796669A (en) | Vertical frame positioning method and equipment | |
| CN110827246A (en) | Electronic equipment frame appearance flaw detection method and equipment | |
| CN110827248A (en) | Method and device for identifying screen area of electronic device | |
| CN110827245A (en) | Method and equipment for detecting screen display disconnection | |
| CN110765799A (en) | Client code scanning identification method, device, equipment and storage medium | |
| CN110569379A (en) | Method for manufacturing picture data set of automobile parts | |
| CN114418861B (en) | Camera image splicing processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 1101-1103, No. 433, Songhu Road, Yangpu District, Shanghai Applicant after: Shanghai wanwansheng Environmental Protection Technology Group Co.,Ltd. Address before: Room 1101-1103, No. 433, Songhu Road, Yangpu District, Shanghai Applicant before: SHANGHAI YUEYI NETWORK INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |