WO2023142438A1 - Method for recognizing broken screen of terminal, and related device - Google Patents

Method for recognizing broken screen of terminal, and related device Download PDF

Info

Publication number
WO2023142438A1
WO2023142438A1 PCT/CN2022/112581 CN2022112581W WO2023142438A1 WO 2023142438 A1 WO2023142438 A1 WO 2023142438A1 CN 2022112581 W CN2022112581 W CN 2022112581W WO 2023142438 A1 WO2023142438 A1 WO 2023142438A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
picture
terminal
detected
broken
Prior art date
Application number
PCT/CN2022/112581
Other languages
French (fr)
Chinese (zh)
Inventor
茅天奇
丁拥科
王恒
Original Assignee
众安在线财产保险股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 众安在线财产保险股份有限公司 filed Critical 众安在线财产保险股份有限公司
Publication of WO2023142438A1 publication Critical patent/WO2023142438A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30121CRT, LCD or plasma display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Definitions

  • the present invention relates to the technical field of image recognition, in particular to a terminal broken screen recognition method and related equipment.
  • the broken screen insurance business refers to the insurance business in which the screen of the terminal is accidentally damaged and can be compensated or the screen replaced.
  • the damage of the screen of the terminal is manually checked and identified through the screen picture taken by the user.
  • the cracks on the screen may be extremely subtle, and the screen pictures taken by users cannot show the cracks on the screen.
  • the invention provides a terminal broken screen identification method and related equipment, which are used to solve the problem of low accuracy of terminal broken screen identification.
  • the present invention provides a method for identifying a broken screen of a terminal, including:
  • the first screen picture Acquiring a first screen picture to be detected, and dividing the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture is taken when the screen of the first terminal is on;
  • the step of dividing the first screen picture into a first preset number of pictures to be detected includes:
  • the step of dividing the first screen picture into a first preset number of pictures to be detected includes:
  • the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is an aspect ratio of an actual screen
  • the recognition model before the step of inputting each of the pictures to be detected to the recognition model to obtain the number of crack pixels in each picture to be detected, it also includes:
  • the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on;
  • a recognition model is obtained by training a preset model according to each of the pictures to be trained, and saving the recognition model.
  • the step of dividing each second screen picture into a first preset number of pictures to be trained includes:
  • the picture to be divided is divided into a first preset number of pictures to be trained.
  • the step of acquiring the first screen picture of the first terminal to be detected includes:
  • the present invention also provides a device for identifying a broken screen of a terminal, including:
  • An acquisition module configured to acquire a first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the The first screen picture is taken when the screen of the first terminal is on;
  • An input module configured to input each of the pictures to be detected into a recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is trained according to each second screen picture marked with crack pixels ;
  • a determining module configured to determine that the screen of the first terminal is broken when the number of cracked pixels in any of the pictures to be detected is greater than or equal to a second preset number
  • the determining module is further configured to determine that the screen of the first terminal is not broken when the number of cracked pixels in each of the pictures to be detected is less than the second preset number.
  • the present invention also provides a device for identifying a broken screen of a terminal, including: a memory and a processor;
  • the memory stores computer-executable instructions
  • the processor executes the computer-executable instructions stored in the memory, so that the processor executes the method for identifying a broken screen of a terminal as described above.
  • the present invention also provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, they are used to realize the above-mentioned terminal fragmentation. screen recognition method.
  • the present invention also provides a computer program product, including a computer program.
  • a computer program product including a computer program.
  • the computer program is executed by a processor, the method for identifying a broken screen of a terminal as described above is implemented.
  • the terminal broken screen identification method and related equipment obtain the first screen picture of the terminal to be detected, and divide the first screen picture into a first preset number of pictures to be detected, and input each picture to be detected Until the recognition model obtains the cracked pixels of each picture to be detected, when the number of cracked pixels in any picture to be detected is greater than the second preset number, it is determined that the screen of the terminal is broken. If the number of cracked pixels in each picture to be detected is If the number is less than the second preset number, it is determined that the screen of the terminal is not broken.
  • the recognition model is trained according to the second screen picture marked with cracked pixels, so that the recognition model can accurately identify the crack of the screen based on the current screen picture of the terminal, improving the accuracy of terminal broken screen recognition.
  • FIG. 1 is a schematic diagram of a scene of a method for identifying a broken screen of a terminal according to the present invention
  • FIG. 2 is a schematic flowchart of a first embodiment of a method for identifying a broken screen of a terminal according to the present invention
  • FIG. 3 is a schematic diagram of a detailed flow chart of step S10 in the second embodiment of the terminal broken screen identification method of the present invention.
  • FIG. 4 is a schematic diagram of a detailed flow chart of step S10 in the third embodiment of the terminal broken screen identification method of the present invention.
  • FIG. 5 is a schematic flowchart of a fourth embodiment of a method for identifying a broken screen of a terminal according to the present invention.
  • Fig. 6 is a schematic diagram of a screen picture marked with cracked pixels involved in the present invention.
  • FIG. 7 is a schematic diagram of a detailed flowchart of step S10 in the fifth embodiment of the method for identifying a broken screen of a terminal according to the present invention.
  • FIG. 8 is a block diagram of a device for identifying a broken screen of a terminal according to the present invention.
  • FIG. 9 is a schematic diagram of a hardware structure of a device for identifying a broken screen of a terminal according to the present invention.
  • the invention provides a broken screen identification method of a terminal.
  • the screen picture is taken by turning on the screen of the mobile phone.
  • the screen picture shows that there are cracks in two areas of the mobile phone, specifically the cracked area of the screen picture.
  • the screen picture is input into the terminal device as the picture to be detected of the mobile phone.
  • the terminal device may be any device capable of data processing, for example, the terminal device may be a computer.
  • the recognition model recognizes the picture to be detected, so that the number of cracked pixels on the screen of the mobile phone can be output, and the terminal device can output a prompt message that the screen of the mobile phone is broken or not broken based on the number and the preset number.
  • the terminal device For example, if the number of cracked pixels is greater than the preset number, the terminal device outputs a prompt message that the screen of the mobile phone is broken; if the number of cracked pixels is less than or equal to the preset number, the terminal device outputs a prompt message that the screen of the mobile phone is not broken.
  • FIG. 2 is a first embodiment of a method for identifying a broken screen of a terminal according to the present invention.
  • the method for identifying a broken screen of a terminal includes the following steps:
  • Step S10 acquire the first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture is the Taken when the screen of a terminal is on.
  • the execution subject is a device for identifying a broken screen of a terminal.
  • the device is used below to refer to a device for identifying a level of a terminal.
  • the device may be any terminal device capable of data processing, for example, the device may be a computer, notebook or mobile phone.
  • the device acquires the first screen picture to be detected.
  • the first screen picture includes a screen of a terminal, and a terminal is defined as a first terminal, which may be a mobile terminal such as a mobile phone or a tablet.
  • the first screen picture is taken when the screen of the first terminal is turned on, that is, the first screen picture includes the lighted screen of the first terminal, so that it is easier to identify whether the screen of the first terminal is lit based on the lighted screen. There are cracks.
  • the device will divide the picture on the first screen into a first preset number of pictures to be detected.
  • the first preset number may be any suitable value, for example, the first preset number may be 8.
  • each picture to be detected is preferably a square picture with the same size, that is, the picture on the first screen is equally divided into a first preset number of pictures to be detected.
  • Step S20 input each picture to be detected into the recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is obtained by training according to each second screen picture marked with crack pixels.
  • a recognition model is stored in the device.
  • the recognition model was trained on individual second-screen images annotated with cracked pixels.
  • the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on.
  • Ripped pixels are those pixels in the second screen picture where the cracks are located.
  • the device inputs each picture to be detected into the recognition model.
  • the identification model identifies each picture to be detected, thereby outputting the number of crack pixels in each picture to be detected.
  • step S30 when the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number, it is determined that the screen of the first terminal is broken.
  • Cracks are generally concentrated in a certain area of the screen, and the total number of pixels on the entire screen is relatively large.
  • the ratio of the crack pixels corresponding to the cracks to the total number is relatively small, which makes the device misjudge that the screen of the first terminal is not broken. . Therefore, the device divides the picture on the first screen, and sets the total number of pixels in the picture to be detected as the second preset number setting, thereby increasing the proportion of the number of cracked pixels to reasonably determine whether cracks occur on the screen of the first terminal. Broken screen, that is, to avoid misjudgment of the device.
  • the device determines that the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number, it determines that the screen of the first terminal is cracked with sound.
  • Step S40 when the number of cracked pixels in each picture to be detected is less than a second preset number, it is determined that the screen of the first terminal is not broken.
  • the device When the device detects that the number of cracked pixels in each picture to be detected is less than the second preset number, it can determine that the screen of the first terminal is not broken.
  • the first screen picture of the terminal to be detected is obtained, and the first screen picture is divided into a first preset number of pictures to be detected, and each picture to be detected is input into the recognition model to obtain For the crack pixels of each picture to be detected, when the number of crack pixels of any picture to be detected is greater than the second preset number, it is determined that the screen of the terminal is broken. If the number of crack pixels of each picture to be detected is less than the second preset number Set the number and make sure that the screen of the terminal is not broken.
  • the recognition model is trained according to the second screen picture marked with cracked pixels, so that the recognition model can accurately identify the crack of the screen based on the current screen picture of the terminal, improving the accuracy of terminal broken screen recognition.
  • FIG. 3 is a second embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on the first embodiment, step S10 includes:
  • Step S11 removing the background image in the first screen image to obtain a third screen image.
  • Step S12 dividing the picture on the third screen into a first preset number of pictures to be detected.
  • the first screen picture is taken when the screen of the first terminal is turned on. Therefore, the first screen image includes content displayed on the screen, and the displayed content may cover the crack on the screen or make the crack difficult to be identified.
  • the device After obtaining the first screen picture, the device removes the background picture in the first screen to obtain the third screen picture, that is, the third screen picture is a pure color picture, for example, a white field picture.
  • the device then divides the third screen picture into a first preset number of pictures to be detected, so that the device can more clearly identify whether the screen of the terminal is broken.
  • the device removes the background picture in the first screen picture to obtain the third screen picture, and then divides the third screen picture into a first preset number of pictures to be detected, avoiding the first screen
  • the background picture of the screen in the picture affects the recognition accuracy of the recognition model.
  • FIG. 4 is a third embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on the first or second embodiment, step S10 includes:
  • Step S13 converting the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is an aspect ratio of an actual screen.
  • Step S14 dividing the picture on the fourth screen into a first preset number of pictures to be detected.
  • the device converts the first screen into a picture on the fourth screen with a preset ratio.
  • the default ratio is the aspect ratio of the actual screen.
  • the aspect ratio of the mobile phone screen is generally 2:1. If the first screen picture includes the mobile phone screen, the device converts the first screen picture into a 2:1 fourth screen picture.
  • the device divides the picture on the fourth screen to obtain a first preset number of pictures to be detected.
  • the picture on the fourth screen is evenly divided into 2 ⁇ 4 to obtain eight pictures to be detected.
  • the device converts the first screen picture into a fourth screen picture with a preset ratio, and then divides the fourth screen picture into a first preset number of pictures to be detected, that is, according to the first
  • the actual aspect ratio of the screen of a terminal processes pictures, and normalizes the pictures to be recognized, so as to unify the recognition standard of whether the screen is broken or not.
  • Fig. 5 is a fourth embodiment of the terminal broken screen identification method of the present invention, based on any one of the first to third embodiments, before step S20, it also includes:
  • Step S50 acquiring each second screen picture with pixels marked with cracks, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on.
  • the device needs to be trained to obtain a recognition model. Specifically, the device selects pictures of mobile phones of various models uploaded by the user from the database, and the mobile phone is the second terminal, and the second screen picture can be obtained based on each picture.
  • the second screen picture includes the screen of the second terminal, and the second screen is taken when the screen of the second terminal is turned on.
  • Each second screen image is tagged with cold pixels.
  • FIG. 6 is an annotated second screen picture, that is, the white lines in the second screen picture are composed of crack pixels on the screen.
  • Step S60 dividing each second screen picture into a first preset number of pictures to be trained.
  • the device divides each second-screen picture into a first preset number of pictures to be trained.
  • the method of cutting the second-screen picture is the same as that of the first-screen picture, and will not be described again.
  • Step S70 train the preset model according to each picture to be trained to obtain a recognition model, and save the recognition model.
  • the device trains the preset model based on each picture to be trained to obtain the recognition model, and then saves the recognition model.
  • the device After the device obtains the second screen picture, it performs preset processing on the second screen picture to obtain the picture to be divided.
  • the preset processing includes converting the second screen picture to a preset ratio and/or removing the second screen picture.
  • the background picture in the screen picture The conversion of the preset ratio of the second screen picture is the same as that of the first screen picture, and the removal of the background picture in the second screen picture is the same as the removal of the background picture in the first screen picture.
  • the device acquires each second screen picture marked with cracked pixels, and divides each second screen picture into a first preset number of pictures to be trained, so that each picture to be trained
  • the recognition model is obtained by training the preset model, and then based on the recognition model, it is accurately recognized whether the screen of the terminal is broken.
  • FIG. 7 is a fifth embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on any one of the first to third embodiments, step S10 includes:
  • Step S15 acquiring an image when the screen of the first terminal is turned on
  • Step S16 extracting key points in the image to obtain each corner point of the screen of the first terminal
  • Step S17 segmenting the image according to each corner point to obtain the first screen picture.
  • the device may extract a picture including only the screen of the terminal from the image.
  • the device first acquires an image when the screen of the first terminal is turned on, and the image is uploaded by the user.
  • the device uses a key point extraction model to extract key points from the image to obtain each corner point of the screen of the first terminal in the image.
  • the key point extraction model marks the positions of the four intersections of the extension lines of the four sides of the mobile phone frame in the order of upper left, lower left, lower right, and upper right, and defines these four points as the key points of the mobile phone.
  • the device can obtain the first screen picture by segmenting the image based on each corner point, that is, the device uses the picture containing only the screen to identify the broken screen.
  • the device obtains the image when the screen of the first terminal is turned on, and determines each corner point of the screen from the image, so as to segment the first screen picture from the image according to each corner point, avoiding
  • the posture of the terminal affects the accuracy of broken screen recognition.
  • the present invention also provides a device for identifying a broken screen of a terminal.
  • the device for identifying a broken screen of a terminal 800 includes:
  • the acquisition module 810 is configured to acquire a first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture was taken when the screen of the first terminal was lit;
  • the input module 820 is used to input each picture to be detected into the recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is obtained by training according to each second screen picture marked with crack pixels;
  • a determining module 830 configured to determine that the screen of the first terminal is broken when the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number
  • the determination module 830 is configured to determine that the screen of the first terminal is not broken when the number of cracked pixels in each picture to be detected is less than a second preset number.
  • the device 800 for identifying a broken screen of a terminal includes:
  • a processing module configured to remove the background picture in the first screen picture to obtain the third screen picture
  • the segmentation module is used to segment the picture on the third screen into a first preset number of pictures to be detected.
  • the device 800 for identifying a broken screen of a terminal includes:
  • a conversion module configured to convert the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is the aspect ratio of the actual screen;
  • a segmentation module configured to segment the fourth screen picture into a first preset number of pictures to be detected.
  • the device 800 for identifying a broken screen of a terminal includes:
  • the acquiring module 810 is configured to acquire each second screen picture marked with cracked pixels, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is on;
  • a segmentation module configured to segment each second screen image into a first preset number of images to be trained
  • the training module is used to train the preset model according to each picture to be trained to obtain the recognition model, and save the recognition model.
  • the device 800 for identifying a broken screen of a terminal includes:
  • the processing module is used to perform preset processing on each second screen picture to obtain the picture to be divided, and the preset processing includes converting the second screen picture to a preset ratio and/or removing the background picture in the second screen picture;
  • the segmentation module is used to segment the image to be segmented into a first preset number of images to be trained.
  • the device 800 for identifying a broken screen of a terminal includes:
  • An acquisition module 810 configured to acquire an image when the screen of the first terminal is turned on
  • An extraction module configured to extract key points in the image to obtain each corner of the screen of the first terminal
  • the segmentation module is configured to segment the image according to each corner point to obtain the first screen image.
  • Fig. 9 is a hardware structural diagram of a device for identifying a broken screen of a terminal according to an exemplary embodiment.
  • the device 900 for identifying a broken screen of a terminal may include: a processor 901 such as a CPU, a memory 902 and a transceiver 903 .
  • a processor 901 such as a CPU
  • memory 902 such as a RAM
  • transceiver 903 a transceiver
  • FIG. 9 does not constitute a limitation on the broken screen recognition device of the terminal, and may include more or less components than those shown in the figure, or combine certain components, or different components. layout.
  • the memory 902 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk any type of volatile or non-volatile storage device or their combination
  • the processor 901 may invoke a computer program stored in the memory 902 to complete all or part of the steps of the above-mentioned method for identifying a broken screen of a terminal.
  • the transceiver 903 is used for receiving information sent by the external device and sending information to the external device.
  • a non-transitory computer-readable storage medium when the instructions in the storage medium are executed by the processor of the broken screen recognition device of the terminal, the broken screen recognition device of the terminal can execute the above broken screen recognition method of the terminal.
  • a computer program product including a computer program, when the computer program is executed by a processor of the broken screen recognition device of the terminal, the broken screen recognition device of the terminal can execute the above broken screen recognition method of the terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Geometry (AREA)
  • Quality & Reliability (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

The present invention provides a method for recognizing a broken screen of a terminal, and a related device. The method comprises: acquiring a first screen picture to be detected, and segmenting the first screen picture into a first preset number of pictures to be detected; inputting each picture to be detected into a recognition model to obtain the number of crack pixels of each picture to be detected, wherein the recognition model is obtained by training according to each second screen picture marked with the crack pixels; determining that a screen of a first terminal is broken when the number of crack pixels of any picture to be detected is greater than or equal to a second preset number; and determining that the screen of the first terminal is not broken when the number of crack pixels of each picture to be detected is less than the second preset number. In the present invention, the recognition model is obtained by training according to each second screen picture marked with the crack pixels, so that the recognition model can accurately recognize cracks of a screen on the basis of the current screen picture of the terminal, thereby improving the accuracy of terminal broken screen recognition.

Description

终端的碎屏识别方法和相关设备Terminal broken screen identification method and related equipment
本申请要求于2022年01月25日提交中国专利局、申请号为202210090385.X、申请名称为“终端的碎屏识别方法和相关设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202210090385.X and the application title "Broken Screen Identification Method of Terminal and Related Equipment" filed with the China Patent Office on January 25, 2022, the entire contents of which are incorporated by reference in this application.
技术领域technical field
本发明涉及图像识别技术领域,尤其涉及一种终端的碎屏识别方法和相关设备。The present invention relates to the technical field of image recognition, in particular to a terminal broken screen recognition method and related equipment.
背景技术Background technique
随着智能终端的发展以及普及,衍生出终端的碎屏险业务。碎屏险业务指的终端的屏幕意外损坏可进行赔偿或者屏幕更换的保险业务。With the development and popularization of smart terminals, the broken screen insurance business of terminals has been derived. The broken screen insurance business refers to the insurance business in which the screen of the terminal is accidentally damaged and can be compensated or the screen replaced.
目前,终端的屏幕的损坏是通过人工对用户拍摄的屏幕图片进行审核鉴定的。但是屏幕的裂痕可能及其细微,用户拍摄的屏幕图片无法显示出屏幕上的裂痕。At present, the damage of the screen of the terminal is manually checked and identified through the screen picture taken by the user. However, the cracks on the screen may be extremely subtle, and the screen pictures taken by users cannot show the cracks on the screen.
可见,终端的碎屏识别的准确性较低。It can be seen that the accuracy of terminal broken screen recognition is low.
发明内容Contents of the invention
本发明提供一种终端的碎屏识别方法和相关设备,用以解决终端的碎屏识别的准确性较低的问题。The invention provides a terminal broken screen identification method and related equipment, which are used to solve the problem of low accuracy of terminal broken screen identification.
一方面,本发明提供一种终端的碎屏识别方法,包括:In one aspect, the present invention provides a method for identifying a broken screen of a terminal, including:
获取待检测的第一屏幕图片,并将所述第一屏幕图片切分为第一预设数量的待检测图片,所述第一屏幕图片包括第一终端的屏幕,且所述第一屏幕图片是在所述第一终端的屏幕点亮时拍摄的;Acquiring a first screen picture to be detected, and dividing the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture is taken when the screen of the first terminal is on;
将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,所述识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的;Inputting each of the pictures to be detected into a recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is trained according to each second screen picture marked with crack pixels;
在任一所述待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定所述第一终端的屏幕发生碎屏;When the number of cracked pixels in any of the pictures to be detected is greater than or equal to a second preset number, it is determined that the screen of the first terminal is broken;
在每张所述待检测图片的裂痕像素的数量均小于所述第二预设数量时,确定所述第一终端的屏幕未发生碎屏。When the number of cracked pixels in each picture to be detected is less than the second preset number, it is determined that the screen of the first terminal is not broken.
在一实施例中,所述将所述第一屏幕图片切分为第一预设数量的待检测图片的步骤包括:In one embodiment, the step of dividing the first screen picture into a first preset number of pictures to be detected includes:
去除所述第一屏幕图片中的背景画面得到第三屏幕图片;removing the background image in the first screen image to obtain a third screen image;
将所述第三屏幕图片切分为第一预设数量的待检测图片。Segmenting the third screen picture into a first preset number of pictures to be detected.
在一实施例中,所述将所述第一屏幕图片切分为第一预设数量的待检测图片的步骤包括:In one embodiment, the step of dividing the first screen picture into a first preset number of pictures to be detected includes:
将所述第一屏幕图片转换为预设比例的第四屏幕图片,其中,所述预设比例是实际屏幕的长宽比例;converting the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is an aspect ratio of an actual screen;
将所述第四屏幕图片切分为第一预设数量的待检测图片。Segmenting the fourth screen picture into a first preset number of pictures to be detected.
在一实施例中,所述将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量的步骤之前,还包括:In one embodiment, before the step of inputting each of the pictures to be detected to the recognition model to obtain the number of crack pixels in each picture to be detected, it also includes:
获取标注裂痕像素的各张第二屏幕图片,所述第二屏幕图片包括第二终端的屏幕,且所述第二屏幕图片是在所述第二终端的屏幕点亮时拍摄的;Acquiring each second screen picture marked with cracked pixels, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on;
将每张所述第二屏幕图片切分为第一预设数量的待训练图片;dividing each of the second screen pictures into a first preset number of pictures to be trained;
根据各张所述待训练图片对预设模型进行训练得到识别模型,并保存所述识别模型。A recognition model is obtained by training a preset model according to each of the pictures to be trained, and saving the recognition model.
在一实施例中,所述将每张所述第二屏幕图片切分为第一预设数量的待训练图片的步骤包括:In one embodiment, the step of dividing each second screen picture into a first preset number of pictures to be trained includes:
对每张所述第二屏幕图片进行预设处理得到待切分图片,所述预设处理包括对所述第二屏幕图片进行预设比例的转换和/或去除所述第二屏幕图片中的背景画面;Perform preset processing on each of the second screen pictures to obtain the picture to be divided, and the preset processing includes converting the second screen picture to a preset ratio and/or removing Background screen;
将所述待切分图片切分为第一预设数量的待训练图片。The picture to be divided is divided into a first preset number of pictures to be trained.
在一实施例中,所述获取待检测的第一终端的第一屏幕图片的步骤包括:In one embodiment, the step of acquiring the first screen picture of the first terminal to be detected includes:
获取所述第一终端屏幕点亮时的图像;acquiring an image when the screen of the first terminal is turned on;
在所述图像中进行关键点的提取,得到所述第一终端的屏幕的各个角点;performing key point extraction in the image to obtain each corner point of the screen of the first terminal;
根据各个所述角点对所述图像进行切分得到所述第一屏幕图片。Segmenting the image according to each of the corner points to obtain the first screen picture.
另一方面,本发明还提供一种终端的碎屏识别装置,包括:On the other hand, the present invention also provides a device for identifying a broken screen of a terminal, including:
获取模块,用于获取待检测的第一屏幕图片,并将所述第一屏幕图片切分为第一预设数量的待检测图片,所述第一屏幕图片包括第一终端的屏幕,且所述第一屏幕图片是在所述第一终端的屏幕点亮时拍摄的;An acquisition module, configured to acquire a first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the The first screen picture is taken when the screen of the first terminal is on;
输入模块,用于将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,所述识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的;An input module, configured to input each of the pictures to be detected into a recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is trained according to each second screen picture marked with crack pixels ;
确定模块,用于在任一所述待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定所述第一终端的屏幕发生碎屏;A determining module, configured to determine that the screen of the first terminal is broken when the number of cracked pixels in any of the pictures to be detected is greater than or equal to a second preset number;
所述确定模块,还用于在每张所述待检测图片的裂痕像素的数量均小于所述第二预设数量时,确定所述第一终端的屏幕未发生碎屏。The determining module is further configured to determine that the screen of the first terminal is not broken when the number of cracked pixels in each of the pictures to be detected is less than the second preset number.
另一方面,本发明还提供一种终端的碎屏识别设备,包括:存储器以及处理器;On the other hand, the present invention also provides a device for identifying a broken screen of a terminal, including: a memory and a processor;
所述存储器存储计算机执行指令;the memory stores computer-executable instructions;
所述处理器执行所述存储器存储的计算机执行指令,使得所述处理器执行如上所述的终端的碎屏识别方法。The processor executes the computer-executable instructions stored in the memory, so that the processor executes the method for identifying a broken screen of a terminal as described above.
另一方面,本发明还提供一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机执行指令,所述计算机执行指令被处理器执行时用于实现如上所述的终端的碎屏识别方法。On the other hand, the present invention also provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, they are used to realize the above-mentioned terminal fragmentation. screen recognition method.
另一方面,本发明还提供一种计算机程序产品,包括计算机程序,所述计算机程序被处理器执行时,实现如上所述的终端的碎屏识别方法。On the other hand, the present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, the method for identifying a broken screen of a terminal as described above is implemented.
本发明提供的终端的碎屏识别方法和相关设备,获取待检测终端的第一屏幕图片,并将第一屏幕图片切分为第一预设数量的待检测图片,将各张待检测图片输入至识别模型得到每张待检测图片的裂痕像素,在任一待检测图片的裂痕像素的数量大于第二预设数量时,确定终端的屏幕发生碎屏,若每张待检测图片的裂痕像素的数量小于第二预设数量,确定终端的屏幕未发生碎屏。本发明中,识别模型是根据标注裂痕像素的第二屏幕图片训练得到的,使得识别模型能够基于终端当前的屏幕图片准确的识别出屏幕的裂痕,提高了终端碎屏识别的准确性。The terminal broken screen identification method and related equipment provided by the present invention obtain the first screen picture of the terminal to be detected, and divide the first screen picture into a first preset number of pictures to be detected, and input each picture to be detected Until the recognition model obtains the cracked pixels of each picture to be detected, when the number of cracked pixels in any picture to be detected is greater than the second preset number, it is determined that the screen of the terminal is broken. If the number of cracked pixels in each picture to be detected is If the number is less than the second preset number, it is determined that the screen of the terminal is not broken. In the present invention, the recognition model is trained according to the second screen picture marked with cracked pixels, so that the recognition model can accurately identify the crack of the screen based on the current screen picture of the terminal, improving the accuracy of terminal broken screen recognition.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.
图1为本发明终端的碎屏识别方法的场景示意图;FIG. 1 is a schematic diagram of a scene of a method for identifying a broken screen of a terminal according to the present invention;
图2为本发明终端的碎屏识别方法第一实施例的流程示意图;FIG. 2 is a schematic flowchart of a first embodiment of a method for identifying a broken screen of a terminal according to the present invention;
图3为本发明终端的碎屏识别方法第二实施例中步骤S10的细化流程示意图;FIG. 3 is a schematic diagram of a detailed flow chart of step S10 in the second embodiment of the terminal broken screen identification method of the present invention;
图4为本发明终端的碎屏识别方法第三实施例中步骤S10的细化流程示意图;FIG. 4 is a schematic diagram of a detailed flow chart of step S10 in the third embodiment of the terminal broken screen identification method of the present invention;
图5为本发明终端的碎屏识别方法第四实施例的流程示意图;FIG. 5 is a schematic flowchart of a fourth embodiment of a method for identifying a broken screen of a terminal according to the present invention;
图6为本发明涉及的标注裂痕像素的屏幕图片的示意图;Fig. 6 is a schematic diagram of a screen picture marked with cracked pixels involved in the present invention;
图7为本发明终端的碎屏识别方法第五实施例中步骤S10的细化流程示意图;FIG. 7 is a schematic diagram of a detailed flowchart of step S10 in the fifth embodiment of the method for identifying a broken screen of a terminal according to the present invention;
图8为本发明终端的碎屏识别装置的模块示意图;FIG. 8 is a block diagram of a device for identifying a broken screen of a terminal according to the present invention;
图9为本发明终端的碎屏识别设备的硬件结构示意图。FIG. 9 is a schematic diagram of a hardware structure of a device for identifying a broken screen of a terminal according to the present invention.
通过上述附图,已示出本公开明确的实施例,后文中将有更详细的描述。这些附图和文字描述并不是为了通过任何方式限制本公开构思的范围,而是通过参考特定实施例为本领域技术人员说明本公开的概念。By means of the above-mentioned drawings, certain embodiments of the present disclosure have been shown and will be described in more detail hereinafter. These drawings and written description are not intended to limit the scope of the disclosed concept in any way, but to illustrate the disclosed concept for those skilled in the art by referring to specific embodiments.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present disclosure as recited in the appended claims.
本发明提供一种终端的碎屏识别方法。参照图1,屏幕图片是手机点亮屏幕所拍摄的,屏幕图片显示手机有两块区域出现了裂痕,具体为屏幕图片的裂痕区域。屏幕图片作为手机的待检测图片输入至终端设备中。终端设备可以是任意具备数据处理能力的设备,例如,终端设备可以是计算机。识别模型对待检测图片进行识别,从而可以输出手机上屏幕的裂痕像素的数量,终端设备基于该数量与预设数量即可输出手机的屏幕发生碎屏或者未发生碎屏的提示信息。例如,裂痕像素的数量大于预设数量,终端设备输出手机的屏 幕发生碎屏的提示信息;裂痕像素的数量小于或等于预设数量,终端设备输出手机的屏幕未发生碎屏的提示信息。The invention provides a broken screen identification method of a terminal. Referring to Figure 1, the screen picture is taken by turning on the screen of the mobile phone. The screen picture shows that there are cracks in two areas of the mobile phone, specifically the cracked area of the screen picture. The screen picture is input into the terminal device as the picture to be detected of the mobile phone. The terminal device may be any device capable of data processing, for example, the terminal device may be a computer. The recognition model recognizes the picture to be detected, so that the number of cracked pixels on the screen of the mobile phone can be output, and the terminal device can output a prompt message that the screen of the mobile phone is broken or not broken based on the number and the preset number. For example, if the number of cracked pixels is greater than the preset number, the terminal device outputs a prompt message that the screen of the mobile phone is broken; if the number of cracked pixels is less than or equal to the preset number, the terminal device outputs a prompt message that the screen of the mobile phone is not broken.
下面以具体地实施例对本发明的技术方案以及本申请的技术方案如何解决上述技术问题进行详细说明。下面这几个具体的实施例可以相互结合,对于相同或相似的概念或过程可能在某些实施例中不再赘述。下面将结合附图,对本发明的实施例进行描述。The technical solution of the present invention and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
参照图2,图2为本发明终端的碎屏识别方法的第一实施例,终端的碎屏识别方法包括以下步骤:Referring to FIG. 2, FIG. 2 is a first embodiment of a method for identifying a broken screen of a terminal according to the present invention. The method for identifying a broken screen of a terminal includes the following steps:
步骤S10,获取待检测的第一屏幕图片,并将第一屏幕图片切分为第一预设数量的待检测图片,第一屏幕图片包括第一终端的屏幕,且第一屏幕图片是在第一终端的屏幕点亮时拍摄的。Step S10, acquire the first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture is the Taken when the screen of a terminal is on.
在本实施例中,执行主体是终端的碎屏识别装置,为了便于描述,以下采用装置指代终端的水平识别装置。装置可以是任意具备数据处理能力的终端设备,例如,装置可以是电脑、笔记本或者手机。In this embodiment, the execution subject is a device for identifying a broken screen of a terminal. For convenience of description, the device is used below to refer to a device for identifying a level of a terminal. The device may be any terminal device capable of data processing, for example, the device may be a computer, notebook or mobile phone.
装置获取待检测的第一屏幕图片。第一屏幕图片中包括终端的屏幕,终端定义为第一终端,第一终端可以是手机、平板等移动终端。第一屏幕图片是第一终端的屏幕点亮时拍摄的,也即第一屏幕图片中包括第一终端点亮的屏幕,从而基于点亮的屏幕更容易的识别出第一终端的屏幕上是否有裂痕。The device acquires the first screen picture to be detected. The first screen picture includes a screen of a terminal, and a terminal is defined as a first terminal, which may be a mobile terminal such as a mobile phone or a tablet. The first screen picture is taken when the screen of the first terminal is turned on, that is, the first screen picture includes the lighted screen of the first terminal, so that it is easier to identify whether the screen of the first terminal is lit based on the lighted screen. There are cracks.
进一步,装置会将第一屏幕图片切分为第一预设数量的待检测图片。第一预设数量可以为任意合适的数值,例如,第一预设数量可以为8个。此外,各个待检测图片优选为尺寸相同的正方形图片,也即将第一屏幕图片均分为第一预设数量的待检测图片。Further, the device will divide the picture on the first screen into a first preset number of pictures to be detected. The first preset number may be any suitable value, for example, the first preset number may be 8. In addition, each picture to be detected is preferably a square picture with the same size, that is, the picture on the first screen is equally divided into a first preset number of pictures to be detected.
步骤S20,将各张待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的。Step S20, input each picture to be detected into the recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is obtained by training according to each second screen picture marked with crack pixels.
装置中存储有识别模型。识别模型是根据标注裂痕像素的各个第二屏幕图片训练得到的。第二屏幕图片包括第二终端的屏幕,且第二屏幕图片是第二终端的屏幕点亮时拍摄的。裂痕像素指的是第二屏幕图片中裂痕所在的像素。A recognition model is stored in the device. The recognition model was trained on individual second-screen images annotated with cracked pixels. The second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on. Ripped pixels are those pixels in the second screen picture where the cracks are located.
装置将各张待检测图片输入至识别模型。识别模型对每张待检测图片进行识别,从而输出每张待检测图片中的裂痕像素的数量。The device inputs each picture to be detected into the recognition model. The identification model identifies each picture to be detected, thereby outputting the number of crack pixels in each picture to be detected.
步骤S30,在任一待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定第一终端的屏幕发生碎屏。In step S30, when the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number, it is determined that the screen of the first terminal is broken.
裂痕一般是集中在屏幕的某个区域,而整个屏幕的像素的总数量较多,裂痕对应的裂痕像素与总数量的比值是比较小,使得装置会误判第一终端的屏幕未发生碎屏。故而,装置将第一屏幕图片进行切分,且将待检测图片中像素的总数量设置为第二预设数量设置,从而提高了裂痕像素数量的占比以合理确定第一终端的屏幕是否发生碎屏,也即避免装置产生误判。Cracks are generally concentrated in a certain area of the screen, and the total number of pixels on the entire screen is relatively large. The ratio of the crack pixels corresponding to the cracks to the total number is relatively small, which makes the device misjudge that the screen of the first terminal is not broken. . Therefore, the device divides the picture on the first screen, and sets the total number of pixels in the picture to be detected as the second preset number setting, thereby increasing the proportion of the number of cracked pixels to reasonably determine whether cracks occur on the screen of the first terminal. Broken screen, that is, to avoid misjudgment of the device.
装置在确定任一待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定第一终端的屏幕发声碎屏。When the device determines that the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number, it determines that the screen of the first terminal is cracked with sound.
步骤S40,在每张待检测图片的裂痕像素的数量均小于第二预设数量时,确定第一终端的屏幕未发生碎屏。Step S40, when the number of cracked pixels in each picture to be detected is less than a second preset number, it is determined that the screen of the first terminal is not broken.
装置在检测每张待检测图片的裂痕像素的数量均小于第二预设数量,即可确定第一终端的屏幕未发生碎屏。When the device detects that the number of cracked pixels in each picture to be detected is less than the second preset number, it can determine that the screen of the first terminal is not broken.
在本实施例提供的技术方案中,获取待检测终端的第一屏幕图片,并将第一屏幕图片切分为第一预设数量的待检测图片,将各张待检测图片输入至识别模型得到每张待检测图片的裂痕像素,在任一待检测图片的裂痕像素的数量大于第二预设数量时,确定终端的屏幕发生碎屏,若每张待检测图片的裂痕像素的数量小于第二预设数量,确定终端的屏幕未发生碎屏。本发明中,识别模型是根据标注裂痕像素的第二屏幕图片训练得到的,使得识别模型能够基于终端当前的屏幕图片准确的识别出屏幕的裂痕,提高了终端碎屏识别的准确性。In the technical solution provided in this embodiment, the first screen picture of the terminal to be detected is obtained, and the first screen picture is divided into a first preset number of pictures to be detected, and each picture to be detected is input into the recognition model to obtain For the crack pixels of each picture to be detected, when the number of crack pixels of any picture to be detected is greater than the second preset number, it is determined that the screen of the terminal is broken. If the number of crack pixels of each picture to be detected is less than the second preset number Set the number and make sure that the screen of the terminal is not broken. In the present invention, the recognition model is trained according to the second screen picture marked with cracked pixels, so that the recognition model can accurately identify the crack of the screen based on the current screen picture of the terminal, improving the accuracy of terminal broken screen recognition.
参照图3,图3是本发明终端的碎屏识别方法第二实施例,基于第一实施例,步骤S10包括:Referring to FIG. 3 , FIG. 3 is a second embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on the first embodiment, step S10 includes:
步骤S11,去除第一屏幕图片中的背景画面得到第三屏幕图片。Step S11 , removing the background image in the first screen image to obtain a third screen image.
步骤S12,将第三屏幕图片切分为第一预设数量的待检测图片。Step S12, dividing the picture on the third screen into a first preset number of pictures to be detected.
在本实施例中,第一屏幕图片是第一终端的屏幕点亮时拍摄的。因而,第一屏幕图片中包括有屏幕显示的内容,显示内容可能会遮盖屏幕上的裂痕或者会造成裂痕不易被识别。In this embodiment, the first screen picture is taken when the screen of the first terminal is turned on. Therefore, the first screen image includes content displayed on the screen, and the displayed content may cover the crack on the screen or make the crack difficult to be identified.
对此,装置在得到第一屏幕图片后,去除第一屏幕中的背景画面得 到第三屏幕图片,也即第三屏幕图片是纯颜色的画面,例如,白场画面。For this, after obtaining the first screen picture, the device removes the background picture in the first screen to obtain the third screen picture, that is, the third screen picture is a pure color picture, for example, a white field picture.
装置再将第三屏幕图片切分为第一预设数量的待检测图片,从而能够使得装置能够更加清晰的识别出终端的屏幕是否发生碎屏。The device then divides the third screen picture into a first preset number of pictures to be detected, so that the device can more clearly identify whether the screen of the terminal is broken.
在本实施例提供的技术方案中,装置将第一屏幕图片中的背景画面去除得到第三屏幕图片,再将第三屏幕图片切分为第一预设数量的待检测图片,避免第一屏幕图片中屏幕的背景画面影响识别模型的识别精度。In the technical solution provided in this embodiment, the device removes the background picture in the first screen picture to obtain the third screen picture, and then divides the third screen picture into a first preset number of pictures to be detected, avoiding the first screen The background picture of the screen in the picture affects the recognition accuracy of the recognition model.
参照图4,图4是本发明终端的碎屏识别方法第三实施例,基于第一或第二实施例,步骤S10包括:Referring to FIG. 4 , FIG. 4 is a third embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on the first or second embodiment, step S10 includes:
步骤S13,将第一屏幕图片转换为预设比例的第四屏幕图片,其中,预设比例是实际屏幕的长宽比例。Step S13, converting the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is an aspect ratio of an actual screen.
步骤S14,将第四屏幕图片切分为第一预设数量的待检测图片。Step S14, dividing the picture on the fourth screen into a first preset number of pictures to be detected.
在本实施例中,装置将第一屏幕转换为预设比例的第四屏幕图片。预设比例是实际屏幕的长宽比例。具体的,手机屏幕的长宽比例一般为2:1,若是第一屏幕图片包括的是手机屏幕,则装置将第一屏幕图片转换为2:1的第四屏幕图片。In this embodiment, the device converts the first screen into a picture on the fourth screen with a preset ratio. The default ratio is the aspect ratio of the actual screen. Specifically, the aspect ratio of the mobile phone screen is generally 2:1. If the first screen picture includes the mobile phone screen, the device converts the first screen picture into a 2:1 fourth screen picture.
装置将第四屏幕图片进行切分得到第一预设数量的待检测图片,例如,将第四屏幕图片进行2×4的均匀切分,得到八张待检测图片。The device divides the picture on the fourth screen to obtain a first preset number of pictures to be detected. For example, the picture on the fourth screen is evenly divided into 2×4 to obtain eight pictures to be detected.
在本实施例提供的技术方案中,装置将第一屏幕图片转化为预设比例的第四屏幕图片,再将第四屏幕图片且分为第一预设数量的待检测图片,也即按照第一终端的屏幕实际长宽比例处理图片,对待识别的图片进行规范化,以统一屏幕是否发生碎屏的识别标准。In the technical solution provided by this embodiment, the device converts the first screen picture into a fourth screen picture with a preset ratio, and then divides the fourth screen picture into a first preset number of pictures to be detected, that is, according to the first The actual aspect ratio of the screen of a terminal processes pictures, and normalizes the pictures to be recognized, so as to unify the recognition standard of whether the screen is broken or not.
参照图5,图5为本发明终端的碎屏识别方法第四实施例,基于第一至第三中任一实施例,步骤S20之前,还包括:Referring to Fig. 5, Fig. 5 is a fourth embodiment of the terminal broken screen identification method of the present invention, based on any one of the first to third embodiments, before step S20, it also includes:
步骤S50,获取标注裂痕像素的各张第二屏幕图片,第二屏幕图片包括第二终端的屏幕,且第二屏幕图片是在第二终端的屏幕点亮时拍摄的。Step S50 , acquiring each second screen picture with pixels marked with cracks, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on.
在本实施例中,装置需要训练得到识别模型。具体的,装置从数据库中选取用户上传的各个型号的手机的图片,手机即为第二终端,基于每张图片即可得到第二屏幕图片。第二屏幕图片包括第二终端的屏幕,且第二屏幕是第二终端屏幕点亮时拍摄的。每张第二屏幕图片会进行列冷像素的标记。具 体参照图6,图6为标注后的第二屏幕图片,也即第二屏幕图片中白色的线条是屏幕上的裂痕像素所组成的。In this embodiment, the device needs to be trained to obtain a recognition model. Specifically, the device selects pictures of mobile phones of various models uploaded by the user from the database, and the mobile phone is the second terminal, and the second screen picture can be obtained based on each picture. The second screen picture includes the screen of the second terminal, and the second screen is taken when the screen of the second terminal is turned on. Each second screen image is tagged with cold pixels. Referring specifically to FIG. 6 , FIG. 6 is an annotated second screen picture, that is, the white lines in the second screen picture are composed of crack pixels on the screen.
步骤S60,将每张第二屏幕图片切分为第一预设数量的待训练图片。Step S60, dividing each second screen picture into a first preset number of pictures to be trained.
装置将每张第二屏幕图片切分为第一预设数量的待训练图片,第二屏幕图片的切方方法与第一屏幕图片的切分方法相同,再次不再进行赘述。The device divides each second-screen picture into a first preset number of pictures to be trained. The method of cutting the second-screen picture is the same as that of the first-screen picture, and will not be described again.
步骤S70,根据各张待训练图片对预设模型进行训练得到识别模型,并保存识别模型。Step S70, train the preset model according to each picture to be trained to obtain a recognition model, and save the recognition model.
装置基于各张待训练图片对预设模型进行训练即可得到识别模型,再保存识别模型。The device trains the preset model based on each picture to be trained to obtain the recognition model, and then saves the recognition model.
需要说明的是,装置在得到第二屏幕图片后,对第二屏幕图片进行预设处理得到待切分图片,预设处理包括对第二屏幕图片进行预设比例的转换和/或去除第二屏幕图片中的背景画面。第二屏幕图片进行预设比例的转换与第一屏幕图片进行预设比例的转换相同,且去除第二屏幕图片中的背景画面与去除第一屏幕画面中背景画面相同,具体参照上述说明,再次不再进行赘述。It should be noted that after the device obtains the second screen picture, it performs preset processing on the second screen picture to obtain the picture to be divided. The preset processing includes converting the second screen picture to a preset ratio and/or removing the second screen picture. The background picture in the screen picture. The conversion of the preset ratio of the second screen picture is the same as that of the first screen picture, and the removal of the background picture in the second screen picture is the same as the removal of the background picture in the first screen picture. Refer to the above description for details. No more details.
在本实施例提供的技术方案中,装置获取标注裂痕像素的各张第二屏幕画面,将每张第二屏幕画面切分为第一预设数量的待训练图片,从而根据各张待训练图片对预设模型进行训练得到识别模型,进而基于识别模型准确的识别终端的屏幕是否发生碎屏。In the technical solution provided in this embodiment, the device acquires each second screen picture marked with cracked pixels, and divides each second screen picture into a first preset number of pictures to be trained, so that each picture to be trained The recognition model is obtained by training the preset model, and then based on the recognition model, it is accurately recognized whether the screen of the terminal is broken.
参照图7,图7是本发明终端的碎屏识别方法第五实施例,基于第一至第三中任一实施例,步骤S10包括:Referring to FIG. 7 , FIG. 7 is a fifth embodiment of a method for identifying a broken screen of a terminal according to the present invention. Based on any one of the first to third embodiments, step S10 includes:
步骤S15,获取第一终端屏幕点亮时的图像;Step S15, acquiring an image when the screen of the first terminal is turned on;
步骤S16,在图像中进行关键点的提取,得到第一终端的屏幕的各个角点;Step S16, extracting key points in the image to obtain each corner point of the screen of the first terminal;
步骤S17,根据各个角点对图像进行切分得到第一屏幕图片。Step S17, segmenting the image according to each corner point to obtain the first screen picture.
在本实施例中,在进行终端的碎屏识别时,终端的姿态不同,会对终端的碎屏识别精度造成影响。对此,装置可以从图像中提取仅包含终端的屏幕的图片。In this embodiment, when identifying a broken screen of the terminal, different gestures of the terminal will affect the accuracy of identifying the broken screen of the terminal. For this, the device may extract a picture including only the screen of the terminal from the image.
具体的,装置先获取第一终端屏幕点亮时的图像,该图像由用户上 传。装置采用关键点提取模型从图像中进行关键点的提取得到第一终端的屏幕在图像中的各个角点。关键点提取模型对手机边框的四条边的延长线的四个交点的位置按照左上,左下,右下,右上的顺序进行标注,并将这四个点定义为该手机的关键点。Specifically, the device first acquires an image when the screen of the first terminal is turned on, and the image is uploaded by the user. The device uses a key point extraction model to extract key points from the image to obtain each corner point of the screen of the first terminal in the image. The key point extraction model marks the positions of the four intersections of the extension lines of the four sides of the mobile phone frame in the order of upper left, lower left, lower right, and upper right, and defines these four points as the key points of the mobile phone.
装置基于各个角点对图像进行切分即可得到第一屏幕图片,也即装置用仅包含屏幕的图片进行碎屏的识别。The device can obtain the first screen picture by segmenting the image based on each corner point, that is, the device uses the picture containing only the screen to identify the broken screen.
在本实施例提供的技术方案中,装置获取第一终端屏幕点亮时的图像,并从图像中确定屏幕的各个角点,从而根据各个角点从图像中切分出第一屏幕图片,避免终端的姿态对碎屏识别精度造成影响。In the technical solution provided by this embodiment, the device obtains the image when the screen of the first terminal is turned on, and determines each corner point of the screen from the image, so as to segment the first screen picture from the image according to each corner point, avoiding The posture of the terminal affects the accuracy of broken screen recognition.
本发明还提供一种终端的碎屏识别装置,参照图8,终端的碎屏识别装置800包括:The present invention also provides a device for identifying a broken screen of a terminal. Referring to FIG. 8 , the device for identifying a broken screen of a terminal 800 includes:
获取模块810,用于获取待检测的第一屏幕图片,并将第一屏幕图片切分为第一预设数量的待检测图片,第一屏幕图片包括第一终端的屏幕,且第一屏幕图片是在第一终端的屏幕点亮时拍摄的;The acquisition module 810 is configured to acquire a first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture was taken when the screen of the first terminal was lit;
输入模块820,用于将各张待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的;The input module 820 is used to input each picture to be detected into the recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is obtained by training according to each second screen picture marked with crack pixels;
确定模块830,用于在任一待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定第一终端的屏幕发生碎屏;A determining module 830, configured to determine that the screen of the first terminal is broken when the number of cracked pixels in any picture to be detected is greater than or equal to a second preset number;
确定模块830,用于在每张待检测图片的裂痕像素的数量均小于第二预设数量时,确定第一终端的屏幕未发生碎屏。The determination module 830 is configured to determine that the screen of the first terminal is not broken when the number of cracked pixels in each picture to be detected is less than a second preset number.
在一实施例中,终端的碎屏识别装置800包括:In an embodiment, the device 800 for identifying a broken screen of a terminal includes:
处理模块,用于去除第一屏幕图片中的背景画面得到第三屏幕图片;A processing module, configured to remove the background picture in the first screen picture to obtain the third screen picture;
切分模块,用于将第三屏幕图片切分为第一预设数量的待检测图片。The segmentation module is used to segment the picture on the third screen into a first preset number of pictures to be detected.
在一实施例中,终端的碎屏识别装置800包括:In an embodiment, the device 800 for identifying a broken screen of a terminal includes:
转换模块,用于将第一屏幕图片转换为预设比例的第四屏幕图片,其中,预设比例是实际屏幕的长宽比例;A conversion module, configured to convert the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is the aspect ratio of the actual screen;
切分模块,用于将第四屏幕图片切分为第一预设数量的待检测图片。A segmentation module, configured to segment the fourth screen picture into a first preset number of pictures to be detected.
在一实施例中,终端的碎屏识别装置800包括:In an embodiment, the device 800 for identifying a broken screen of a terminal includes:
获取模块810,用于获取标注裂痕像素的各张第二屏幕图片,第二屏幕图 片包括第二终端的屏幕,且第二屏幕图片是在第二终端的屏幕点亮时拍摄的;The acquiring module 810 is configured to acquire each second screen picture marked with cracked pixels, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is on;
切分模块,用于将每张第二屏幕图片切分为第一预设数量的待训练图片;A segmentation module, configured to segment each second screen image into a first preset number of images to be trained;
训练模块,用于根据各张待训练图片对预设模型进行训练得到识别模型,并保存识别模型。The training module is used to train the preset model according to each picture to be trained to obtain the recognition model, and save the recognition model.
在一实施例中,终端的碎屏识别装置800包括:In an embodiment, the device 800 for identifying a broken screen of a terminal includes:
处理模块,用于对每张第二屏幕图片进行预设处理得到待切分图片,预设处理包括对第二屏幕图片进行预设比例的转换和/或去除第二屏幕图片中的背景画面;The processing module is used to perform preset processing on each second screen picture to obtain the picture to be divided, and the preset processing includes converting the second screen picture to a preset ratio and/or removing the background picture in the second screen picture;
切分模块,用于将待切分图片切分为第一预设数量的待训练图片。The segmentation module is used to segment the image to be segmented into a first preset number of images to be trained.
在一实施例中,终端的碎屏识别装置800包括:In an embodiment, the device 800 for identifying a broken screen of a terminal includes:
获取模块810,用于获取第一终端屏幕点亮时的图像;An acquisition module 810, configured to acquire an image when the screen of the first terminal is turned on;
提取模块,用于在图像中进行关键点的提取,得到第一终端的屏幕的各个角点;An extraction module, configured to extract key points in the image to obtain each corner of the screen of the first terminal;
切分模块,用于根据各个角点对图像进行切分得到第一屏幕图片。The segmentation module is configured to segment the image according to each corner point to obtain the first screen image.
图9是根据一示例性实施例示出的一种终端的碎屏识别设备的硬件结构图。Fig. 9 is a hardware structural diagram of a device for identifying a broken screen of a terminal according to an exemplary embodiment.
终端的碎屏识别设备900可以包括:处理器901,例如CPU,存储器902以及收发器903。本领域技术人员可以理解,图9中示出的结构并不构成对终端的碎屏识别设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。存储器902可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。The device 900 for identifying a broken screen of a terminal may include: a processor 901 such as a CPU, a memory 902 and a transceiver 903 . Those skilled in the art can understand that the structure shown in FIG. 9 does not constitute a limitation on the broken screen recognition device of the terminal, and may include more or less components than those shown in the figure, or combine certain components, or different components. layout. The memory 902 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
处理器901可以调用存储器902内存储的计算机程序,以完成上述的终端的碎屏识别方法的全部或部分步骤。The processor 901 may invoke a computer program stored in the memory 902 to complete all or part of the steps of the above-mentioned method for identifying a broken screen of a terminal.
收发器903用于接收外部设备发送的信息以及向外部设备发送信息。The transceiver 903 is used for receiving information sent by the external device and sending information to the external device.
一种非临时性计算机可读存储介质,当该存储介质中的指令由终端 的碎屏识别设备的处理器执行时,使得终端的碎屏识别设备能够执行上述终端的碎屏识别方法。A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the broken screen recognition device of the terminal, the broken screen recognition device of the terminal can execute the above broken screen recognition method of the terminal.
一种计算机程序产品,包括计算机程序,当该计算机程序由终端的碎屏识别设备的处理器执行时,使得终端的碎屏识别设备能够执行上述终端的碎屏识别方法。A computer program product, including a computer program, when the computer program is executed by a processor of the broken screen recognition device of the terminal, the broken screen recognition device of the terminal can execute the above broken screen recognition method of the terminal.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本发明旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求书指出。Other embodiments of the present disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present invention is intended to cover any modification, use or adaptation of the present disclosure, and these modifications, uses or adaptations follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The specification and examples are to be considered exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求书来限制。It should be understood that the present disclosure is not limited to the precise constructions which have been described above and shown in the drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

  1. 一种终端的碎屏识别方法,其特征在于,包括:A method for identifying a broken screen of a terminal, comprising:
    获取待检测的第一屏幕图片,并将所述第一屏幕图片切分为第一预设数量的待检测图片,所述第一屏幕图片包括第一终端的屏幕,且所述第一屏幕图片是在所述第一终端的屏幕点亮时拍摄的;Acquiring a first screen picture to be detected, and dividing the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the first screen picture is taken when the screen of the first terminal is on;
    将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,所述识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的;Inputting each of the pictures to be detected into a recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is trained according to each second screen picture marked with crack pixels;
    在任一所述待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定所述第一终端的屏幕发生碎屏;When the number of cracked pixels in any of the pictures to be detected is greater than or equal to a second preset number, it is determined that the screen of the first terminal is broken;
    在每张所述待检测图片的裂痕像素的数量均小于所述第二预设数量时,确定所述第一终端的屏幕未发生碎屏。When the number of cracked pixels in each picture to be detected is less than the second preset number, it is determined that the screen of the first terminal is not broken.
  2. 根据权利要求1所述的终端的碎屏识别方法,其特征在于,所述将所述第一屏幕图片切分为第一预设数量的待检测图片的步骤包括:The method for identifying a broken screen of a terminal according to claim 1, wherein the step of dividing the first screen picture into a first preset number of pictures to be detected comprises:
    去除所述第一屏幕图片中的背景画面得到第三屏幕图片;removing the background image in the first screen image to obtain a third screen image;
    将所述第三屏幕图片切分为第一预设数量的待检测图片。Segmenting the third screen picture into a first preset number of pictures to be detected.
  3. 根据权利要求1所述的终端的碎屏识别方法,其特征在于,所述将所述第一屏幕图片切分为第一预设数量的待检测图片的步骤包括:The method for identifying a broken screen of a terminal according to claim 1, wherein the step of dividing the first screen picture into a first preset number of pictures to be detected comprises:
    将所述第一屏幕图片转换为预设比例的第四屏幕图片,其中,所述预设比例是实际屏幕的长宽比例;converting the first screen picture into a fourth screen picture with a preset ratio, wherein the preset ratio is an aspect ratio of an actual screen;
    将所述第四屏幕图片切分为第一预设数量的待检测图片。Segmenting the fourth screen picture into a first preset number of pictures to be detected.
  4. 根据权利要求1所述的终端的碎屏识别方法,其特征在于,所述将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量的步骤之前,还包括:The method for identifying a broken screen of a terminal according to claim 1, wherein before the step of inputting each of the pictures to be detected to the recognition model to obtain the number of crack pixels of each picture to be detected, further comprising:
    获取标注裂痕像素的各张第二屏幕图片,所述第二屏幕图片包括第二终端的屏幕,且所述第二屏幕图片是在所述第二终端的屏幕点亮时拍摄的;Acquiring each second screen picture marked with cracked pixels, the second screen picture includes the screen of the second terminal, and the second screen picture is taken when the screen of the second terminal is turned on;
    将每张所述第二屏幕图片切分为第一预设数量的待训练图片;dividing each of the second screen pictures into a first preset number of pictures to be trained;
    根据各张所述待训练图片对预设模型进行训练得到识别模型,并保存所述识别模型。A recognition model is obtained by training a preset model according to each of the pictures to be trained, and saving the recognition model.
  5. 根据权利要求4所述的终端的碎屏识别方法,其特征在于,所述将每张所述第二屏幕图片切分为第一预设数量的待训练图片的步骤包括:The terminal broken screen recognition method according to claim 4, wherein the step of dividing each of the second screen pictures into a first preset number of pictures to be trained comprises:
    对每张所述第二屏幕图片进行预设处理得到待切分图片,所述预设处理包括对所述第二屏幕图片进行预设比例的转换和/或去除所述第二屏幕图片中的背景画面;Perform preset processing on each of the second screen pictures to obtain the picture to be divided, and the preset processing includes converting the second screen picture to a preset ratio and/or removing Background screen;
    将所述待切分图片切分为第一预设数量的待训练图片。The picture to be divided is divided into a first preset number of pictures to be trained.
  6. 根据权利要求1-5任一项所述的终端的碎屏识别方法,其特征在于,所述获取待检测的第一终端的第一屏幕图片的步骤包括:The method for identifying a broken screen of a terminal according to any one of claims 1-5, wherein the step of acquiring the first screen picture of the first terminal to be detected comprises:
    获取所述第一终端屏幕点亮时的图像;acquiring an image when the screen of the first terminal is turned on;
    在所述图像中进行关键点的提取,得到所述第一终端的屏幕的各个角点;performing key point extraction in the image to obtain each corner point of the screen of the first terminal;
    根据各个所述角点对所述图像进行切分得到所述第一屏幕图片。Segmenting the image according to each of the corner points to obtain the first screen picture.
  7. 一种终端的碎屏识别装置,其特征在于,包括:A device for identifying a broken screen of a terminal, characterized in that it comprises:
    获取模块,用于获取待检测的第一屏幕图片,并将所述第一屏幕图片切分为第一预设数量的待检测图片,所述第一屏幕图片包括第一终端的屏幕,且所述第一屏幕图片是在所述第一终端的屏幕点亮时拍摄的;An acquisition module, configured to acquire a first screen picture to be detected, and divide the first screen picture into a first preset number of pictures to be detected, the first screen picture includes the screen of the first terminal, and the The first screen picture is taken when the screen of the first terminal is on;
    输入模块,用于将各张所述待检测图片输入至识别模型得到每张待检测图片的裂痕像素的数量,其中,所述识别模型是根据标注裂痕像素的各张第二屏幕图片训练得到的;An input module, configured to input each of the pictures to be detected into a recognition model to obtain the number of crack pixels in each picture to be detected, wherein the recognition model is trained according to each second screen picture marked with crack pixels ;
    确定模块,用于在任一所述待检测图片的裂痕像素的数量大于或等于第二预设数量时,确定所述第一终端的屏幕发生碎屏;A determining module, configured to determine that the screen of the first terminal is broken when the number of cracked pixels in any of the pictures to be detected is greater than or equal to a second preset number;
    所述确定模块,还用于在每张所述待检测图片的裂痕像素的数量均小于所述第二预设数量时,确定所述第一终端的屏幕未发生碎屏。The determining module is further configured to determine that the screen of the first terminal is not broken when the number of cracked pixels in each of the pictures to be detected is less than the second preset number.
  8. 一种终端的碎屏识别设备,其特征在于,包括:存储器以及处理器;A device for identifying a broken screen of a terminal, comprising: a memory and a processor;
    所述存储器存储计算机执行指令;the memory stores computer-executable instructions;
    所述处理器执行所述存储器存储的计算机执行指令,使得所述处理器执行如权利要求1至6任一项所述的终端的碎屏识别方法。The processor executes the computer-executed instructions stored in the memory, so that the processor executes the method for identifying a broken screen of a terminal according to any one of claims 1 to 6.
  9. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机执行指令,所述计算机执行指令被处理器执行时用于实现如权利要求1至6任一项所述的终端的碎屏识别方法。A computer-readable storage medium, characterized in that computer-executable instructions are stored in the computer-readable storage medium, and when the computer-executable instructions are executed by a processor, they are used to implement any one of claims 1 to 6. The broken screen identification method of the terminal.
  10. 一种计算机程序产品,包括计算机程序,其特征在于,所述计算机程序被处理器执行时,实现权利要求1至6任一项所述的终端的碎屏识别方 法。A computer program product, comprising a computer program, characterized in that, when the computer program is executed by a processor, the method for identifying a broken screen of a terminal according to any one of claims 1 to 6 is implemented.
PCT/CN2022/112581 2022-01-25 2022-08-15 Method for recognizing broken screen of terminal, and related device WO2023142438A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210090385.X 2022-01-25
CN202210090385.XA CN114429464A (en) 2022-01-25 2022-01-25 Screen-breaking identification method of terminal and related equipment

Publications (1)

Publication Number Publication Date
WO2023142438A1 true WO2023142438A1 (en) 2023-08-03

Family

ID=81313293

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/112581 WO2023142438A1 (en) 2022-01-25 2022-08-15 Method for recognizing broken screen of terminal, and related device

Country Status (2)

Country Link
CN (1) CN114429464A (en)
WO (1) WO2023142438A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114429464A (en) * 2022-01-25 2022-05-03 众安在线财产保险股份有限公司 Screen-breaking identification method of terminal and related equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170372465A1 (en) * 2016-06-28 2017-12-28 ecoATM, Inc. Methods and systems for detecting cracks in illuminated electronic device screens
WO2018156869A1 (en) * 2017-02-26 2018-08-30 Yougetitback Limited System and method for detection of mobile device fault conditions
CN109119009A (en) * 2017-06-26 2019-01-01 深圳回收宝科技有限公司 Screen defect inspection method, detection device, system and storage medium
CN111612757A (en) * 2020-05-18 2020-09-01 苏州精濑光电有限公司 Screen crack detection method, device, equipment and storage medium
CN113936232A (en) * 2021-10-25 2022-01-14 京东科技信息技术有限公司 Screen fragmentation identification method, device, equipment and storage medium
CN114429464A (en) * 2022-01-25 2022-05-03 众安在线财产保险股份有限公司 Screen-breaking identification method of terminal and related equipment

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110383811A (en) * 2018-06-29 2019-10-25 深圳市大疆创新科技有限公司 Image processing method and device, the first electronic equipment and image processing system
CN108961238A (en) * 2018-07-02 2018-12-07 北京百度网讯科技有限公司 Display screen quality determining method, device, electronic equipment and storage medium
CN110276756A (en) * 2019-06-25 2019-09-24 百度在线网络技术(北京)有限公司 Road surface crack detection method, device and equipment
CN111311556B (en) * 2020-01-21 2023-02-03 上海万物新生环保科技集团有限公司 Mobile phone defect position identification method and equipment
CN113783996B (en) * 2021-08-17 2023-01-17 咪咕文化科技有限公司 Screen defect optimization method, device and equipment and computer storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170372465A1 (en) * 2016-06-28 2017-12-28 ecoATM, Inc. Methods and systems for detecting cracks in illuminated electronic device screens
WO2018156869A1 (en) * 2017-02-26 2018-08-30 Yougetitback Limited System and method for detection of mobile device fault conditions
CN109119009A (en) * 2017-06-26 2019-01-01 深圳回收宝科技有限公司 Screen defect inspection method, detection device, system and storage medium
CN111612757A (en) * 2020-05-18 2020-09-01 苏州精濑光电有限公司 Screen crack detection method, device, equipment and storage medium
CN113936232A (en) * 2021-10-25 2022-01-14 京东科技信息技术有限公司 Screen fragmentation identification method, device, equipment and storage medium
CN114429464A (en) * 2022-01-25 2022-05-03 众安在线财产保险股份有限公司 Screen-breaking identification method of terminal and related equipment

Also Published As

Publication number Publication date
CN114429464A (en) 2022-05-03

Similar Documents

Publication Publication Date Title
WO2019169772A1 (en) Picture processing method, electronic apparatus, and storage medium
WO2018028583A1 (en) Subtitle extraction method and device, and storage medium
JP6208383B2 (en) Image capturing parameter adjustment in preview mode
WO2020093634A1 (en) Face recognition-based method, device and terminal for adding image, and storage medium
US10303968B2 (en) Method and apparatus for image recognition
US8744195B2 (en) Object detection metadata
WO2018233055A1 (en) Method and apparatus for entering policy information, computer device and storage medium
US10847073B2 (en) Image display optimization method and apparatus
ES2609953T3 (en) Text image cropping procedure
CN112396054A (en) Text extraction method and device, electronic equipment and storage medium
WO2022105569A1 (en) Page direction recognition method and apparatus, and device and computer-readable storage medium
US20200089945A1 (en) Information processing apparatus and non-transitory computer readable medium
CN111709414A (en) AR device, character recognition method and device thereof, and computer-readable storage medium
WO2023142438A1 (en) Method for recognizing broken screen of terminal, and related device
WO2022002262A1 (en) Character sequence recognition method and apparatus based on computer vision, and device and medium
US10965801B2 (en) Method for inputting and processing phone number, mobile terminal and storage medium
CN111428570A (en) Detection method and device for non-living human face, computer equipment and storage medium
WO2021190664A1 (en) Multi-face detection method and system based on key point positioning, and storage medium
WO2019137259A1 (en) Image processing method and apparatus, storage medium, and electronic device
CN115719416A (en) Disconnecting link state identification method and device, computer equipment and storage medium
CN111241974B (en) Bill information acquisition method, device, computer equipment and storage medium
US20230343120A1 (en) Automatic scoring method and system
CN110717060B (en) Image mask filtering method, device and storage medium
CN108270973B (en) Photographing processing method, mobile terminal and computer readable storage medium
US20210073458A1 (en) Comic data display system, method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22923242

Country of ref document: EP

Kind code of ref document: A1