CN114531507A

CN114531507A - Defect detection method and device, terminal and storage medium

Info

Publication number: CN114531507A
Application number: CN202011323111.8A
Authority: CN
Inventors: 胡现坤
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2020-11-23
Filing date: 2020-11-23
Publication date: 2022-05-24

Abstract

The disclosure relates to a defect detection method and apparatus, a terminal and a storage medium. Controlling an ultrasonic wave generating device to emit ultrasonic waves toward a screen assembly; the screen assembly includes: the screen and/or the transparent cover plate covered on the screen; detecting the echo of the ultrasonic wave to obtain echo information; and the screen component determines whether the screen component has defects according to the echo information.

Description

Defect detection method and device, terminal and storage medium

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a defect detection method and apparatus, a terminal, and a storage medium.

Background

The display is an important component of a mobile terminal. The display screen can display a system interface, an application interface and the like. In this way, before the display screen is assembled, various defects need to be detected to ensure that the display screen assembled in the mobile terminal is the display screen meeting the use quality requirement.

For example, the defect detection of the display screen is usually performed by collecting an optical image using an electrical property detection or a Charge-coupled Device (CCD), and detecting the optical image through the collected image.

The defect detection of the screen in the related art needs to be performed under a specific detection environment.

Disclosure of Invention

The disclosure provides a defect detection method and apparatus, a terminal and a storage medium.

A first aspect of the embodiments of the present disclosure provides a defect detection method, which is applied to a terminal, where the terminal is provided with a screen assembly and an ultrasonic transmitter located below the screen assembly, and the method includes:

controlling the ultrasonic wave generating device to emit ultrasonic waves toward the screen assembly; the screen assembly includes: the screen and/or the transparent cover plate covering the screen;

detecting the echo of the ultrasonic wave to obtain echo information;

and determining whether the screen component has defects according to the echo information.

Based on the above scheme, the detecting the echo of the ultrasonic wave to obtain echo information includes: detecting the echo of the ultrasonic wave to generate an echo image;

the determining whether the screen component has a defect according to the echo information includes: and determining whether the screen assembly has defects according to the echo image.

Based on the scheme, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used for receiving the echo and forming the echo image.

Based on the scheme, the ultrasonic receiving device is a Thin Film Transistor (TFT).

Based on the above scheme, the method further comprises:

determining defect parameters of the defect according to the echo information, wherein the defect parameters comprise at least one of the following: a defect shape; the width of the defect; depth of defect; a defect location; the length of the defect.

Based on the above scheme, receiving the echo by an ultrasonic receiving device, and determining whether the screen has a defect according to the echo information includes:

determining the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information;

determining whether a region with echo energy meeting a preset condition exists on the receiving surface or not based on the energy distribution;

and if the area with the echo energy meeting the preset condition exists, determining that the screen assembly has defects.

Based on the above scheme, the determining whether there is a region where echo energy satisfies a preset condition on the receiving surface based on the energy distribution includes:

determining whether a region with the ratio of the echo energy to the transmitting energy of the ultrasonic wave larger than a proportional threshold exists on the receiving surface according to the energy distribution;

and if the area with the ratio of the echo energy to the transmitting energy larger than the proportional threshold exists, determining that the area with the echo energy meeting the preset condition exists on the receiving surface.

Based on the above scheme, the method further comprises:

before the ultrasonic wave is transmitted or when the ultrasonic wave is transmitted, outputting first prompt information, wherein the first prompt information is used for prompting that the screen component is stopped being touched.

Based on the above scheme, the method further comprises:

when the screen component is determined to have the defect, outputting second prompt information; wherein the second prompt message is used for prompting that the screen component has a defect.

Based on the above scheme, the determining whether the screen assembly has a defect according to the echo information includes:

and after detecting a starting operation for indicating the starting of a defect detection function, determining whether the screen component has defects according to the echo information.

Based on the above scheme, the determining whether the screen assembly has a defect according to the echo information includes: under the condition that the terminal is in a first working mode, determining whether the screen component has defects or not according to the echo information; and/or, the method further comprises: and under the condition that the terminal is in a second working mode, determining fingerprint information above the screen component according to the echo information.

A second aspect of the embodiments of the present disclosure provides a defect detecting apparatus, which is applied to a terminal, where the terminal is provided with a screen assembly and an ultrasonic emitting device located below the screen assembly, and the apparatus includes:

a transmitting module for controlling the ultrasonic wave generating device to transmit ultrasonic waves toward the screen assembly; screen assembly the screen assembly includes: the screen and/or the transparent cover plate covered on the screen;

the detection module is used for detecting the echo of the ultrasonic wave to obtain echo information;

and the determining module is used for determining whether the screen component has defects according to the echo information.

Based on the above scheme, the detection module is configured to detect an echo of the ultrasonic wave and generate an echo image;

the determining module is used for determining whether the screen component is defective or not according to the echo image.

Based on the above scheme, the determining module is further configured to determine a defect parameter of the defect according to the echo information, where the defect parameter includes at least one of:

a defect shape;

the width of the defect;

depth of defect;

a defect location;

the length of the defect.

Based on the scheme, the echo is received through an ultrasonic receiving device, and the determining module is used for determining the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information; determining whether a region with echo energy meeting a preset condition exists on the receiving surface or not based on the energy distribution; and if the area with the echo energy meeting the preset condition exists, determining that the screen assembly has defects.

Based on the scheme, the determining module is used for determining whether a region with the ratio of the echo energy to the transmission energy of the ultrasonic wave larger than a proportional threshold exists on the receiving surface according to the energy distribution;

Based on the above scheme, the apparatus further comprises:

the first prompt module is used for outputting first prompt information before the ultrasonic wave is transmitted or when the ultrasonic wave is transmitted, wherein the first prompt information is used for prompting to stop touching the screen component.

Based on the above scheme, the apparatus further comprises:

and the second prompt module is used for outputting second prompt information when the fact that the screen assembly has the defect is determined, wherein the second prompt information is used for prompting that the screen assembly has the defect.

Based on the above scheme, the determining module is configured to determine whether the screen component has a defect according to the echo information after detecting a start operation for instructing a defect detection function to start.

Based on the above scheme, the determining module is configured to determine whether the screen component has a defect according to the echo information when the terminal is in the first working mode; and/or

The device further comprises:

and the fingerprint module is used for determining fingerprint information above the screen component according to the echo information under the condition that the terminal is in a second working mode.

According to a third aspect of the embodiments of the present disclosure, there is provided a mobile terminal including:

a memory for storing processor-executable instructions;

a processor coupled to the memory;

wherein the processor is configured to perform the defect detection method as described above.

According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium having instructions therein, which when executed by a processor of a computer, enable the computer to perform the defect detection method as described above.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in the embodiment of the disclosure, whether the screen component has defects such as cracks or not is detected by using ultrasonic waves, so that on one hand, an ultrasonic transmitter in the terminal can be reused, thereby breaking the limitation that the detection must be carried out under a specific detection environment, and the terminal can carry out the detection of the screen component in the using process. On the other hand, the ultrasonic wave is adopted for detection, and based on the echo detection of the ultrasonic wave, whether a crack exists on the screen assembly can be detected with high precision, so that the method has the characteristic of high detection precision.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a schematic flow diagram illustrating a defect detection method according to an exemplary embodiment;

FIG. 2 is a schematic diagram illustrating detection of a fingerprint according to an exemplary embodiment;

FIG. 3 is a schematic diagram illustrating defect detection according to an exemplary embodiment;

FIG. 4 is a schematic flow diagram illustrating a defect detection method in accordance with one illustrative embodiment;

FIG. 5 is a schematic flow chart diagram illustrating a method of defect detection according to an exemplary embodiment;

FIG. 6 is a block diagram of a terminal shown in accordance with an exemplary embodiment;

FIG. 7 is a schematic diagram illustrating a configuration of a defect detection apparatus according to an exemplary embodiment;

fig. 8 is a schematic diagram illustrating a structure of a terminal according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.

As shown in fig. 1, an embodiment of the present disclosure provides a defect detection method, which is applied in a terminal, where the terminal is provided with a screen assembly and an ultrasonic wave emitting device located below the screen assembly, and the method includes:

s110: controlling the ultrasonic wave generating device to emit ultrasonic waves toward the screen assembly; the screen assembly includes: the screen and/or the transparent cover plate covered on the screen;

s120: detecting the echo of the ultrasonic wave to obtain echo information;

s130: and determining whether the screen component has defects according to the echo information.

In the disclosed embodiments, the defects of the screen assembly that can be detected may include at least, but are not limited to: cracks and/or pores.

The defect detection method provided by the embodiment of the disclosure is applied to various types of terminals, including but not limited to: fixed terminal and mobile terminal.

The fixed terminal includes: a desktop computer or a large-screen display device, for example, the large-screen display device includes: smart televisions and/or projection devices.

The mobile terminal includes but is not limited to: the mobile phone, the tablet computer, the wearable device, the vehicle-mounted device or the internet of things terminal. The internet of things terminal includes but is not limited to: intelligent household equipment and/or intelligent office equipment.

The terminal provided by the embodiment of the disclosure can be a terminal with a screen assembly and an ultrasonic transmitter. The ultrasonic transmitter is positioned at the bottom of the screen assembly. The terminal is provided with a screen assembly and an ultrasonic wave emitting device positioned below the screen assembly. The screen may include: a touch screen and a non-touch screen; the touch screen includes: the touch panel is stacked with the display screen; the touch screen can detect touch operation acting on the touch screen through the touch panel. The non-touch screen may include a display screen, does not include a touch panel stacked with the display screen, and cannot detect a touch operation applied to the display screen. A typical touch screen may include: an Organic Light Emitting Diode (OLED) touch screen or a liquid crystal touch screen.

In some embodiments, a transparent Cover plate for protecting the screen is further stacked on the screen, and the transparent Cover plate may be a Cover Glass (CG) but is not limited to a Glass Cover plate.

In some embodiments, the transparent cover plate may also include a plastic cover plate.

In an embodiment of the present disclosure, the screen assembly includes: a screen and/or a transparent cover plate covering the surface of the screen. Alternatively, the screen components may be: any module comprising glass. For example, the screen includes: a glass substrate. The transparent cover plate is as follows: the glass plate has better skid resistance.

The ultrasonic transmitter can be any ultrasonic transmitter positioned at the bottom of the screen component and capable of transmitting ultrasonic waves towards the screen component. In a terminal, the ultrasonic transmitter may be located below the screen. For example, the ultrasonic transmitter is pressed against the back surface of the touch screen.

In some embodiments, the ultrasonic transmitter within the terminal may be: the ultrasonic transmitter for detecting the operation gesture can also be an ultrasonic transmitter for detecting the distance and/or the outline of the collected object in the photographing process of the front camera. The ultrasonic transmitter used in the embodiments of the present disclosure may be an ultrasonic transmitter originally used for other functions in a multiplex terminal, but may also be a dedicated ultrasonic transmitter intentionally introduced for defects of a screen and/or a transparent cover. This is merely an example and the specific implementation is not limited thereto.

In some embodiments, the terminal may be: contain the terminal of fingerprint module. The fingerprint module includes: the ultrasonic transmitter and the image sensor for detecting ultrasonic waves. The ultrasonic waves emit ultrasonic waves, and the image sensor may detect ultrasonic waves (i.e., echoes) returned based on the ultrasonic waves and generate an echo image.

If cracks or pores are formed on the screen and/or the transparent cover plate, air exists in the cracks or pores, so that the quantity of echoes formed by reflecting the ultrasonic waves emitted from the corresponding positions back under the action of the air is increased, and the echo energy at the corresponding positions is more; if there is no crack on the screen or the transparent cover, i.e. there is no crack or air in the pores to reflect the ultrasonic waves, the ultrasonic waves are absorbed more by the screen and/or the transparent cover. In view of this, the detection of whether the screen assembly is defective may be performed according to the echo information in step S130.

In one embodiment, if the ultrasonic sensor located below the screen is used to emit ultrasonic waves for defect detection, since the transparent cover plate is superimposed on the screen, it is necessary to accurately determine whether the defect is located on the screen or on the transparent cover plate, which can be achieved by controlling the emission power of the ultrasonic waves. For example, if the current screen component is a screen, the transmitting power of the ultrasonic wave is a first power; if the current screen component is a transparent cover plate, the transmitting power of the ultrasonic wave is a second power, and the first power is lower than the second power; by means of the power control, on one hand, the positioning of the screen assembly where the defect is located can be achieved, and on the other hand, excessive power consumption caused by excessive power emitted by the ultrasonic waves can be saved.

As shown in fig. 2, the fingerprint module detects fingerprints. The fingerprint of the finger surface is made up of skin protrusions (i.e. ridges of the fingerprint) and depressions (valleys of the fingerprint) between the protrusions of the body surface. The ridges of the fingerprint in fig. 2 are shown at B and the valleys of the fingerprint are shown at a. Between the valleys of the fingerprint and the screen surface, there are formed fine spaces having air therein, which returns the ultrasonic waves as a transmission medium of the ultrasonic waves.

In fig. 2, the Ag conductive layer can be a Thin Film Transistor (TFT) as an integral part of the fingerprint emitter. When alternating current is applied between the TFT and the Ag conducting layer, the piezoelectric material between the TFT and the Ag conducting layer can sense voltage transformation generated by the alternating current, and therefore ultrasonic waves are transmitted in a stretching mode. If the ultrasonic wave returns, the ultrasonic wave acts on the TFT, so that the TFT senses echo energy with different strengths and weaknesses, and a grain signal corresponding to the strengths and weaknesses is formed, thereby generating an echo image. The conductive foam or the conductive ink in fig. 2 can absorb the echo, and the echo is reduced to continue to propagate, so that the ultrasonic wave is transmitted from the back of the terminal.

The screen in fig. 2 is a flexible OLED screen.

Based on the same principle, if a gap or a pore is formed in the screen and/or the glass cover plate, the space in the environment can enter the gap or the pore, so that the ultrasonic wave is not absorbed but returned in the transmission process, and therefore, whether the screen and/or the transparent cover plate has the defects of cracks, pores and the like can be detected according to the echo information obtained by echo detection.

Referring to fig. 3, if there are defects such as cracks or pores in the screen, air or the like is introduced into the defects. For example, see fig. 3 showing a cracked defect at B; and A is the position of the screen without cracks. At this time, more echoes can be formed at B by applying alternating current to the piezoelectric material to transmit ultrasonic waves; and much of the ultrasonic waves emitted at a will be absorbed by the screen and/or the transparent cover itself.

By performing ultrasonic wave emission and echo detection by the module shown in fig. 2 and 3, an alternating current having a frequency of 13 to 18M may be applied between the Ag conductive layer and the TFT, so that the piezoelectric material expands and contracts based on a varying electric field and emits ultrasonic waves.

In one embodiment, the S120 may include: detecting the echo of the ultrasonic wave to generate an echo image;

the S120 may include: and determining whether the screen component has defects according to the echo image.

If the screen and/or the transparent cover plate have defects such as cracks and/or pores, an image different from the image without the defects is formed on the echo image. For example, if location a on the echo image corresponds to a defective area of the screen assembly and location B on the echo image corresponds to a non-defective area of the screen assembly, the texture and/or grayscale corresponding to location a and location B may be different. Thus, by using the image analysis algorithm, it can be known whether the screen assembly is defective or not by extracting the image features of different regions of the image and matching the defective and/or non-defective image features. Image analysis algorithms herein include, but are not limited to: an image analysis algorithm based on a neural network. For example, the echo image is input into a neural network that is trained and capable of detecting defects such as cracks, and the neural network may output decision information on whether the screen component is defective.

In another embodiment, some neural networks may also output some defect parameters of the defect, etc.

Of course, a specific implementation manner that the echo information is an echo image and whether the screen assembly is defective is determined through detection of the echo image is given here, and the specific implementation is not limited thereto.

In one embodiment, the terminal is further provided with an ultrasonic receiving device located below the screen assembly, and the ultrasonic receiving device is used for receiving the echo and forming the echo image.

Illustratively, the ultrasonic receiving device is a thin film transistor TFT.

For example, the ultrasonic receiving device includes: a TFT array composed of a plurality of TFTs, the TFT array forming a receiving face for the echo and generating the echo image based on the received echo energy.

As shown in fig. 4, the method further includes:

s140: determining defect parameters of the defect according to the echo information, wherein the defect parameters comprise at least one of the following parameters: a defect shape; the width of the defect; depth of defect; a defect location; the length of the defect.

The defect parameters may show attributes of different levels of the defect. For example, taking a defect as an example of a crack, at least one of the following may be indicated according to a defect parameter of the crack:

fracture shapes including, but not limited to: single cracks without bifurcations, dendritic cracks with bifurcations;

a crack width, which refers to a width in a first direction within a plane parallel to the screen or transparent cover plate;

the crack depth refers to the length of the crack in the direction perpendicular to the plane of tiling of the screen or transparent cover plate;

a fracture length, which refers to the width in a second direction within the tiling plane of the screen or transparent cover plate, the second direction being perpendicular to the first direction;

the position of the crack, indicating that the crack is located on the screen and/or on the transparent cover plate, further may indicate: the fracture is at a specific location on the screen and/or transparent cover.

Taking the defect as an example of a void, the defect parameter of the void may indicate at least one of: the location of the aperture; the shape of the pores; the inner diameter of the pores, etc.

Of course, the above is only an example, and in particular implementation, the defect parameter may be a parameter describing any attribute of the defect in a spatial structure.

Thus, in the embodiment of the present disclosure, based on the analysis of the echo image, not only can it be detected whether the screen and/or the transparent cover has a defect, but also many parameter attributes of the defect can be detected, so as to facilitate the subsequent maintenance and/or grade determination of the terminal.

In some embodiments, as shown in fig. 4, the S130 may include:

s131: determining the energy distribution of the echo on the receiving surface of the ultrasonic receiving device according to the echo information;

s132: determining whether a region with echo energy meeting a preset condition exists on the receiving surface or not based on the energy distribution;

s133: and if the area with the echo energy meeting the preset condition exists, determining that the screen assembly has defects.

In one embodiment, the energy profile may specifically indicate: the values of the returned wave energy are received in different areas.

In one embodiment, if an echo image is generated, the image reflecting the echo energy may be analyzed to find an area satisfying a predetermined condition, and if an area satisfying the predetermined condition is found, it may be considered that the screen assembly has a defect.

In another embodiment, the terminal may further include: an ultrasonic receiver that receives the ultrasonic waves directly and is able to determine the value of the echo energy directly, rather than generating an echo image.

As can be appreciated, the S132 may include:

And if the ultrasonic receiver is used for receiving the echo and detecting the echo energy, carrying out defect detection on the screen assembly. In an alternative mode, the transmission energy of the ultrasonic wave is recorded, and the echo energy of the echo is detected; and calculating the ratio of the echo energy to the transmitting energy, and determining whether the screen assembly is defective according to the space where the ratio is located. For example, when the ratio is greater than 80%, the screen element may be considered to have a defect, and when the ratio is less than 80%, the screen element may be considered to have no defect.

The ratio threshold may be an experimental value determined by an experiment, or may be in statistics of echo energy and emission energy detected when there is a defect such as a crack.

For example, the ratio threshold may be 80%, 70%, or 85%.

When the mode is adopted to detect the defects of the screen assembly, the screen assembly can be layered in the flat laying plane to form a plurality of areas, the defect detection is carried out based on the areas, and the positions of the defects can be positioned by adopting the mode.

Of course, the defect parameters of the defect, such as the shape, length and/or width of the defect, can also be estimated according to the specific size of the ratio.

For example, if the area corresponding to 9 or 16 adjacent pixels on the screen is taken as one region, the determined shape and the like can be determined according to the ratio of the adjacent regions, and obviously, the defect position can also be located with higher accuracy.

In one embodiment, as shown in fig. 2, the method further comprises:

s100: before the ultrasonic wave is transmitted or when the ultrasonic wave is transmitted, outputting first prompt information, wherein the first prompt information is used for prompting that the screen component is stopped being touched.

In order to reduce the interference of the user touching the screen and the defect detection by fingers, in the embodiment of the disclosure, the first prompt information is output.

The outputting the first prompt message may include:

displaying the first prompt information, for example, controlling a display screen to display the first prompt information;

the first prompt information is output by voice, for example, the voice of the first prompt information is output through a loudspeaker or an earphone.

For example, when detecting a defect of a component On the screen, the Display screen enters a full screen Display state or an off screen Display (AOD) Display state, and displays the first prompt message.

In some embodiments, in order to ensure that the condition of the screen and/or the transparent cover of the terminal in use, for example, defects such as cracks may be generated due to dropping or bumping during the use of the terminal, the defects may be detected by performing the defect detection method provided by the embodiments of the present disclosure periodically or aperiodically. For example, the terminal self-initiates a defect detection of the ultrasound-based screen and/or transparent cover once a week or month each. As another example, based on user input, ultrasonic-based defect detection is initiated. When a user falls or collides in the process of using the terminal, the user may not see the defects of cracks and the like caused by falling and/or collision of the screen and/or the glass cover plate of the terminal from the appearance, and the terminal can be triggered to perform defect detection based on ultrasonic waves through input operation.

In one embodiment, the method further comprises:

and outputting a second prompt message when the screen component is determined to have the defect. And the second prompt message is used for prompting that the screen assembly has defects.

And if the detected screen component has defects, outputting second prompt information through the display screen or the audio module. If the screen is detected to have defects, the user can be prompted to maintain in time by outputting second prompt information.

In addition, if the terminal does not leave the factory currently, the factory can be prompted to intercept the terminal with defects of screen components such as a screen and/or a transparent cover plate from the factory in time.

Of course, in some embodiments, the method further comprises:

according to the defect parameters of the defects, carrying out severity grade classification on the defects;

and outputting grade information of the severity grade of the defect.

The grade information can be used for a manufacturer to judge whether screen components such as a screen and/or a transparent cover plate need to be replaced, if the screen components have defects but the defects have very small influence on use, the severity grade is determined to be low (namely, slight defects), the quality grade of the terminal can be reduced, or the screen and/or the cover plate are disassembled and assembled to the terminal with lower quality grade requirement, the screen and/or the transparent cover plate with slight defects can be continuously used, and unnecessary scrap is reduced.

In some embodiments, if the current terminal is a terminal with a reduced quality level or a low quality, in a factory use process, when it is detected that a defect is detected before factory shipment, the defect is ignored, that is, at least the second prompt information is not output by using the defect detection method based on ultrasonic waves provided by the embodiments of the present disclosure.

For example, in the periodic detection, only the position where the screen and/or the transparent cover plate are easily defective during the use of the terminal may be detected, and exemplarily, the four corners of the screen are periodically detected.

In some embodiments, the S130 may include: and after detecting a starting operation for indicating the starting of a defect detection function, determining whether the screen component has defects according to the echo information.

Namely, the method further comprises: after detecting a start operation of the detection function, starting the defect detection function; wherein the ultrasonic wave for detection is emitted after the defect detection function is turned on;

after the detection is completed, the defect detection function is turned off.

Since the detection is always performed, which results in an increase in power consumption of the terminal, in the embodiment of the present disclosure, the detection function is started after the start operation of the defect detection function is detected. After the detection function is started, the ultrasonic transmitter transmits ultrasonic waves to perform defect detection of screen components such as a screen and/or a transparent cover plate. After the detection is completed, the detection function is automatically turned off. After the defect detection function is turned off, the ultrasonic transmitter stops transmitting ultrasonic waves, and the sensor for detecting echo information also stops detecting the echo information, thereby realizing power consumption saving of the terminal.

In one embodiment, the terminal is provided with a setting page, and a virtual control for turning on or off the defect detection function is arranged in the setting page.

In another embodiment, there are some physical keys on the terminal, such as volume adjustment key and/or power switch key. The activation operation of the activation detection function may be applied to one or a plurality of physical keys simultaneously.

In one embodiment, the terminal comprises a fingerprint module located below the screen, and the fingerprint module has multiple working modes.

The fingerprint module includes: an ultrasonic transmitter capable of transmitting ultrasonic waves and a sensor for detecting echoes to generate an echo image.

In one embodiment, the S130 includes: under the condition that the terminal is in a first working mode, determining whether the screen component has defects or not according to the echo information;

as can be appreciated, the method further comprises: and under the condition that the terminal is in a second working mode, determining fingerprint information above the screen component according to the echo information.

Namely, under a second working mode, the fingerprint module executes a fingerprint detection function; under a first working mode, the fingerprint module executes a defect detection function.

The fingerprint detection function and the defect detection function are different in detection configuration.

The detection configuration includes, but is not limited to:

the transmission power of the ultrasonic wave;

the duration of the transmission of the ultrasonic waves;

the emission range of the ultrasonic waves.

For example, because the fingerprint detection module needs to generate a clear fingerprint image, and the finger of the user must be positioned on the cover plate of the terminal, the ultrasonic wave emitted by the ultrasonic emitter may be sequentially absorbed by the screen and the transparent cover plate and transmitted to the body surface of the finger; therefore, the transmission power of the ultrasonic wave in the first operation mode may be slightly larger than that when defect detection is performed.

For another example, the transmission range of the ultrasonic wave may cover the whole screen and/or the whole transparent cover, but when the fingerprint detection is performed, the user may be informed of the fingerprint detection area through the display of the fingerprint icon. However, when the defect detection of the screen and/or the transparent cover plate is comprehensive detection, the ultrasonic wave emission range during the defect detection is larger than the emission range of the fingerprint detection.

The embodiment of the disclosure relates to a novel application of fingerprints, which utilizes ultrasonic fingerprints to detect screen defects. The working principle of the ultrasonic fingerprint is shown in figure 2. The ultrasonic wave encounters the valley of the fingerprint (area a in fig. 2), because more than 85% of the air is reflected back and received by the TFT; encountering the ridge of the fingerprint (region B in fig. 2), mostly penetrating the finger, with very few returns to the TFT; this forms a fingerprint image, which is a texture signal having different intensity on the TFT.

The reflectivity of the ultrasonic wave meeting air is more than 85%, so that an air layer cannot exist in the screen. By utilizing the characteristic, microcracks in the display screen and the glass cover plate can be detected to remove faults and give an early warning.

As in fig. 3, without finger pressure, most of the energy returns after a crack B in the screen encounters the ultrasonic wave; in the absence of the crack a, a part of the energy is absorbed on the way to the propagation, and the return energy is small. By this method, the shape of the fracture can be detected, and if the signal is sufficient, the depth and width of the fracture can be judged by means of an image processing algorithm.

A switch for detecting the above-mentioned defects such as screen defects may be provided in the mobile phone to turn on the detection function. When the defects of the screen and/or the transparent cover plate are detected, a user is reminded that the display screen is not touched by hands as much as possible, and the display effect is influenced. After the defect detection is completed, the detection function is automatically turned off.

The scheme has limited conditions in use and can be used on a mobile phone with a full-screen ultrasonic fingerprint. The area of the single-point ultrasonic fingerprint or large-area ultrasonic fingerprint detection screen defect is too small, only the size of the sensing area of the ultrasonic fingerprint,

the terminal shown on the left side of fig. 6 has a full-screen ultrasonic function, and thus, by using the full-screen ultrasonic function, it is possible to detect fine cracks of a screen and a CG, screen defective products, and reduce quality accidents at any time and any place.

The terminal shown on the right of fig. 6 has a partial ultrasonic fingerprint. If the terminal only has local ultrasonic fingerprint, then under the nonadjustable condition of ultrasonic emitter's of the fingerprint module that this ultrasonic fingerprint corresponds emission angle, then defects such as the fracture of screen and/or transparent cover plate that can only detect locally. If the transmission angle of the ultrasonic transmitter contained in the fingerprint module corresponding to the local fingerprint detection can be changed, for example, any position of the AA area can be displayed by the scanning terminal through the change of the transmission angle, and the local fingerprint detection module can still be used for detecting the defects of the screen and/or the transparent cover plate.

The full-screen ultrasonic fingerprint is utilized to develop the screen defect detection function, and the production and test costs are reduced.

As shown in fig. 7, an embodiment of the present disclosure provides a defect detecting apparatus, which is applied in a terminal, where the terminal is provided with a screen assembly and an ultrasonic wave emitting device located below the screen assembly; the device comprises:

a transmitting module 710 for controlling the ultrasonic wave generating device to transmit the ultrasonic wave toward the screen assembly; screen assembly the screen assembly includes: the screen and/or the transparent cover plate covered on the screen;

a detecting module 720, configured to detect an echo of the ultrasonic wave to obtain echo information;

and a determining module 730, configured to determine, by the screen component, whether the screen component has a defect according to the echo information.

In some embodiments, the transmission module 710, detection module 720, and determination module 730 may be program modules; after being executed by the processor, the program module can realize the emission of ultrasonic waves, the detection of echo waves and the determination of defects.

In other embodiments, the transmitting module 710, the detecting module 720 and the determining module 730 can be a soft-hard combining module; soft and hard combining modules include, but are not limited to, programmable arrays; programmable arrays include, but are not limited to: a field programmable array or a complex programmable array.

In still other embodiments, the transmission module 710, detection module 720, and determination module 730 may be purely hardware modules; pure hardware modules include, but are not limited to: an application specific integrated circuit.

In some embodiments, the detecting module 720 is configured to detect an echo of the ultrasonic wave, and generate an echo image;

the determining module 730 is configured to determine whether the screen component is defective according to the echo image.

In one embodiment, the ultrasonic receiving device is a thin film transistor TFT.

In some embodiments, the determining module 730 is further configured to determine a defect parameter of the defect according to the echo information, where the defect parameter includes at least one of:

a defect shape;

the width of the defect;

depth of defect;

a defect location;

the length of the defect.

In some embodiments, the determining module 730 is configured to determine an energy distribution of an echo on a receiving surface of the ultrasound receiving device according to the echo information; determining whether a region with echo energy meeting a preset condition exists on the receiving surface or not based on the energy distribution; and if the area with the echo energy meeting the preset condition exists, determining that the screen assembly has defects.

In some embodiments, the determining module 730 is configured to determine whether there is a region on the receiving surface where a ratio between the echo energy and the transmission energy of the ultrasonic wave is greater than a proportional threshold according to the energy distribution; and if the area with the ratio of the echo energy to the transmitting energy larger than the proportional threshold exists, determining that the area with the echo energy meeting the preset condition exists on the receiving surface.

In some embodiments, the apparatus further comprises:

the starting module is used for starting the defect detection function after the starting operation of the detection function is detected; wherein the ultrasonic wave for detection is emitted after the defect detection function is turned on; after the detection is completed, the defect detection function is turned off.

The determining module is used for determining whether the screen component has defects or not according to the echo information under the condition that the terminal is in a first working mode; and/or, the device further comprises: and the fingerprint module is used for determining fingerprint information above the screen component according to the echo information under the condition that the terminal is in a second working mode.

An embodiment of the present disclosure provides a terminal, including:

a memory for storing processor-executable instructions;

a processor connected with the memory;

wherein the processor is configured to execute the defect detection method provided by any of the preceding claims.

The processor may include various types of storage media, non-transitory computer storage media capable of continuing to remember to store the information thereon after a power loss to the communication device.

The terminal includes but is not limited to: a mobile terminal.

The processor may be connected to the memory via a bus or the like for reading the executable program stored on the memory, e.g. capable of performing at least one of the methods as shown in any of fig. 1, 4 to 5.

Fig. 8 is a block diagram illustrating a terminal 800 according to an example embodiment. For example, the terminal 800 may be a mobile phone, a mobile computer, or the like.

Referring to fig. 8, terminal 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the terminal 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on terminal 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 806 provides power to the various components of the terminal 800. Power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for terminal 800.

The multimedia component 808 includes a screen that provides an output interface between the terminal 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating state, such as a shooting state or a video state. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive an external audio signal when the terminal 800 is in an operating state, such as a call state, a recording state, and a voice recognition state. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

Sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for terminal 800. For example, sensor assembly 814 can detect the open/closed state of device 800, the relative positioning of components, such as a display and keypad of terminal 800, sensor assembly 814 can also detect a change in position of terminal 800 or a component of terminal 800, the presence or absence of user contact with terminal 800, orientation or acceleration/deceleration of terminal 800, and a change in temperature of terminal 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 816 is configured to facilitate communications between terminal 800 and other devices in a wired or wireless manner. The terminal 800 may access a wireless network based on a communication standard, such as Wi-Fi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, communications component 816 further includes a Near Field Communications (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the terminal 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium including instructions, such as the memory 804 including instructions, executable by the processor 820 of the terminal 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The disclosed embodiments provide a non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of a mobile terminal, enable the mobile terminal to perform the defect detection method provided in any of the foregoing embodiments, and to perform at least one of the methods illustrated in any of fig. 1, 4 to 5.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A defect detection method is applied to a terminal, wherein the terminal is provided with a screen component and an ultrasonic wave emitting device positioned below the screen component, and the method comprises the following steps:

controlling the ultrasonic wave generating device to emit ultrasonic waves toward the screen assembly; the screen assembly includes: the screen and/or the transparent cover plate covered on the screen;

detecting the echo of the ultrasonic wave to obtain echo information;

2. The method of claim 1,

the detecting the echo of the ultrasonic wave to obtain echo information includes: detecting the echo of the ultrasonic wave to generate an echo image;

the determining whether the screen component has a defect according to the echo information includes: and determining whether the screen component has defects according to the echo image.

3. The method of claim 2, wherein the terminal is further provided with an ultrasonic receiving device located below the screen assembly for receiving the echo and forming the echo image.

4. The method according to claim 3, wherein the ultrasonic receiving device is a Thin Film Transistor (TFT).

5. The method of claim 1, further comprising:

6. The method of claim 1, wherein receiving the echo by an ultrasonic receiving device, and wherein determining whether the screen is defective based on the echo information comprises:

7. The method of claim 6, wherein the determining whether there is a region on the receiving surface where the echo energy satisfies a preset condition based on the energy distribution comprises:

8. The method according to any one of claims 1 to 7, further comprising:

9. The method according to any one of claims 1 to 7, further comprising:

10. The method of any one of claims 1 to 7, wherein said determining whether the screen assembly is defective based on the echo information comprises:

11. The method of any one of claims 1 to 7, wherein the determining whether the screen assembly is defective based on the echo information comprises: under the condition that the terminal is in a first working mode, determining whether the screen component has defects or not according to the echo information;

and/or

The method further comprises the following steps: and under the condition that the terminal is in a second working mode, determining fingerprint information above the screen component according to the echo information.

12. A defect detecting apparatus applied to a terminal provided with a screen assembly and an ultrasonic wave emitting device located below the screen assembly, the apparatus comprising:

a transmitting module for controlling the ultrasonic generating device to transmit ultrasonic waves toward the screen assembly; screen assembly the screen assembly includes: the screen and/or the transparent cover plate covering the screen;

and the determining module is used for determining whether the screen component has defects or not according to the echo information.

13. The apparatus according to claim 12, wherein the detecting module is configured to detect an echo of the ultrasonic wave to generate an echo image;

14. The apparatus according to claim 12, wherein the echo is received by an ultrasonic receiving device, and the determining module is configured to determine an energy distribution of the echo on a receiving surface of the ultrasonic receiving device according to the echo information; determining whether a region with echo energy meeting a preset condition exists on the receiving surface or not based on the energy distribution; and if the area with the echo energy meeting the preset condition exists, determining that the screen assembly has defects.

15. The apparatus of claim 14, wherein the determining module is configured to determine whether there is a region on the receiving surface where a ratio between the echo energy and the transmission energy of the ultrasonic wave is greater than a proportional threshold value according to the energy distribution; if the area with the ratio of the echo energy to the transmitting energy larger than the ratio threshold exists, the area with the echo energy meeting the preset condition on the receiving surface is determined.

16. The apparatus of any one of claims 12 to 15, further comprising:

17. The apparatus of any one of claims 12 to 15, further comprising:

18. The apparatus according to any one of claims 12 to 15, wherein the determining module is configured to determine whether the screen component has a defect according to the echo information after detecting a turn-on operation for instructing a defect detection function to turn on.

19. The method according to any one of claims 12 to 15,

the determining module is used for determining whether the screen component has defects or not according to the echo information under the condition that the terminal is in a first working mode; and/or

The device further comprises:

20. A terminal, comprising:

a memory for storing processor-executable instructions;

a processor coupled to the memory;

wherein the processor is configured to perform the defect detection method of any one of claims 1 to 11.

21. A non-transitory computer-readable storage medium, wherein instructions, when executed by a processor of a computer, enable the computer to perform the defect detection method of any of claims 1 to 11.