TW202141972A - Control method, electronic equipment and computer readable storage medium - Google Patents

Abstract

The invention discloses a control method, electronic equipment and a computer readable storage medium. The electronic equipment comprises a depth image acquisition module, a shell and a display screen, the depth image acquisition module is arranged in the shell and located below the display screen, and the depth image acquisition module comprises a transmitter and a receiver. The control method comprises the following steps: when the display screen is refreshed, the transmitter transmits a detection signal to the display screen, and the receiver receives the detection signal which penetrates through the display screen and is reflected by a to-be-detected object so as to obtain a depth information image of the to-be-detected object, wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter. The frequency of the detection signal transmitted by the depth image acquisition module and the refresh frequency of the display screen are kept synchronous, and the transmitter in the depth image acquisition module is driven to transmit the detection signal while the display screen displays the image, so that obvious flickering of an area, corresponding to the depth image acquisition module, of the display screen is avoided, and the user experience is improved.

Description

Control method, electronic equipment and computer readable storage medium

This application relates to the field of imaging technology, in particular to a control method, electronic equipment and computer-readable storage media.

As the market has increasingly higher requirements for the proportion of large screens in mobile phones, various mobile phone manufacturers are trying to place various electronic components, such as cameras, below the screen, which will not affect the photographing effect, but can also display normally. In addition, due to the prevalence of 3D unlocking, more and more mobile phone manufacturers have begun to consider placing the depth camera for 3D unlocking under the screen. However, since the depth camera needs to actively emit light, the actively emitted light will be caused in the corresponding area of the display screen. Obvious flicker seriously affects the user experience.

The embodiments of the present application provide a control method, an electronic device, and a non-volatile computer-readable storage medium.

This application provides a control method. The control method is used in an electronic device, and the electronic device includes a depth image acquisition module, a housing, and a display screen. The depth image acquisition module is arranged in the housing and located below the display screen, and the depth image acquisition module includes a transmitter and a receiver. The control method includes: while the display screen is being refreshed, the transmitter transmits a detection signal to the direction of the display screen, and the receiver receives the reflection of the object to be detected after passing through the display screen. The detection signal is used to obtain the depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.

This application provides an electronic device. The electronic device includes a housing, a display screen, and a depth image acquisition module. The display screen is arranged on the casing. The depth image acquisition module is arranged in the housing and located below the display screen, and the depth image acquisition module includes a transmitter and a receiver. While the display screen is displaying an image, the transmitter transmits a detection signal toward the display screen, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain the Describe the depth information image of the object to be inspected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.

This application provides a non-volatile computer-readable storage medium. The non-volatile computer-readable storage medium includes a computer program that, when executed by a processor, causes the processor to execute: while the display screen is refreshed, the transmitter is directed toward the display screen The detection signal is transmitted, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected; the refresh frequency of the display screen and the The projection frequencies of the transmitters are the same.

The control method, electronic equipment, and non-volatile computer-readable storage medium provided by this application set the frequency of the detection signal emitted by the depth image acquisition module to be synchronized with the refresh frequency of the display screen, and drive the depth map while displaying the image on the screen. The transmitter in the image acquisition module emits a detection signal to avoid obvious flicker in the area corresponding to the display screen and the depth image acquisition module, thereby enhancing the user experience.

The additional aspects and advantages of the embodiments of the present application will be partly given in the following description, and part of them will become obvious from the following description, or be understood through the practice of the present application.

The embodiments of the present application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar symbols indicate the same or similar elements or elements with the same or similar functions throughout. The following embodiments described with reference to the drawings are exemplary, and are only used to explain the embodiments of the present application, and should not be understood as limitations on the embodiments of the present application.

Please refer to FIG. 1, FIG. 2 and FIG. 5. The present application provides a control method for the electronic device 100. The electronic device 100 includes a depth image acquisition module 30, a housing 20, and a display screen 10. The depth image acquisition module 30 is disposed in the housing 20 and is located below the display screen 10. The depth image acquisition module 30 includes a transmitter The receiver 31 and the receiver 32; the control method includes the steps:

01: While the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information of the object to be detected Image; Among them, the refresh frequency of the display screen 10 is the same as the projection frequency of the transmitter 31.

It should be noted that after the display screen 10 is turned on and displays the screen, the display screen 10 will be refreshed at a certain refresh rate. The refreshing process is to display images, no images, display images, and no images alternately and repeatedly. In the process of appearance, since the time that the display screen 10 does not display images during the refresh process is very short and can be ignored, it appears to the user that the display screen 10 continues to display images after being turned on.

Please refer to FIG. 1 and FIG. 2, this application also provides an electronic device 100. The control method of the embodiment of the present application may be implemented by the electronic device 100 of the embodiment of the present application. The electronic device 100 includes a display screen 10, a housing 20 and a depth image acquisition module 30. The display screen 10 is arranged on the housing 20, the depth image acquisition module 30 is arranged in the housing 20 and is located below the display screen 10. The depth image acquisition module 30 includes a transmitter 31 and a receiver 32; on the display screen 10 While displaying the image, the transmitter 31 emits a detection signal toward the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information image of the object to be detected, and display the screen The refresh frequency of 10 is the same as the projection frequency of the transmitter 31.

It should be noted that the electronic device 100 may be a mobile phone, a tablet computer, a notebook computer, a smart bracelet, a smart watch, a smart glasses, etc. In this application, the electronic device 100 is a mobile phone as an example for description.

Specifically, referring to FIGS. 1, 2 and 3, the housing 20 includes a first surface 21 and a second surface 22 disposed opposite to each other. The display screen 10 includes a first substrate 11 and a second substrate 13. The second substrate 13 is disposed on one side of the first substrate 11, and the second substrate 13 is provided with at least one through hole 133. The display screen 10 is disposed on the first surface 21 of the casing 20, and the display screen 10 and the casing 20 form a receiving space 23.

The depth image acquisition module 30 is disposed in the casing 20 and located below the display screen 10, that is, the depth image acquisition module 30 is accommodated in the containing space 23 formed by the display screen 10 and the casing 20. The depth image acquisition module 30 includes a transmitter 31 and a receiver 32. When the number of through holes 133 is one, both the transmitter 31 and the receiver 32 are accommodated in the through holes 133. When the number of through holes 133 is two, the transmitter 31 and the receiver 32 are housed in the two through holes 133 respectively.

While the display screen 10 is displaying images, that is, when the display screen 10 is refreshed, the transmitter 31 transmits a detection signal toward the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 Obtain the depth information image of the object to be inspected. For example, FIG. 4 is a schematic diagram showing the refresh frequency of the screen 10 and the transmission frequency of the detection signal transmitted by the transmitter 31. As shown in FIG. 4, at time T0, the display screen 10 does not display images, and the transmitter 31 does not emit detection signals; at time T1, the display screen 10 starts to display images, and the transmitter 31 starts to emit detection signals; At time T2, the display screen 10 ends displaying images, and the transmitter 31 ends transmitting detection signals. Since the transmitter 31 in the depth image acquisition module 30 is driven to emit a detection signal while the display screen 10 is refreshed (the display screen 10 displays images), the area corresponding to the display screen 10 and the depth image acquisition module 30 is prevented from appearing Obviously flickers, thereby enhancing the user experience.

In some embodiments, the display screen 10 further includes a connection layer 12. The connection layer 12 is used to connect the first substrate 11 and the second substrate 13, and the refractive index of the connection layer 12 is almost close to the refractive index of the air in the through hole 133, and the difference between the two is within a predetermined range (small range). For example, assuming that the predetermined range is (-0.5, 0.5), the difference between the refractive index of the connecting layer 12 and the refractive index of air may be: -0.49, -0.2, -0.1, -0.23, 0, 0.11, 0.2, 0.33, 0.45, etc. Since the difference between the refractive index of the connection layer 12 and the refractive index of the air in the through hole 133 is within a predetermined range, the amount of light reflected from the display screen 10 toward the inside of the display screen 10 in the area where the through hole 133 is not opened is the same as the amount of light reflected in the display screen 10 The area where the through hole 133 is opened has the same amount of light reflected toward the inside of the display screen 10, so as to prevent the display screen 10 from showing inconsistencies in the area where the depth image acquisition module 30 is provided with other areas, thereby further reducing obvious flickering. .

Please refer to Figure 6, step 01: While the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain The depth information image of the object to be inspected includes:

011: Transmit a first detection signal to the object to be detected with the first power;

012: Receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100;

013: Transmit a second detection signal to the object to be detected with the second power, the second power is obtained from the pre-stored distance-power correspondence according to the distance;

014: Receive the second detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the depth information image of the object to be detected.

Specifically, referring to FIGS. 2 and 6, the depth image acquisition module 30 includes a transmitter 31 and a receiver 32. The transmitter 31 is used to transmit a first detection signal to the object to be detected with a first power; the receiver 32 is used to receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the object to be detected and the electronic device The distance of 100; the depth image acquisition module 30 is also used to obtain the second power from the pre-stored distance-power correspondence according to the distance; the transmitter 31 is also used to transmit the second detection signal to the object to be detected at the second power; The receiver 32 is also used to receive the second detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected.

It should be noted that the memory (not shown) in the depth image acquisition module 30 has a distance-power correspondence stored in advance, and the distance-power correspondence represents that the object to be detected is at different distances from the electronic device 100. The magnitude of the optimal power (second power) required for the corresponding depth image acquisition module 30 to transmit the second detection signal. Among them, the distance and power are positively correlated, that is, the farther the distance, the greater the power of the transmitter 31. The distance-power correspondence may be set by the manufacturer when the electronic device 100 leaves the factory, and is fixed, and cannot be changed by the user during use. The distance-power correspondence can also be set by the user and can be changed arbitrarily, and there is no restriction here.

For example, suppose that the distance-power correspondence records that the optimal power corresponding to the first distance is the first preset value; the optimal power corresponding to the second distance is the second preset value, where the first distance is smaller than the first distance Two distances, the first preset value is less than the second preset value. When the depth image acquisition module 30 acquires that the distance between the object to be detected and the electronic device 100 is the first distance, the magnitude of the optimal power corresponding to the first distance in the distance-power correspondence is the first preset value , The transmitter 31 in the depth image acquisition module 30 transmits the second detection signal with the power as the first preset value; when the depth image acquisition module 30 acquires the distance between the object to be detected and the electronic device 100 When it is the second distance, according to the magnitude of the optimal rate corresponding to the second distance in the distance-power correspondence as the second preset value, the transmitter 31 in the depth image acquisition module 30 uses the power as the second preset value. Suppose that a second detection signal is emitted.

In one example, the first power is less than the second power. Since the depth image acquisition module 30 first transmits a low-power (first power) first detection signal to determine the distance between the object to be detected and the electronic device 100, and then selects according to the distance between the object to be detected and the electronic device 100 The second detection signal is transmitted at the optimal power (second power) corresponding to the distance to obtain the depth information image. On the one hand, it prevents the depth image acquisition module 30 from emitting a high-power detection signal for a long time and passing the signal through the display screen 10, which can reduce the damage to the display screen 10 caused by the detection signal emitted by the transmitter 31, thereby improving the display screen 10. Life. On the other hand, when the depth image acquisition module 30 provided below the display screen 10 is used for face recognition, the second detection signal is adjusted according to the distance between the object to be detected (face) and the electronic device 100 The second power level. When the actual distance is greater than the test distance corresponding to the low power, the second power can be adjusted to be greater than the first power. This can prevent the depth image acquisition module 30 from emitting high-power detection signals for a long time and make the The signal passes through the display screen 10 and is shot to the human eye, thereby protecting the human eye and ensuring the safety of the human eye. When the actual distance is less than the test distance corresponding to the low power, the second power can be adjusted to be less than the first power, which can also prevent the depth image acquisition module 30 from emitting a high-power detection signal for a long time and make the signal pass through the display screen 10Shoot into the human eye, thereby protecting the human eye and ensuring the safety of the human eye.

It should be noted that when the distance between the object to be detected and the electronic device 100 is very close, the second power may be equal to the first power.

Please refer to Figure 7, the control method also includes:

015: While transmitting the first detection signal, the display screen 10 displays an image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency; and

016: While transmitting the second detection signal, the display screen 10 displays an image at the second refresh frequency. The projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency.

2 and 7, while the transmitter 31 transmits the first detection signal, the display screen 10 displays an image at a first refresh frequency. The projection frequency of the first detection signal is the same as the first refresh frequency; the transmitter 31 is at While emitting the second detection signal, the display screen 10 displays an image at the second refresh frequency. The projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the second refresh frequency.

In some embodiments, the transmitter 31 emits the first detection signal to the object to be detected at the first power, and the display screen 10 displays the image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency. The receiver 32 receives the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the processor 50 of the electronic device 100 is also used to obtain the distance from the pre-stored distance- The second power is obtained from the power correspondence relationship. The transmitter 31 then transmits the second detection signal at the second power, and at the same time the display screen 10 displays the image at the second refresh frequency, and the projection frequency of the second detection signal is the same as the second refresh frequency. And the first refresh frequency is less than the second refresh frequency, even if the projection frequency of the first detection signal is less than the projection frequency of the second detection signal. On the one hand, because the projection frequency of the first detection signal used to detect the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, because it is used to obtain the depth information image The second detection signal has a higher projection frequency, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

In other embodiments, the memory (not shown) in the electronic device 100 also pre-stores the distance-projection frequency correspondence relationship. The distance-projection frequency correspondence relationship represents that the object to be detected and the electronic device 100 are at different distances. , The size of the optimal projection frequency required for the corresponding depth image acquisition module 30 to transmit the second detection signal. Among them, the distance and the projection frequency are also positively correlated, that is, the farther the distance is, the greater the projection frequency of the transmitter 31 is. The distance-projection frequency correspondence relationship may be set by the manufacturer when the electronic device 100 leaves the factory, is fixed, and cannot be changed by the user during use. The distance-projection frequency correspondence relationship can also be set by the user and can be changed arbitrarily, which is not limited here.

The transmitter 31 can select a second detection signal having a corresponding projection frequency and a corresponding power according to the distance between the object to be detected and the electronic device 100. The greater the distance between the object to be detected and the electronic device 100, the greater the projection frequency of the second detection signal. While projecting the second detection signal, the display screen 10 has a second refresh frequency, and the second refresh frequency is the same as the projection frequency of the second detection signal. In other words, the farther the distance between the object to be detected and the electronic device 100 is, the greater the refresh frequency of the display screen 10 when the second detection signal is transmitted. Specifically, the transmitter 31 emits the first detection signal to the object to be detected at the first power, and at the same time the display screen 10 displays the image at the first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency. The receiver 32 receives the first detection signal reflected back by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the depth image acquisition module 30 is also used to obtain the distance from the pre-stored distance according to the distance − The magnitude of the second power is obtained from the power correspondence, and the magnitude of the projection frequency of the second detection signal is obtained from the pre-stored distance-frequency correspondence according to the distance. The transmitter 31 emits a second detection signal according to the acquired second power and projection frequency, and the display screen 10 displays images at the second refresh frequency, which is the same as the projection frequency of the second detection signal.

In some embodiments, in the distance-power correspondence relationship, a distance value may correspond to a power value, a distance value may correspond to a power range, a distance range may correspond to a power value, or a distance The range corresponds to a power range. When the distance between the object to be detected and the electronic device 100 is detected through the low-power first detection signal, if the table look-up method is used, in the distance-power correspondence relationship, the power corresponding to the detected distance is found to be If there are multiple, one power can be selected as the second power of the second detection signal. Similarly, in the distance-projection frequency correspondence relationship, a distance value can correspond to a projected frequency value, a distance value can correspond to a projected frequency range, a distance range can correspond to a projected frequency value, or a distance range corresponds to a projected frequency value. The distance range corresponds to a projection frequency range. When the distance between the object to be detected and the electronic device 100 is detected through the low-power first detection signal, if the table look-up method is used, in the distance-projection frequency correspondence relationship, the projection corresponding to the detected distance is found If there are multiple frequencies, one projection frequency can be selected as the projection frequency of the second detection signal.

It should be noted that, in an example, the first power of the first detection signal may be equal to the second power of the second detection signal, but the projection frequency of the first detection signal may be less than the projection frequency of the second detection signal. On the one hand, because the projection frequency of the first detection signal used to detect the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, because it is used to obtain the depth information image The second detection signal has a higher projection frequency, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

In an example, the projection frequency of the first detection signal may be equal to the projection frequency of the second detection signal, but the first power of the first detection signal is less than the second power of the second detection signal. On the one hand, because the power of the first detection signal used to detect the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, due to the low power used to obtain the depth information image The power of the second detection signal is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

In another example, the first power of the first detection signal is less than the second power of the second detection signal, and the projection frequency of the first detection signal is also less than the projection frequency of the second detection signal. On the one hand, since the energy (including power and projection frequency) of the first detection signal used to detect the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, due to the use of The energy (including power and projection frequency) of the second detection signal used to obtain the depth information image is larger, and the depth image information of the object to be detected is also more detailed, thereby improving the accuracy of the depth information image.

Referring to FIG. 5, in some embodiments, the control method further includes:

02: Obtain the two-dimensional image information of the object to be detected; and

03: When there is a human face in the two-dimensional image message, the depth image acquisition module 30 is activated.

Please refer to FIG. 1, FIG. 2 and FIG. 5, the electronic device 100 further includes a camera module 40. The photographing module 40 is accommodated in the accommodating cavity formed by the display screen 10 and the housing 20. The camera module 40 may be a visible light camera or an infrared light camera. When the photographing module 40 is a visible light camera, the two-dimensional image information of the object to be inspected by the photographing module 40 is an RGB image; when the photographing module 40 is an infrared light camera, the photographing module 40 acquires the object to be inspected The two-dimensional image of is an infrared image. In the embodiment of the present application, the camera module 40 is a visible light camera.

Understandably, when the depth image acquisition module 30 provided under the display screen 10 is used for face unlocking, the depth image acquisition module 30 needs to be turned on to acquire the human face only when it is recognized that there is a human face in the two-dimensional message. The depth message image of the face is unlocked; if there is no face in the two-dimensional message, it is not required. Since the camera module 40 is first used to determine whether the object to be inspected contains a human face, the depth image acquisition module 30 is turned on when there is a human face, which greatly reduces the number of times the detection signal emitted by the transmitter 31 passes through the display screen 10. The screen flicker is reduced, and the damage to the display screen 10 caused by the detection signal emitted by the transmitter 31 is reduced, and the life of the display screen 10 is increased.

It should be noted that turning on the depth image acquisition module 30 does not mean that the transmitter 31 is immediately driven to transmit the detection signal, but when a human face is detected in the two-dimensional image information of the object to be detected, the depth image acquisition module The group 30 has been powered on, and the transmitter 31 is ready to emit light. Only when the display screen 10 displays an image for the first time, the transmitter 31 officially emits a detection signal to the outside of the display screen 10.

Referring to FIG. 5, in some embodiments, the control method further includes:

04: Compare the depth information image with the preset depth image;

05: Unlock the electronic device 100 when the similarity between the depth information image and the preset image is greater than a predetermined value.

Please refer to FIG. 2 and FIG. 5, the electronic device 100 further includes a processor 50. Both step 04 and step 05 can be executed by the processor 50. In other words, the processor 50 is used to compare the depth information image with the preset depth image, and unlock the electronic device 100 when the similarity between the depth information image and the preset image is greater than a predetermined value.

Specifically, the obtained depth information image and the preset depth image are respectively subjected to facial feature extraction to obtain a first feature image corresponding to the preset depth image and a second feature image corresponding to the depth information image Like; classify each feature in the first feature image and each feature in the second feature image, and perform vectorized representations respectively. After obtaining the feature vector in the first feature image corresponding to the preset depth image and the feature vector of the second feature image corresponding to the depth information image, calculate each of the first feature images The gap between the feature vector of the category and the feature vector of the corresponding category in the second feature image. For example, select the feature vector representing the width of the eyes in the first feature image and the feature vector representing the width of the eyes in the second feature image, and calculate the difference between the two vectors; or select the first feature image to represent the height of the bridge of the nose Calculate the difference between the feature vector of and the feature vector representing the height of the nose bridge in the second feature image.

。用計算獲得的L值表示深度訊息圖像中人臉與預設深度圖像中人臉的相似度，計算的歐氏距離值越小表示綜合差距越小，即該深度訊息圖像中的人臉與預設深度圖像中人臉越相似，即相似度越高。當深度訊息圖像中的人臉與預設深度圖像中的人臉之間的相似度大於預定值時，即可認為此時使用電子設備100的使用者是該電子設備100的授權使用者，則可解鎖電子設備100。According to multiple gaps corresponding to multiple categories, the comprehensive gap between the depth information image and the preset depth image is calculated, and the comprehensive gap is used to express the similarity. In some embodiments, the Euclidean distance can be used to calculate the comprehensive gap and the Euclidean distance value is used to represent the similarity. For example, the category of the feature vector includes eyes, nose, mouth, and ears, and the first feature image represents the features of the eyes The vector is A, the feature vector representing the eyes in the second feature image is A0; the feature vector representing the nose in the first feature image is B, the feature vector representing the nose in the second feature image is B0; the first feature image The feature vector representing the mouth in the image is C, the feature vector representing the mouth in the second feature image is C0; the feature vector representing the ears in the first feature image is D, and the feature vector representing the ears in the second feature image is D0 , Then calculate the comprehensive gap L based on the Euclidean distance as the arithmetic square root of the sum of the squares of the difference between the feature vectors of the same category on the first feature image and the second feature image, that is, expressed by the mathematical formula:

. The calculated L value is used to indicate the similarity between the face in the depth information image and the face in the preset depth image. The smaller the calculated Euclidean distance value, the smaller the comprehensive gap, that is, the person in the depth information image The more similar the face is to the human face in the preset depth image, the higher the similarity. When the similarity between the face in the depth information image and the face in the preset depth image is greater than a predetermined value, it can be considered that the user using the electronic device 100 at this time is an authorized user of the electronic device 100 , Then the electronic device 100 can be unlocked.

Please refer to FIG. 8 together. The present application also provides a computer-readable storage medium 200 on which a computer program 210 is stored. When the program is executed by the processor 50, the steps of the control method of any one of the above embodiments are implemented.

For example, referring to FIGS. 6 and 8, when the program is executed by the processor 50, the steps of the following control method are implemented:

011: Transmit a first detection signal to the object to be detected with the first power;

012: Receive the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; obtain the second power from the pre-stored distance-power correspondence according to the distance;

013: Transmit a second detection signal at the second power to the object to be detected;

014: Receive the second detection signal reflected by the object to be detected after passing through the display screen to obtain the depth information image of the object to be detected.

For another example, please refer to FIG. 2 and FIG. 8. When the program is executed by the processor 50, the steps of the following control method are implemented:

02: Obtain the two-dimensional image information of the object to be detected; and

03: When there is a human face in the two-dimensional image message, the depth image acquisition module 30 is activated.

The computer-readable storage medium 200 can be set in the electronic device 100 or in a cloud server. At this time, the electronic device 100 can communicate with the cloud server to obtain the corresponding computer program 210.

It can be understood that the computer program 210 includes computer program code. The computer program code can be in the form of source code, object code, executable file, or some intermediate forms, etc. Computer-readable storage media can include: any entity or device capable of carrying computer program codes, recording media, flash drives, mobile hard drives, magnetic disks, optical discs, computer memory, read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), and software distribution media, etc.

The processor 50 may refer to a driver board. The drive board can be a central processing unit (Central Processing Unit, CPU), other general-purpose processors 50, digital signal processors 230 (Digital Signal Processor, DSP), dedicated integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.

In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "examples", "specific examples" or "some examples" etc. means to combine the described implementations The specific features, structures, materials, or characteristics described in the manners or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above-mentioned terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.

Any process or method description described in the flowchart or described in other ways herein can be understood as a module, segment, or code that includes one or more executable instructions for implementing specific logical functions or steps of the process. Part, and the scope of the preferred embodiments of the present application includes additional implementations, which may not be in the order shown or discussed, including the functions involved in a substantially simultaneous manner or in the reverse order according to the functions involved, which It should be understood by those skilled in the art to which the embodiments of the present application belong.

Although the embodiments of this application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the application. Those of ordinary skill in the art can comment on the above within the scope of this application. The implementation mode is subject to change, modification, replacement and modification.

10: Display screen 11: The first substrate 12: Connection layer 13: Second substrate 133: Through hole 20: shell 21: First side 22: second side 23: Containment Space 30: Depth image acquisition module 31: Launcher 32: receiver 40: Photography module 50: processor 100: electronic equipment 200: Computer readable storage medium 210: computer program T0~T2: time 01~05: Step 011~016: Steps

The above-mentioned and/or additional aspects and advantages of the present application will become obvious and easy to understand from the description of the embodiments in conjunction with the following drawings, in which:

FIG. 1 is a schematic diagram of a three-dimensional structure of an electronic device according to some embodiments of the present application;

Fig. 2 is an exploded schematic diagram of an electronic device according to some embodiments of the present application;

3 is a schematic partial cross-sectional view of the electronic device of FIG. 2 along the line III-III;

4 is a schematic diagram of the refresh frequency of the display screen and the emission frequency of the detection signal emitted by the transmitter according to some embodiments of the present application;

FIG. 5 is a schematic flowchart of a control method of some embodiments of the present application;

FIG. 6 is a schematic flowchart of a control method of some embodiments of the present application;

FIG. 7 is a schematic flowchart of a control method of certain embodiments of the present application;

FIG. 8 is a schematic diagram of interaction between a computer-readable storage medium and a processor in some embodiments of the present application.

01~05: Step

Claims (12)

A control method for an electronic device, the electronic device comprising a depth image acquisition module, a housing and a display screen, the depth image acquisition module being arranged in the housing and located below the display screen, The depth image acquisition module includes a transmitter and a receiver; the control method includes: While the display screen is refreshing, the transmitter transmits a detection signal toward the display screen, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain all The depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter. The control method according to claim 1, wherein the transmitter transmits a detection signal toward the display screen while the display screen is being refreshed, and the receiver receives the detection signal after passing through the display screen. The detection signal reflected by the object to be detected to obtain the depth information image of the object to be detected includes: Transmitting a first detection signal to the object to be detected with a first power; Receiving the first detection signal that is reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic device; according to the distance from a pre-stored distance-power correspondence To obtain the second power; Transmitting the second detection signal to the object to be detected with a second power; The second detection signal reflected by the object to be detected after passing through the display screen is received to obtain a depth information image of the object to be detected. According to the control method according to claim 2, the control method includes: While transmitting the first detection signal, the display screen displays an image at a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency; While transmitting the second detection signal, the display screen displays an image at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is less than the first refresh frequency. 2. Refresh frequency. According to the control method according to claim 2 or 3, the control method includes: Acquiring the two-dimensional image information of the object to be detected; and When there is a human face in the two-dimensional image message, the depth image acquisition module is activated. According to the control method according to claim 4, the control method includes: Comparing the depth information image with a preset depth image; When the similarity between the depth information image and the preset image is greater than a predetermined value, unlock the electronic device. An electronic device, the electronic device comprising: case; A display screen, the display screen being arranged on the housing; and A depth image acquisition module, the depth image acquisition module is arranged in the housing and located below the display screen, the depth image acquisition module includes a transmitter and a receiver; on the display screen While displaying the image, the transmitter transmits a detection signal toward the display screen, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen to obtain the object to be detected The depth information image; wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter. The electronic device according to claim 6, wherein: The transmitter is used to transmit a first detection signal to the object to be detected with a first power; The receiver is configured to receive the first detection signal reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic device; The transmitter is further configured to transmit the second detection signal toward the object to be detected at a second power, where the second power is obtained from a pre-stored distance-power correspondence relationship according to the distance; The receiver receives the second detection signal reflected by the object to be detected after passing through the display screen to obtain a depth information image of the object to be detected. According to the electronic equipment shown in claim 7, in which, While the transmitter transmits the first detection signal, the display screen displays an image at a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency; While the transmitter transmits the second detection signal, the display screen displays an image at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first The refresh frequency is less than the second refresh frequency. The electronic device according to claim 7 or 8, the electronic device further comprising: A photographing module, which is used to obtain two-dimensional image information of an object to be inspected; wherein: When there is a human face in the two-dimensional image message, the depth image acquisition module is activated. The electronic device according to claim 9, the electronic device further comprising: A processor, the processor is used to compare the depth information image with a preset depth image; wherein: When the similarity between the depth information image and the preset image is greater than a predetermined value, the electronic device is unlocked. The electronic device according to claim 6, wherein the display screen includes: First substrate A second substrate, the second substrate is disposed on one side of the first substrate, the second substrate is provided with at least one through hole, and the depth image acquisition module is disposed in the through hole; and The connection layer is used to connect the first substrate and the second substrate, and the difference between the refractive index of the connection layer and the refractive index of the air in the through hole is within a predetermined range. A non-volatile computer-readable storage medium containing a computer program. When the computer program is executed by a processor, the processor executes the control method described in any one of request items 1 to 5.

Images