CN111461069B - Control method, electronic device, and computer-readable storage medium - Google Patents
Control method, electronic device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN111461069B CN111461069B CN202010353593.5A CN202010353593A CN111461069B CN 111461069 B CN111461069 B CN 111461069B CN 202010353593 A CN202010353593 A CN 202010353593A CN 111461069 B CN111461069 B CN 111461069B
- Authority
- CN
- China
- Prior art keywords
- display screen
- detection signal
- detected
- frequency
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application discloses a control method, an electronic device and a computer readable storage medium. The electronic equipment comprises a depth image acquisition module, a shell and a display screen, wherein the depth image acquisition module is arranged in the shell and positioned below the display screen, and the depth image acquisition module comprises a transmitter and a receiver. The control method comprises the following steps: the method comprises the steps that when a display screen is refreshed, a transmitter transmits a detection signal to the direction of the display screen, and a receiver receives the detection signal reflected by an object to be detected after passing through the display screen, so that a depth information image of the object to be detected is obtained; wherein the refresh frequency of the display screen is the same as the projection frequency of the transmitter. According to the depth image display device, the frequency of the emission detection signal of the depth image acquisition module is kept synchronous with the refreshing frequency of the display screen, the emission detection signal of the emitter in the depth image acquisition module is driven while the display screen displays images, and obvious flicker of the display screen and the corresponding area of the depth image acquisition module is avoided, so that user experience is improved.
Description
Technical Field
The present disclosure relates to the field of imaging technologies, and in particular, to a control method, an electronic device, and a computer readable storage medium.
Background
Along with the increasing requirements of the market on the large screen ratio of the mobile phone, each mobile phone manufacturer tries to place each electronic component, such as a camera, below the screen, so that the photographing effect is not affected, and normal display can be realized. In addition, due to the prevalence of 3D unlocking, more and more manufacturers of mobile phones begin to consider that a depth camera for 3D unlocking is placed below a screen, however, due to the fact that the depth camera needs to actively emit light, the actively emitted light can cause obvious flicker in a corresponding area of a display screen, and user experience is seriously affected.
Disclosure of Invention
The embodiment of the application provides a control method, electronic equipment and a non-volatile computer readable storage medium.
The application provides a control method. The control method is used for the electronic equipment, and the electronic equipment comprises a depth image acquisition module, a shell and a display screen. The depth image acquisition module is arranged in the shell and positioned below the display screen, and comprises a transmitter and a receiver. The control method comprises the following steps: and when the display screen is refreshed, the transmitter transmits a detection signal to the direction of the display screen, and the receiver receives the detection signal which passes through the display screen and is reflected by the object to be detected, so as to obtain a depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.
The application provides an electronic device. The electronic equipment comprises a shell, a display screen and a depth image acquisition module. The display screen is arranged on the shell. The depth image acquisition module is arranged in the shell and positioned below the display screen, and comprises a transmitter and a receiver. And the transmitter transmits a detection signal to the direction of the display screen while the display screen displays the image, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen so as to obtain a depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the transmitter.
The present application provides a non-transitory computer readable storage medium. The non-transitory computer readable storage medium contains a computer program which, when executed by a processor, causes the processor to perform: the transmitter transmits a detection signal to the direction of the display screen while the display screen is refreshed, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen so as to obtain a depth information image of the object to be detected; the refresh frequency of the display screen is the same as the projection frequency of the transmitter.
According to the control method, the electronic equipment and the nonvolatile computer readable storage medium, the frequency of transmitting the detection signal by the depth image acquisition module is set to be synchronous with the refreshing frequency of the display screen, the display screen displays images, and meanwhile, the transmitter in the depth image acquisition module is driven to transmit the detection signal, so that obvious flicker of the display screen and the region corresponding to the depth image acquisition module is avoided, and therefore user experience is improved.
Additional aspects and advantages of embodiments of the application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
FIG. 1 is a schematic perspective view of an electronic device according to certain embodiments of the present application;
FIG. 2 is an exploded schematic view of an electronic device of some embodiments of the present application;
FIG. 3 is a schematic partial cross-sectional view of the electronic device of FIG. 2 along line III-III;
FIG. 4 is a schematic diagram of refresh frequencies of a display screen and emission frequencies of an emitter emission detection signal according to certain embodiments of the present application;
FIG. 5 is a flow chart of a control method of certain embodiments of the present application;
FIG. 6 is a flow chart of a control method of certain embodiments of the present application;
FIG. 7 is a flow chart of a control method of certain embodiments of the present application;
FIG. 8 is a schematic diagram of interactions of a computer-readable storage medium with a processor of some embodiments of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for explaining the embodiments of the present application and are not to be construed as limiting the embodiments of the present application.
Referring to fig. 1, 2 and 5, the present application provides a control method for an electronic device 100. The electronic device 100 comprises a depth image acquisition module 30, a shell 20 and a display screen 10, wherein the depth image acquisition module 30 is arranged in the shell 20 and is positioned below the display screen 10, and the depth image acquisition module 30 comprises a transmitter 31 and a receiver 32; the control method comprises the following steps:
01: while the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10, so as to obtain a depth information image of the object to be detected; wherein the refresh frequency of the display screen 10 is the same as the projection frequency of the transmitter 31.
It should be noted that, after the display screen 10 is turned on and displays a picture, the display screen 10 will be refreshed at a certain refresh frequency, and the refresh process is a process of alternately repeating the display image, the non-display image, the display image and the non-display image, and since the time of the display screen 10 not displaying the image in the refresh process is very short and negligible, the display screen 10 is continuously displaying the image after being turned on in the view of the user.
Referring to fig. 1 and 2, the present application further provides an electronic device 100. The control method of the embodiment of the present application may be implemented by the electronic device 100 of the embodiment of the present application. The electronic device 100 includes a display 10, a housing 20, and a depth image acquisition module 30. The display screen 10 is arranged on the shell 20, the depth image acquisition module 30 is arranged in the shell 20 and positioned below the display screen 10, and the depth image acquisition module 30 comprises a transmitter 31 and a receiver 32; while the display screen 10 displays an image, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected back by the object to be detected after passing through the display screen 10 to obtain a depth information image of the object to be detected, and the refresh frequency of the display screen 10 is the same as the projection frequency of the transmitter 31.
It should be noted that, the electronic device 100 may be a mobile phone, a tablet computer, a notebook computer, a smart bracelet, a smart watch, a smart glasses, and the like. The present application describes an electronic device 100 as a mobile phone.
Specifically, referring to fig. 1, 2 and 3, the housing 20 includes a first surface 21 and a second surface 22 disposed opposite to each other. The display screen 10 includes a first substrate 11 and a second substrate 13, the second substrate 13 is disposed on one side of the first substrate 11, and at least one through hole 133 is formed in the second substrate 13. The display screen 10 is disposed on the first surface 21 of the housing 20, and the display screen 10 and the housing 20 form an accommodating space 23.
The depth image acquiring module 30 is disposed in the housing 20 and located below the display screen 10, that is, the depth image acquiring module 30 is accommodated in the accommodating space 23 formed by the display screen 10 and the housing 20. The depth image acquiring module 30 includes a transmitter 31 and a receiver 32, and when the number of through holes 133 is one, the transmitter 31 and the receiver 32 are both accommodated in the through holes 133. When the number of through holes 133 is two, the transmitter 31 and the receiver 32 are respectively accommodated in the two through holes 133.
While the display screen 10 displays an image, that is, while the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected back by the object to be detected after passing through the display screen 10 to obtain a depth information image of the object to be detected. Fig. 4 is a schematic diagram illustrating a refresh frequency of the display screen 10 and a transmission frequency of the detection signal transmitted by the transmitter 31. As shown in fig. 4, at time T0, the display screen 10 does not display an image, and the transmitter 31 does not transmit a detection signal; at time T1, the display screen 10 starts displaying an image, and the transmitter 31 starts transmitting a detection signal; at time T2, the display screen 10 ends displaying the image, and the transmitter 31 ends transmitting the detection signal. Since the transmitter 31 in the depth image acquisition module 30 is driven to transmit the detection signal while the display screen 10 is refreshed (the display screen 10 displays the image), the display screen 10 is prevented from flickering obviously in the region corresponding to the depth image acquisition module 30, and thus the user experience is improved.
In some embodiments, the display screen 10 further includes a connection layer 12. The connection layer 12 is for connecting the first substrate 11 and the second substrate 13, and the refractive index of the connection layer 12 is almost close to that of the air in the through hole 133, and the difference therebetween is within a predetermined range (small range). For example, assuming that the predetermined range is (-0.5, 0.5), the difference between the refractive index of the connection layer 12 and the refractive index of air may be: -0.49, -0.2, -0.1, -0.23, 0, 0.11, 0.2, 0.33, 0.45, etc. Since the difference between the refractive index of the connection layer 12 and the refractive index of the air in the through hole 133 is within the predetermined range, the amount of light reflected by the light inside the display screen 10 toward the inside of the display screen 10 in the area where the through hole 133 is not opened is the same as the amount of light reflected by the light toward the inside of the display screen 10 in the area where the through hole 133 is opened, thereby avoiding the phenomenon that the display screen 10 is inconsistent with the display in other areas in the area where the depth image acquisition module 30 is provided, and further reducing the obvious flicker phenomenon.
Referring to fig. 6, step 01: while the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the direction of the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10, so as to obtain a depth information image of the object to be detected, which includes:
011: transmitting a first detection signal towards the object to be detected at a first power;
012: receiving a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic equipment 100;
013: transmitting a second detection signal to the object to be detected with a second power, wherein the second power is obtained from a pre-stored distance-power corresponding relation according to the distance;
014: the second detection signal reflected by the object to be detected after passing through the display screen 10 is received to acquire a depth information image of the object to be detected.
Specifically, referring to fig. 2 and 6, the depth image acquisition module 30 includes a transmitter 31 and a receiver 32. The transmitter 31 is configured to transmit a first detection signal toward the object to be detected at a first power; the receiver 32 is configured to receive a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a distance between the object to be detected and the electronic device 100; the depth image obtaining module 30 is further configured to obtain a second power from a pre-stored distance-power correspondence according to the distance; the transmitter 31 is further configured to transmit a second detection signal toward the object to be detected at a second power; the receiver 32 is further configured to receive a second detection signal reflected back by the object to be detected after passing through the display screen, so as to acquire a depth information image of the object to be detected.
It should be noted that, the memory (not shown) in the depth image acquiring module 30 stores a distance-power correspondence in advance, where the distance-power correspondence characterizes the optimal power (second power) required for the depth image acquiring module 30 to transmit the second detection signal when the object to be detected and the electronic device 100 are at different distances. Where the distance is positively correlated with power, i.e. the farther the distance, the more power the transmitter 31. The distance-power correspondence may be set by a manufacturer when the electronic device 100 leaves the factory, and is fixed, and can not be changed when the user uses the electronic device, and can be changed at will. The distance-power correspondence relationship may be set by the user himself, and is not limited thereto.
For example, assume that the distance-power correspondence relation records that the magnitude of the optimal power corresponding to the first distance is a first preset value; the size of the optimal power corresponding to the second distance is a second preset value, wherein the first distance is smaller than the second distance, and the first preset value is smaller than the second preset value. When the depth image acquiring module 30 acquires that the distance between the object 100 to be detected and the electronic device 100 is a first distance, according to the first preset value of the optimal power corresponding to the first distance in the distance-power corresponding relation, the transmitter 31 in the depth image acquiring module 30 transmits a second detection signal with the power as the first preset value; when the depth image acquiring module 30 acquires that the distance between the object 100 to be detected and the electronic device 100 is the second distance, the transmitter 31 in the depth image acquiring module 30 transmits a second detection signal with the power level as a second preset value according to the second optimal rate corresponding to the second distance in the distance-power correspondence.
In one example, the first power is less than the second power. The depth image acquiring module 30 firstly transmits a first detection signal with low power (first power) to determine the distance between the object to be detected and the electronic device 100, and then selects the size of the optimal power (second power) corresponding to the distance between the object to be detected and the electronic device 100 to transmit a second detection signal according to the distance between the object to be detected and the electronic device 100, so as to obtain the depth information image. On the one hand, the depth image acquisition module 30 is prevented from emitting high-power detection signals for a long time and enabling the signals to pass through the display screen 10, so that the damage to the display screen 10 caused by the detection signals emitted by the emitter 31 can be reduced, and the service life of the display screen 10 is prolonged. On the other hand, when the depth image acquiring module 30 disposed below the display screen 10 is used for face recognition, the second power of the second detection signal is adjusted according to the distance between the object to be detected (face) and the electronic device 100, and when the actual distance is greater than the test distance corresponding to the low power, the second power can be adjusted to be greater than the first power, so that the depth image acquiring module 30 can be prevented from emitting the high-power detection signal for a long time and enabling the signal to penetrate through the display screen 10 to reach the eyes, thereby protecting the eyes and ensuring the safety of the eyes. When the actual distance is smaller than the test distance corresponding to the low power, the second power can be adjusted to be smaller than the first power, so that the depth image acquisition module 30 can be prevented from emitting a high-power detection signal for a long time and enabling the signal to penetrate through the display screen 10 to reach the human eyes, thereby protecting the human eyes and ensuring the safety of the human eyes.
It should be noted that, when the distance between the object to be detected and the electronic device 100 is very close, the second power may be equal to the first power.
Referring to fig. 7, the control method further includes:
015: the display screen 10 displays an image at a first refresh frequency while transmitting a first detection signal, the first detection signal having the same projection frequency as the first refresh frequency; a kind of electronic device with high-pressure air-conditioning system
016: the display screen 10 displays an image at a second refresh frequency while emitting a second detection signal, the second detection signal having a projection frequency identical to the second refresh frequency, the first refresh frequency being less than the second refresh frequency.
Referring to fig. 2 and 7, the transmitter 31 transmits a first detection signal and simultaneously displays images on the display screen 10 at a first refresh frequency, wherein the projection frequency of the first detection signal is the same as the first refresh frequency; the transmitter 31 transmits the second detection signal and simultaneously displays the image on the display screen 10 at the second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is smaller than the second refresh frequency.
In some embodiments, the transmitter 31 transmits a first detection signal at a first power toward the object to be detected while the display screen 10 displays images at a first refresh frequency, the first detection signal being projected at the same frequency as the first refresh frequency. The receiver 32 receives the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the processor 50 of the electronic device 100 is further configured to obtain the second power from a pre-stored distance-power correspondence based on the distance. The transmitter 31 then transmits a second detection signal at a second power, while the display screen 10 displays images at a second refresh frequency, the second detection signal having the same projection frequency as the second refresh frequency. And the first refresh frequency is less than the second refresh frequency, that is, the projection frequency of the first detection signal is less than the projection frequency of the second detection signal. On the one hand, since the projection frequency of the first detection signal for detecting the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, since the projection frequency of the second detection signal for acquiring the depth information image is large, the depth image information of the object to be detected is also acquired in more detail, thereby improving the accuracy of the depth information image.
In other embodiments, the memory (not shown) in the electronic device 100 also stores a distance-projecting frequency correspondence in advance, where the distance-projecting frequency correspondence characterizes the optimal projecting frequency that needs to be used by the depth image acquisition module 30 corresponding to the object to be detected to transmit the second detection signal under different distances from the electronic device 100. Wherein the distance is also positively correlated with the projected frequency, i.e. the farther the distance, the greater the projected frequency of the emitter 31. The distance-projection frequency correspondence may be set by a manufacturer when the electronic device 100 leaves the factory, and is fixed, and cannot be changed when the user uses the electronic device. The distance-projection frequency correspondence relationship may be set by the user himself or herself, and may be arbitrarily changed, and is not limited thereto.
The transmitter 31 may select a second detection signal having a corresponding projection frequency and a corresponding power according to a distance between the object to be detected and the electronic device 100. The farther the distance between the object to be detected and the electronic device 100, the larger the projection frequency of the second detection signal. The display screen 10 has a second refresh frequency while the second detection signal is projected, and the second refresh frequency is the same as the projection frequency of the second detection signal. That is, the farther the distance between the object to be detected and the electronic device 100, the greater the refresh frequency of the display screen 10 at the time of transmitting the second detection signal. Specifically, the transmitter 31 transmits a first detection signal with a first power toward the object to be detected, while the display screen 10 displays an image with a first refresh frequency, and the projection frequency of the first detection signal is the same as the first refresh frequency. The receiver 32 receives the first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the depth image obtaining module 30 is further configured to obtain the magnitude of the second power from a pre-stored distance-power correspondence according to the distance, and obtain the magnitude of the projection frequency of the second detection signal from the pre-stored distance-frequency correspondence according to the distance. The transmitter 31 transmits a second detection signal according to the acquired magnitude of the second power and the magnitude of the projection frequency, and simultaneously the display screen 10 displays an image at a second refresh frequency, which is the same as the projection frequency of the second detection signal.
In some embodiments, in the distance-power correspondence, a distance value may correspond to a power value, a distance value may correspond to a power range, a distance range may correspond to a power value, or a distance range may correspond to a power range. After detecting the distance between the object to be detected and the electronic device 100 by the first detection signal with low power, if the power corresponding to the detected distance is found to be plural in the distance-power correspondence by the table look-up method, then one power may be selected as the second power of the second detection signal. Similarly, in the distance-projection frequency correspondence relationship, one distance value may correspond to one projection frequency value, one distance value may correspond to one projection frequency range, one distance range may correspond to one projection frequency value, or one distance range may correspond to one projection frequency range. After detecting the distance between the object to be detected and the electronic device 100 by the first detection signal with low power, if a plurality of projection frequencies corresponding to the detected distance are found out in the distance-projection frequency correspondence by the table look-up method, one projection frequency may be selected as the projection frequency of the second detection signal.
It should be noted that, in one example, the first power of the first detection signal may be equal to the second power of the second detection signal, but the projection frequency of the first detection signal may be smaller than the projection frequency of the second detection signal. On the one hand, since the projection frequency of the first detection signal for detecting the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, since the projection frequency of the second detection signal for acquiring the depth information image is large, the depth image information of the object to be detected is also acquired in more detail, thereby improving the accuracy of the depth information image.
In one example, the projected frequency of the first detection signal may be equal to the projected frequency of the second detection signal, but the first power of the first detection signal is less than the second power of the second detection signal. On the one hand, since the power of the first detection signal for detecting the distance is smaller, the damage energy to the display screen 10 is weaker, thereby prolonging the service life of the display screen 10; on the other hand, since the power of the second detection signal for acquiring the depth information image is larger, the depth image information of the object to be detected is acquired in more detail, thereby improving the accuracy of the depth information image.
In yet another example, the first power of the first detection signal is less than the second power of the second detection signal, and the projected frequency of the first detection signal is also less than the projected frequency of the second detection signal. On the one hand, since the energy (including power and projection frequency) of the first detection signal for detecting the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, since the energy (including power and projection frequency) of the second detection signal for acquiring the depth information image is large, the depth image information of the object to be detected is acquired in more detail, thereby improving the accuracy of the depth information image.
Referring to fig. 5, in some embodiments, the control method further includes:
02: acquiring two-dimensional image information of an object to be detected; a kind of electronic device with high-pressure air-conditioning system
03: when a face exists in the two-dimensional image information, the depth image acquisition module 30 is started.
Referring to fig. 1, 2 and 5, the electronic device 100 further includes a camera module 40. The camera module 40 is accommodated in an accommodating cavity formed by the display screen 10 and the shell 20. The camera module 40 may be a visible light camera or an infrared light camera. When the camera module 40 is a visible light camera, the camera module 40 acquires two-dimensional image information of the object to be detected as an RGB image; when the camera module 40 is an infrared camera, the camera module 40 obtains that the two-dimensional image of the object to be detected is an infrared image. In the embodiment of the present application, the camera module 40 is a visible light camera.
As can be appreciated, when the depth image acquisition module 30 disposed under the display screen 10 is used for face unlocking, only if the face is identified to exist in the two-dimensional information, the depth image acquisition module 30 needs to be started to acquire the depth information image of the face for unlocking; if no face exists in the two-dimensional information, the face is not needed. Because the camera module 40 is used to determine whether the object to be detected contains a human face, the depth image acquisition module 30 is started only when the human face exists, the frequency of the detection signal transmitted by the transmitter 31 passing through the display screen 10 is greatly reduced, so that the screen flash is reduced, the damage to the display screen 10 caused by the detection signal transmitted by the transmitter 31 is reduced, and the service life of the display screen 10 is prolonged.
It should be noted that, when the depth image acquiring module 30 is turned on, the transmitter 31 is not immediately driven to transmit the detection signal, but after detecting that the face exists in the two-dimensional image information of the object to be detected, the depth image acquiring module 30 is powered on, the transmitter 31 is ready to transmit light, and only when the display screen 10 displays the image for the first time, the transmitter 31 formally transmits the detection signal to the outside of the display screen 10.
Referring to fig. 5, in some embodiments, the control method further includes:
04: comparing the depth information image with a preset depth image;
05: when the similarity between the depth information image and the preset depth image is greater than a predetermined value, the electronic device 100 is unlocked.
Referring to fig. 2 and 5, the electronic device 100 further includes a processor 50. Step 04 and step 05 may both be performed by the processor 50. That is, the processor 50 is configured to compare the depth information image with the preset depth image, and unlock the electronic device 100 when the similarity between the depth information image and the preset depth image is greater than a predetermined value.
Specifically, extracting facial features of the obtained depth information image and a preset depth image respectively to obtain a first feature image corresponding to the preset depth image and a second feature image corresponding to the depth information image; and classifying each feature in the first feature image and each feature in the second feature image, and respectively carrying out vectorization representation. After the feature vector in the first feature image corresponding to the preset depth image and the feature vector in the second feature image corresponding to the to-be-depth information image are obtained, the difference between the feature vector of each category in each first feature image and the feature vector of the corresponding category in the second feature image is calculated. For example, selecting a feature vector representing the width of the eye in the first feature image and a feature vector representing the width of the eye in the second feature image, and calculating the difference between the two vectors; or selecting a characteristic vector representing the height of the nose girder in the first characteristic image and a characteristic vector representing the height of the nose girder in the second characteristic image, and calculating the difference between the two vectors.
And calculating the comprehensive gap between the depth information image and the preset depth image according to a plurality of gaps corresponding to a plurality of categories, and representing the similarity by using the comprehensive gap. In some embodiments, the euclidean distance may be used to calculate the composite gap and the similarity may be represented by a euclidean distance value, e.g. the classes of feature vectors include eyes, nose, mouth, ears, and the feature vector representing an eye in the first feature image is a, and the feature vector representing an eye in the second feature image is A0; the characteristic vector representing the nose in the first characteristic image is B, and the characteristic vector representing the nose in the second characteristic image is B0; the feature vector representing the mouth in the first feature image is C, and the feature vector representing the mouth in the second feature image is C0; the first characteristic image represents the characteristic vector of the ear as D and the second characteristicIf the feature vector in the syndrome image representing the ear is D0, the comprehensive difference L is calculated according to the euclidean distance, and is the arithmetic square root of the sum of squares of the difference values between the feature vectors of the same category on the first feature image and the second feature image, namely, the sum of squares is expressed as follows by using a mathematical formula:
the L value obtained by calculation represents the similarity between the face in the depth information image and the face in the preset depth image, and the smaller the calculated Euclidean distance value is, the smaller the comprehensive gap is, namely the more similar the face in the depth information image is to the face in the preset depth image, namely the higher the similarity is. When the similarity between the face in the depth information image and the face in the preset depth image is greater than a predetermined value, the user using the electronic device 100 at this time can be considered as an authorized user of the electronic device 100, and the electronic device 100 can be unlocked.
Referring to fig. 8, the present application further provides a computer readable storage medium 200 having a computer program 210 stored thereon, where the program, when executed by the processor 50, implements the steps of the control method according to any of the above embodiments.
For example, referring to fig. 6 and 8, when the program is executed by the processor 50, the following steps of the control method are implemented:
011: transmitting a first detection signal towards the object to be detected at a first power;
012: receiving a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic equipment 100; acquiring second power from a pre-stored distance-power corresponding relation according to the distance;
013: transmitting a second detection signal towards the object to be detected with a second power;
014: and receiving a second detection signal reflected by the object to be detected after passing through the display screen so as to acquire a depth information image of the object to be detected.
For another example, referring to fig. 2 and 8, when the program is executed by the processor 50, the following control method steps are implemented:
02: acquiring two-dimensional image information of an object to be detected; a kind of electronic device with high-pressure air-conditioning system
03: when a face exists in the two-dimensional image information, the depth image acquisition module 30 is started.
The computer readable storage medium 200 may be disposed in the electronic device 200 or in a cloud server, where the electronic device 200 may communicate with the cloud server to obtain the corresponding computer program 210.
It is understood that the computer program 210 comprises computer program code. The computer program code may be in the form of source code, object code, executable files, or in some intermediate form, among others. The computer readable storage medium may include: any entity or device capable of carrying computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a software distribution medium, and so forth.
The processor 50 may be referred to as a drive board. The drive board may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processor 50, digital signal processor 230 (Digital Signal Processor, DSP), application specific integrated circuit (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like.
In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, the different embodiments or examples described in this specification and the features of the different embodiments or examples may be combined and combined by those skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and further implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the embodiments of the present application.
While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are illustrative and not to be construed as limiting the present application, and that variations, modifications, alternatives, and variations may be made to the above embodiments by one of ordinary skill in the art within the scope of the present application.
Claims (8)
1. The control method for the electronic equipment is characterized by comprising a depth image acquisition module, a shell and a display screen, wherein the depth image acquisition module is arranged in the shell and positioned below the display screen, and the depth image acquisition module comprises a transmitter and a receiver; the control method comprises the following steps:
the transmitter transmits a detection signal to the direction of the display screen while the display screen is refreshed, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen so as to obtain a depth information image of the object to be detected; the refreshing frequency of the display screen is the same as the projection frequency of the transmitter;
the transmitter transmits a detection signal to the direction of the display screen while the display screen is refreshed, and the receiver receives the detection signal reflected back by the object to be detected after passing through the display screen to obtain a depth information image of the object to be detected, and the method comprises the following steps:
transmitting a first detection signal towards the object to be detected at a first power;
receiving the first detection signal reflected by the object to be detected after passing through the display screen to obtain the distance between the object to be detected and the electronic equipment; acquiring second power from a pre-stored distance-power corresponding relation according to the distance;
transmitting a second detection signal towards the object to be detected at a second power;
receiving the second detection signal reflected by the object to be detected after passing through the display screen to acquire a depth information image of the object to be detected;
the control method comprises the following steps:
the display screen displays images at a first refresh frequency while transmitting the first detection signal, wherein the projection frequency of the first detection signal is the same as the first refresh frequency;
and transmitting the second detection signal, and simultaneously displaying images by the display screen at a second refresh frequency, wherein the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is smaller than the second refresh frequency.
2. The control method according to claim 1, characterized in that the control method includes:
acquiring two-dimensional image information of the object to be detected; a kind of electronic device with high-pressure air-conditioning system
And when the face exists in the two-dimensional image information, starting the depth image acquisition module.
3. The control method according to claim 2, characterized in that the control method includes:
comparing the depth information image with a preset depth image;
and unlocking the electronic equipment when the similarity between the depth information image and the preset depth image is larger than a preset value.
4. An electronic device, the electronic device comprising:
a housing;
the display screen is arranged on the shell; a kind of electronic device with high-pressure air-conditioning system
The depth image acquisition module is arranged in the shell and positioned below the display screen, and comprises a transmitter and a receiver; the transmitter transmits a detection signal to the direction of the display screen while the display screen displays an image, and the receiver receives the detection signal reflected by the object to be detected after passing through the display screen so as to obtain a depth information image of the object to be detected; the refreshing frequency of the display screen is the same as the projection frequency of the transmitter;
the transmitter is used for transmitting a first detection signal towards the object to be detected with a first power;
the receiver is used for receiving the first detection signal reflected by the object to be detected after passing through the display screen so as to acquire the distance between the object to be detected and the electronic equipment;
the transmitter is further configured to transmit a second detection signal toward the object to be detected at a second power, where the second power is obtained from a pre-stored distance-power correspondence according to the distance;
the receiver receives the second detection signal reflected by the object to be detected after passing through the display screen so as to acquire a depth information image of the object to be detected;
the transmitter transmits the first detection signal and simultaneously displays images on the display screen at a first refreshing frequency, and the projection frequency of the first detection signal is the same as the first refreshing frequency;
the transmitter transmits the second detection signal and simultaneously displays images at a second refresh frequency, the projection frequency of the second detection signal is the same as the second refresh frequency, and the first refresh frequency is smaller than the second refresh frequency.
5. The electronic device of claim 4, wherein the electronic device further comprises:
the camera module is used for acquiring two-dimensional image information of the object to be detected; wherein:
and when the two-dimensional image information contains a human face, starting the depth image acquisition module.
6. The electronic device of claim 5, wherein the electronic device further comprises:
the processor is used for comparing the depth information image with a preset depth image; wherein:
and unlocking the electronic equipment when the similarity between the depth information image and the preset depth image is larger than a preset value.
7. The electronic device of claim 4, wherein the display screen comprises:
a first substrate;
the second substrate is arranged on one side of the first substrate, at least one through hole is formed in the second substrate, and the depth image acquisition module is arranged in the through hole; a kind of electronic device with high-pressure air-conditioning system
And the connecting layer is used for connecting the first substrate and the second substrate, and the difference value between the refractive index of the connecting layer and the refractive index of air in the through hole is in a preset range.
8. A non-transitory computer-readable storage medium containing a computer program, characterized in that the computer program, when executed by a processor, causes the processor to execute the control method of any one of claims 1 to 3.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010353593.5A CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
| PCT/CN2021/079072 WO2021218374A1 (en) | 2020-04-29 | 2021-03-04 | Control method, electronic device, and computer readable storage medium |
| TW110112946A TWI791208B (en) | 2020-04-29 | 2021-04-09 | Control method, electronic device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010353593.5A CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111461069A CN111461069A (en) | 2020-07-28 |
| CN111461069B true CN111461069B (en) | 2023-05-30 |
Family
ID=71683050
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010353593.5A Active CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN111461069B (en) |
| TW (1) | TWI791208B (en) |
| WO (1) | WO2021218374A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111461069B (en) * | 2020-04-29 | 2023-05-30 | Oppo广东移动通信有限公司 | Control method, electronic device, and computer-readable storage medium |
| CN114333661A (en) * | 2022-01-05 | 2022-04-12 | 苏州华兴源创科技股份有限公司 | Display panel industrial detection method, system, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105451011A (en) * | 2014-08-20 | 2016-03-30 | 联想(北京)有限公司 | Method and device for adjusting power |
| CN106850989A (en) * | 2017-02-08 | 2017-06-13 | 广东欧珀移动通信有限公司 | Display screen condition control method and device |
| CN108615012A (en) * | 2018-04-27 | 2018-10-02 | Oppo广东移动通信有限公司 | Distance reminding method, electronic device and non-volatile computer readable storage medium storing program for executing |
| CN108803917A (en) * | 2018-03-28 | 2018-11-13 | 广东欧珀移动通信有限公司 | Control method, control device, electronic device, computer storage media and equipment |
| CN109167904A (en) * | 2018-10-31 | 2019-01-08 | Oppo广东移动通信有限公司 | Image acquiring method, image acquiring device, structure optical assembly and electronic device |
| CN110134034A (en) * | 2019-03-26 | 2019-08-16 | 华为技术有限公司 | A kind of optical sensor condition control method and electronic equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140085245A1 (en) * | 2012-09-21 | 2014-03-27 | Amazon Technologies, Inc. | Display integrated camera array |
| CN107748869B (en) * | 2017-10-26 | 2021-01-22 | 奥比中光科技集团股份有限公司 | 3D face identity authentication method and device |
| CN109840475A (en) * | 2018-12-28 | 2019-06-04 | 深圳奥比中光科技有限公司 | Face identification method and electronic equipment |
| CN209170443U (en) * | 2018-12-28 | 2019-07-26 | 深圳奥比中光科技有限公司 | Electronic equipment |
| CN111461069B (en) * | 2020-04-29 | 2023-05-30 | Oppo广东移动通信有限公司 | Control method, electronic device, and computer-readable storage medium |
-
2020
- 2020-04-29 CN CN202010353593.5A patent/CN111461069B/en active Active
-
2021
- 2021-03-04 WO PCT/CN2021/079072 patent/WO2021218374A1/en active Application Filing
- 2021-04-09 TW TW110112946A patent/TWI791208B/en active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105451011A (en) * | 2014-08-20 | 2016-03-30 | 联想(北京)有限公司 | Method and device for adjusting power |
| CN106850989A (en) * | 2017-02-08 | 2017-06-13 | 广东欧珀移动通信有限公司 | Display screen condition control method and device |
| WO2018145555A1 (en) * | 2017-02-08 | 2018-08-16 | 广东欧珀移动通信有限公司 | Display screen state control method and apparatus, storage medium, and electronic device |
| CN108803917A (en) * | 2018-03-28 | 2018-11-13 | 广东欧珀移动通信有限公司 | Control method, control device, electronic device, computer storage media and equipment |
| CN108615012A (en) * | 2018-04-27 | 2018-10-02 | Oppo广东移动通信有限公司 | Distance reminding method, electronic device and non-volatile computer readable storage medium storing program for executing |
| CN109167904A (en) * | 2018-10-31 | 2019-01-08 | Oppo广东移动通信有限公司 | Image acquiring method, image acquiring device, structure optical assembly and electronic device |
| CN110134034A (en) * | 2019-03-26 | 2019-08-16 | 华为技术有限公司 | A kind of optical sensor condition control method and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202141972A (en) | 2021-11-01 |
| TWI791208B (en) | 2023-02-01 |
| WO2021218374A1 (en) | 2021-11-04 |
| CN111461069A (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9866748B2 (en) | System and method for controlling a camera based on processing an image captured by other camera | |
| CN108764091B (en) | Living body detection method and apparatus, electronic device, and storage medium | |
| JP7195422B2 (en) | Face recognition method and electronic device | |
| EP3191888B1 (en) | Scanning laser planarity detection | |
| KR102566998B1 (en) | Apparatus and method for determining image sharpness | |
| US11379960B2 (en) | Image processing method, image processing apparatus, and wearable device | |
| KR20190139062A (en) | Electronic device for providing customized quality image and method for controlling thereof | |
| CN111461069B (en) | Control method, electronic device, and computer-readable storage medium | |
| US20180184062A1 (en) | Image Processing to Determine Center of Balance in a Digital Image | |
| US9104038B2 (en) | Multiple laser drive method, apparatus and system | |
| KR20170028941A (en) | Method and device for recognizing biometric information | |
| US11514872B2 (en) | Mitigating display interference with captured image by controlling display brightness | |
| EP3989591A1 (en) | Resource display method, device, apparatus, and storage medium | |
| CN111557023A (en) | Method and system for maintaining color calibration using common objects | |
| CN109068116A (en) | Image processing method, device, mobile terminal and storage medium based on light filling | |
| KR102393299B1 (en) | Method of processing an image and apparatus thereof | |
| CN109754439B (en) | Calibration method, calibration device, electronic equipment and medium | |
| US9282317B2 (en) | Method and apparatus for processing an image and generating information representing the degree of stereoscopic effects | |
| CN109842791B (en) | Image processing method and device | |
| WO2020019682A1 (en) | Laser projection module, depth acquisition apparatus and electronic device | |
| US20190045093A1 (en) | Wearable Device Capable of Thermal Imaging | |
| CN113938689B (en) | Quantization parameter determination method and device | |
| CN110659609B (en) | Fingerprint matching method and device, electronic equipment and medium | |
| CN117542325A (en) | Compensation device, method, equipment and storage medium of display panel | |
| CN116958227A (en) | Method, device, equipment and storage medium for generating depth map of scene image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |