CN111461069A - Control method, electronic device, and computer-readable storage medium - Google Patents
Control method, electronic device, and computer-readable storage medium Download PDFInfo
- Publication number
- CN111461069A CN111461069A CN202010353593.5A CN202010353593A CN111461069A CN 111461069 A CN111461069 A CN 111461069A CN 202010353593 A CN202010353593 A CN 202010353593A CN 111461069 A CN111461069 A CN 111461069A
- Authority
- CN
- China
- Prior art keywords
- display screen
- detection signal
- detected
- image
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Controls And Circuits For Display Device (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The application discloses a control method, an electronic device and a computer-readable storage medium. Electronic equipment obtains module, casing and display screen including the degree of depth image, and the degree of depth image obtains the module setting and is located the below of display screen in the casing, and the degree of depth image obtains the module and includes transmitter and receiver. The control method comprises the following steps: the method comprises the steps that when a display screen is refreshed, a transmitter transmits a detection signal to the display screen, and a receiver receives the detection signal which passes through the display screen and is reflected by an object to be detected so as to obtain a depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the emitter. This application is through setting up the frequency that the degree of depth image acquireed module transmission detected signal and display screen refresh frequency and keep in step, and the transmitter transmission detected signal in the module is acquireed to the drive degree of depth image when the display screen shows the image, avoids the display screen and degree of depth image to acquire the corresponding region of module and obviously twinkle appears to promote user experience.
Description
Technical Field
The present disclosure relates to the field of image technologies, and in particular, to a control method, an electronic device, and a computer-readable storage medium.
Background
With the higher and higher requirements of the market on the large screen ratio of the mobile phone, various mobile phone manufacturers try to place electronic components, such as a camera, below the screen, so that the photographing effect is not affected, and the electronic components can be normally displayed. In addition, due to the prevalence of 3D unlocking, more and more mobile phone manufacturers begin to consider placing a depth camera for 3D unlocking below a screen, however, since the depth camera needs to actively emit light, the actively emitted light may cause obvious flicker in a corresponding area of the display screen, which seriously affects user experience.
Disclosure of Invention
The embodiment of the application provides a control method, electronic equipment and a non-volatile computer readable storage medium.
The application provides a control method. The control method is used for the electronic equipment, and the electronic equipment comprises a depth image acquisition module, a shell and a display screen. The depth image acquisition module is arranged in the shell and positioned below the display screen, and the depth image acquisition module comprises a transmitter and a receiver. The control method comprises the following steps: and when the display screen is refreshed, the emitter emits a detection signal to the display screen, and the receiver receives the detection signal which passes through the display screen and is reflected by the object to be detected so as to obtain a depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the emitter.
The application provides an electronic device. The electronic equipment comprises a shell, a display screen and a depth image acquisition module. The display screen is arranged on the shell. The depth image acquisition module is arranged in the shell and positioned below the display screen, and the depth image acquisition module comprises a transmitter and a receiver. The display screen displays images, the emitter emits detection signals towards the display screen, and the receiver receives the detection signals reflected by the object to be detected after the detection signals penetrate through the display screen so as to obtain the depth information image of the object to be detected. The refresh frequency of the display screen is the same as the projection frequency of the emitter.
The present application provides a non-volatile computer-readable storage medium. The non-transitory computer readable storage medium contains a computer program that, when executed by a processor, causes the processor to perform: the emitter emits a detection signal to the display screen direction while the display screen is refreshed, and the receiver receives the detection signal which passes through the display screen and is reflected by an object to be detected so as to obtain a depth information image of the object to be detected; the refresh frequency of the display screen is the same as the projection frequency of the emitter.
The control method, the electronic device and the non-volatile computer-readable storage medium provided by the application keep synchronization through setting the frequency of the depth image acquisition module for transmitting the detection signal and the refresh frequency of the display screen, and drive the transmitter in the depth image acquisition module to transmit the detection signal while the display screen displays the image, so that the display screen and the region corresponding to the depth image acquisition module are prevented from obviously flickering, and the user experience is improved.
Additional aspects and advantages of embodiments of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic perspective view of an electronic device according to some embodiments of the present application;
FIG. 2 is an exploded schematic view of an electronic device according to some embodiments of the present application;
FIG. 3 is a schematic partial cross-sectional view of the electronic device of FIG. 2 along line III-III;
FIG. 4 is a graphical illustration of a refresh frequency of a display screen and a transmission frequency of a transmitter transmitting a detection signal in accordance with certain embodiments of the present application;
FIG. 5 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;
FIG. 6 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;
FIG. 7 is a schematic flow chart diagram of a control method according to certain embodiments of the present application;
FIG. 8 is a schematic diagram of the interaction of a computer-readable storage medium and a processor of certain embodiments of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the embodiments of the present application, and are not to be construed as limiting the embodiments of the present application.
Referring to fig. 1, fig. 2 and fig. 5, the present application provides a control method for an electronic device 100. The electronic device 100 includes a depth image obtaining module 30, a housing 20, and a display screen 10, wherein the depth image obtaining module 30 is disposed in the housing 20 and below the display screen 10, and the depth image obtaining module 30 includes a transmitter 31 and a receiver 32; the control method comprises the following steps:
01: while the display screen 10 is refreshed, the emitter 31 emits a detection signal to the display screen 10, and the receiver 32 receives the detection signal which passes through the display screen 10 and is reflected by an object to be detected, so as to obtain a depth information image of the object to be detected; wherein the refresh frequency of the display screen 10 is the same as the projection frequency of the emitter 31.
It should be noted that, after the display screen 10 is turned on and displays a picture, the display screen 10 may refresh at a certain refresh frequency, and the refresh process is a process in which an image is displayed, an image is not displayed, an image is displayed, and an image is not displayed alternately and repeatedly, and since the time during the refresh process in which the image is not displayed by the display screen 10 is very short and can be ignored, the user may see that the image is continuously displayed after the display screen 10 is turned on.
Referring to fig. 1 and fig. 2, an electronic device 100 is also provided. The control method according to the embodiment of the present application can be implemented by the electronic device 100 according to the embodiment of the present application. The electronic device 100 includes a display screen 10, a housing 20, and a depth image capturing module 30. The display screen 10 is arranged on the shell 20, the depth image acquisition module 30 is arranged in the shell 20 and is positioned below the display screen 10, and the depth image acquisition module 30 comprises a transmitter 31 and a receiver 32; when the display screen 10 displays an image, the emitter 31 emits a detection signal towards the display screen 10, the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a depth information image of the object to be detected, and the refresh frequency of the display screen 10 is the same as the projection frequency of the emitter 31.
It should be noted that the electronic device 100 may be a mobile phone, a tablet computer, a notebook computer, an intelligent bracelet, an intelligent watch, an intelligent glasses, or the like. The present application will be described taking an example in which the electronic device 100 is a mobile phone.
Specifically, referring to fig. 1, fig. 2 and fig. 3, the housing 20 includes a first surface 21 and a second surface 22 opposite to each other. The display screen 10 includes a first substrate 11 and a second substrate 13, the second substrate 13 is disposed on one side of the first substrate 11, and at least one through hole 133 is formed on the second substrate 13. The display screen 10 is disposed on the first surface 21 of the housing 20, and the display screen 10 and the housing 20 form an accommodating space 23.
The depth image obtaining module 30 is disposed in the housing 20 and located below the display screen 10, that is, the depth image obtaining module 30 is accommodated in an accommodating space 23 formed by the display screen 10 and the housing 20. The depth image obtaining module 30 includes a transmitter 31 and a receiver 32, and when the number of the through holes 133 is one, both the transmitter 31 and the receiver 32 are accommodated in the through holes 133. When the number of the through holes 133 is two, the transmitter 31 and the receiver 32 are respectively accommodated in the two through holes 133.
While the display screen 10 displays an image, that is, while the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a depth information image of the object to be detected. Illustratively, fig. 4 is a diagram of the refresh frequency of the display screen 10 and the transmission frequency of the transmitter 31 transmitting the detection signal. As shown in fig. 4, at time T0, the display screen 10 does not display an image, and the emitter 31 does not emit a detection signal; at time T1, display screen 10 starts displaying images and emitter 31 starts emitting detection signals; at time T2, display screen 10 ends displaying the image and emitter 31 ends emitting the detection signal. Because the emitter 31 in the depth image acquisition module 30 is driven to emit the detection signal while the display screen 10 refreshes (the display screen 10 displays images), the display screen 10 is prevented from obviously flickering in the region corresponding to the depth image acquisition module 30, and the user experience is improved.
In some embodiments, the display screen 10 also includes a connection layer 12. The connection layer 12 is used to connect the first substrate 11 and the second substrate 13, and the refractive index of the connection layer 12 is almost close to the refractive index of the air in the through hole 133, and the difference between the two is within a predetermined range (small range). For example, assuming the predetermined range is (-0.5, 0.5), the difference between the refractive index of the connection layer 12 and the refractive index of air may be: -0.49, -0.2, -0.1, -0.23, 0, 0.11, 0.2, 0.33, 0.45, etc. Because the difference between the refractive index of the connection layer 12 and the refractive index of the air in the through hole 133 is within the predetermined range, the amount of light reflected by the light inside the display screen 10 towards the inside of the display screen 10 in the region where the through hole 133 is not formed is the same as the amount of light reflected by the light towards the inside of the display screen 10 in the region where the through hole 133 is formed, so that the phenomenon that the display screen 10 is displayed inconsistently in the region where the depth image acquisition module 30 is arranged and other regions is avoided, and the obvious flicker phenomenon can be further reduced.
Referring to fig. 6, step 01: when the display screen 10 is refreshed, the transmitter 31 transmits a detection signal to the display screen 10, and the receiver 32 receives the detection signal which passes through the display screen 10 and is reflected by the object to be detected, so as to obtain the depth information image of the object to be detected, including:
011: transmitting a first detection signal towards an object to be detected with a first power;
012: receiving a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a distance between the object to be detected and the electronic device 100;
013: transmitting a second detection signal to the object to be detected with a second power, wherein the second power is obtained from a pre-stored distance-power corresponding relation according to the distance;
014: and receiving a second detection signal reflected by the object to be detected after passing through the display screen 10 to acquire a depth information image of the object to be detected.
Specifically, referring to fig. 2 and 6, the depth image obtaining module 30 includes a transmitter 31 and a receiver 32. The transmitter 31 is used for transmitting a first detection signal towards the object to be detected with a first power; the receiver 32 is configured to receive a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a distance between the object to be detected and the electronic device 100; the depth image obtaining module 30 is further configured to obtain a second power from a pre-stored distance-power correspondence according to the distance; the transmitter 31 is further configured to transmit a second detection signal at a second power toward the object to be detected; the receiver 32 is further configured to receive a second detection signal reflected by the object to be detected after passing through the display screen to obtain a depth information image of the object to be detected.
It should be noted that a distance-power correspondence relationship is stored in advance in a memory (not shown) in the depth image acquiring module 30, and the distance-power correspondence relationship represents an optimal power (second power) required by the depth image acquiring module 30 corresponding to the object to be detected to transmit the second detection signal at different distances from the electronic device 100. Wherein the distance is positively correlated to the power, i.e. the further the distance, the more power the transmitter 31. The distance-power correspondence may be set by a manufacturer when the electronic device 100 leaves a factory, is fixed, and cannot be changed by a user when the user uses the electronic device, and may be changed arbitrarily. The distance-power correspondence may be set by the user, and is not limited herein.
For example, it is assumed that the distance-power correspondence records that the magnitude of the optimal power corresponding to the first distance is a first preset value; the magnitude of the optimal power corresponding to the second distance is a second preset value, wherein the first distance is smaller than the second distance, and the first preset value is smaller than the second preset value. When the distance between the object to be detected 100 and the electronic device 100 acquired by the depth image acquisition module 30 is a first distance, and the magnitude of the optimal power corresponding to the first distance in the distance-power correspondence is a first preset value, the transmitter 31 in the depth image acquisition module 30 transmits a second detection signal with the magnitude of the power as the first preset value; when the distance between the object 100 to be detected and the electronic device 100 acquired by the depth image acquiring module 30 is a second distance, and the magnitude of the optimal rate corresponding to the second distance in the distance-power correspondence is a second preset value, the transmitter 31 in the depth image acquiring module 30 transmits a second detection signal with the magnitude of power as a second preset value.
In one example, the first power is less than the second power. The depth image obtaining module 30 first transmits a first detection signal with low power (first power) to determine the distance between the object to be detected and the electronic device 100, and then selects the magnitude of the corresponding optimal power (second power) at the distance to transmit a second detection signal according to the distance between the object to be detected and the electronic device 100, so as to obtain the depth information image. On the one hand, the depth image acquisition module 30 is prevented from transmitting a high-power detection signal for a long time and enabling the signal to pass through the display screen 10, so that the damage of the detection signal transmitted by the transmitter 31 to the display screen 10 can be reduced, and the service life of the display screen 10 is prolonged. On the other hand, when the depth image acquisition module 30 disposed below the display screen 10 is used for face recognition, the second power of the second detection signal is adjusted according to the distance between the object to be detected (face) and the electronic device 100, and when the actual distance is greater than the test distance corresponding to the low power, the second power can be adjusted to be greater than the first power, so that the depth image acquisition module 30 can be prevented from emitting a high-power detection signal for a long time and enabling the signal to penetrate through the display screen 10 to reach human eyes, thereby protecting the human eyes and ensuring the safety of the human eyes. When the actual distance is smaller than the test distance corresponding to the low power, the second power can be adjusted to be smaller than the first power, and the depth image acquisition module 30 can be prevented from emitting a high-power detection signal for a long time and enabling the signal to penetrate through the display screen 10 to reach human eyes, so that the human eyes are protected, and the safety of the human eyes is guaranteed.
It should be noted that when the distance between the object to be detected and the electronic device 100 is close, the second power may be equal to the first power.
Referring to fig. 7, the control method further includes:
015: the display screen 10 displays an image at a first refresh frequency while emitting a first detection signal, the projection frequency of the first detection signal being the same as the first refresh frequency; and
016: the display screen 10 displays the image at a second refresh frequency while emitting a second detection signal, the projection frequency of the second detection signal being the same as the second refresh frequency, the first refresh frequency being less than the second refresh frequency.
Referring to fig. 2 and 7, the display screen 10 displays an image at a first refresh frequency while the transmitter 31 transmits the first detection signal, and the projection frequency of the first detection signal is the same as the first refresh frequency; the transmitter 31 displays the image on the display screen 10 at a second refresh frequency while transmitting a second detection signal, the projection frequency of the second detection signal being the same as the second refresh frequency, the first refresh frequency being less than the second refresh frequency.
In some embodiments, the transmitter 31 transmits a first detection signal at a first power towards the object to be detected while the display screen 10 displays images at a first refresh frequency, the first detection signal being projected at the same frequency as the first refresh frequency. The receiver 32 receives a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the processor 50 of the electronic device 100 is further configured to obtain the second power from a pre-stored distance-power correspondence according to the distance. The emitter 31 emits a second detection signal at a second power, and the display screen 10 displays images at a second refresh frequency, wherein the projection frequency of the second detection signal is the same as the second refresh frequency. And the first refresh frequency is less than the second refresh frequency, i.e. such that the projection frequency of the first detection signal is less than the projection frequency of the second detection signal. On one hand, the projection frequency of the first detection signal for detecting the distance is small, so that the damage energy to the display screen 10 is weak, and the service life of the display screen 10 is prolonged; on the other hand, the projection frequency of the second detection signal for acquiring the depth information image is high, so that the depth image information for acquiring the object to be detected is more detailed, and the accuracy of the depth information image is improved.
In other embodiments, a memory (not shown) in the electronic device 100 further stores a distance-projection frequency correspondence, where the distance-projection frequency correspondence represents an optimal projection frequency required by the depth image acquiring module 30 to transmit the second detection signal when the object to be detected and the electronic device 100 are at different distances. Wherein the distance is also positively correlated with the projection frequency, i.e. the further the distance, the larger the projection frequency of the emitter 31. The distance-projection frequency correspondence may be set by a manufacturer when the electronic device 100 leaves a factory, and may be fixed and may not be changed by a user when the user uses the electronic device. The distance-projection frequency correspondence may also be set by the user himself, and may be changed arbitrarily, which is not limited herein.
The transmitter 31 may select the second detection signal having the corresponding projection frequency and the corresponding power according to the distance between the object to be detected and the electronic apparatus 100. The longer the distance between the object to be detected and the electronic device 100 is, the greater the projection frequency of the second detection signal is. The display screen 10 has a second refresh frequency while the second detection signal is projected, and the second refresh frequency is the same as the projection frequency of the second detection signal. That is, the farther the distance between the object to be detected and the electronic device 100 is, the greater the refresh frequency of the display screen 10 when the second detection signal is transmitted. Specifically, the transmitter 31 transmits a first detection signal at a first power toward the object to be detected, while the display screen 10 displays an image at a first refresh frequency, the projection frequency of the first detection signal being the same as the first refresh frequency. The receiver 32 receives a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain the distance between the object to be detected and the electronic device 100; the depth image obtaining module 30 is further configured to obtain a second power according to the distance from the pre-stored distance-power corresponding relationship, and obtain a projection frequency of the second detection signal according to the distance from the pre-stored distance-frequency corresponding relationship. The transmitter 31 transmits a second detection signal according to the obtained magnitude of the second power and the magnitude of the projection frequency, and the display screen 10 displays an image at a second refresh frequency, where the second refresh frequency is the same as the projection frequency of the second detection signal.
In some embodiments, in the distance-power correspondence relationship, one distance value may correspond to one power value, one distance value may correspond to one power range, one distance range may correspond to one power value, and one distance range may correspond to one power range. After the distance between the object to be detected and the electronic device 100 is detected by the first detection signal with low power, if a plurality of powers corresponding to the detected distance are found in the distance-power correspondence relationship by a table lookup method, one power can be selected as the second power of the second detection signal. Similarly, in the distance-projection frequency correspondence relationship, one distance value may correspond to one projection frequency value, one distance value may correspond to one projection frequency range, one distance range may correspond to one projection frequency value, and one distance range may correspond to one projection frequency range. After the distance between the object to be detected and the electronic device 100 is detected by the first detection signal with low power, if a plurality of projection frequencies corresponding to the detected distance are found in the distance-projection frequency correspondence relationship by a table lookup method, one projection frequency can be selected as the projection frequency of the second detection signal.
It should be noted that, in an example, the first power of the first detection signal may be equal to the second power of the second detection signal, but the projection frequency of the first detection signal may be smaller than the projection frequency of the second detection signal. On one hand, the projection frequency of the first detection signal for detecting the distance is small, so that the damage energy to the display screen 10 is weak, and the service life of the display screen 10 is prolonged; on the other hand, the projection frequency of the second detection signal for acquiring the depth information image is high, so that the depth image information for acquiring the object to be detected is more detailed, and the accuracy of the depth information image is improved.
In one example, the projected frequency of the first detection signal may be equal to the projected frequency of the second detection signal, but the first power of the first detection signal is less than the second power of the second detection signal. On one hand, the power of the first detection signal for detecting the distance is small, so that the damage energy to the display screen 10 is weak, and the service life of the display screen 10 is prolonged; on the other hand, the power of the second detection signal for acquiring the depth information image is high, so that the depth image information of the object to be detected is acquired in more detail, and the accuracy of the depth information image is improved.
In yet another example, the first power of the first detection signal is less than the second power of the second detection signal, and the projected frequency of the first detection signal is also less than the projected frequency of the second detection signal. On one hand, since the energy (including power and projection frequency) of the first detection signal for detecting the distance is small, the damage energy to the display screen 10 is weak, thereby prolonging the service life of the display screen 10; on the other hand, because the energy (including power and projection frequency) of the second detection signal for acquiring the depth information image is large, the depth image information acquired from the object to be detected is more detailed, so that the accuracy of the depth information image is improved.
Referring to fig. 5, in some embodiments, the control method further includes:
02: acquiring two-dimensional image information of an object to be detected; and
03: when the face exists in the two-dimensional image information, the depth image obtaining module 30 is started.
Referring to fig. 1, fig. 2 and fig. 5, the electronic device 100 further includes a camera module 40. The camera module 40 is accommodated in an accommodating chamber formed by the display screen 10 and the housing 20. The camera module 40 can be a visible light camera or an infrared camera. When the camera module 40 is a visible light camera, the camera module 40 acquires that the two-dimensional image information of the object to be detected is an RGB image; when the camera module 40 is an infrared camera, the camera module 40 acquires that the two-dimensional image of the object to be detected is an infrared image. In the embodiment of the present application, the camera module 40 is a visible light camera.
As can be understood, when the depth image acquiring module 30 disposed below the display screen 10 is used for unlocking a human face, the depth image acquiring module 30 needs to be started to acquire the depth information image of the human face for unlocking only when the human face is identified to exist in the two-dimensional information; if the face does not exist in the two-dimensional information, the face does not need to be detected. Because whether the object to be detected contains the human face is judged by the camera module 40 firstly, the depth image acquisition module 30 is opened only when the human face exists, the frequency that the detection signal transmitted by the transmitter 31 passes through the display screen 10 is greatly reduced, thereby reducing screen flicker, reducing the damage of the detection signal transmitted by the transmitter 31 to the display screen 10 and prolonging the service life of the display screen 10.
It should be noted that, the turning on of the depth image obtaining module 30 does not mean that the emitter 31 is immediately driven to emit the detection signal, but after detecting that the two-dimensional image information of the object to be detected has a human face, the depth image obtaining module 30 is powered on, the emitter 31 is ready to emit light, and only when the display screen 10 displays an image for the first time, the emitter 31 formally emits the detection signal to the outside of the display screen 10.
Referring to fig. 5, in some embodiments, the control method further includes:
04: comparing the depth information image with a preset depth image;
05: and when the similarity between the depth information image and the preset image is greater than a preset value, unlocking the electronic device 100.
Referring to fig. 2 and 5, the electronic device 100 further includes a processor 50. Step 04 and step 05 can both be performed by the processor 50. That is, the processor 50 is configured to compare the depth information image with the preset depth image, and unlock the electronic device 100 when the similarity between the depth information image and the preset image is greater than a predetermined value.
Specifically, the obtained depth information image and a preset depth image are respectively subjected to face feature extraction to obtain a first feature image corresponding to the preset depth image and a second feature image corresponding to the depth information image; and classifying each feature in the first feature image and each feature in the second feature image, and respectively performing vectorization representation. After the feature vector in the first feature image corresponding to the preset depth image and the feature vector of the second feature image corresponding to the image to be subjected to depth information are obtained, the difference between the feature vector of each category in each first feature image and the feature vector of the corresponding category in the second feature image is calculated. For example, a feature vector representing the width of the eye in the first feature image and a feature vector representing the width of the eye in the second feature image are selected, and the difference between the two vectors is calculated; or selecting a feature vector representing the height of the nose bridge in the first feature image and a feature vector representing the height of the nose bridge in the second feature image, and calculating the difference between the two vectors.
Calculating the depth according to a plurality of differences corresponding to a plurality of categoriesIn some embodiments, the euclidean distance may be used to calculate a composite gap and represent the similarity by a euclidean distance value, for example, the class of feature vectors includes eyes, nose, mouth, and ears, and the feature vector representing eyes in the first feature image is a, the feature vector representing eyes in the second feature image is a0, the feature vector representing nose in the first feature image is B, the feature vector representing nose in the second feature image is B0, the feature vector representing mouth in the first feature image is C, the feature vector representing mouth in the second feature image is C0, the feature vector representing ears in the first feature image is D, the feature vector representing ears in the second feature image is D0, and the composite gap L is calculated as an arithmetic sum of squares of differences between the same class feature vectors on the first feature image and the second feature image, expressed by the mathematical formula:
the L value obtained by calculation is used to represent the similarity between the face in the depth information image and the face in the preset depth image, and the smaller the calculated Euclidean distance value is, the smaller the comprehensive difference is, that is, the more similar the face in the depth information image and the face in the preset depth image is, that is, the higher the similarity is, when the similarity between the face in the depth information image and the face in the preset depth image is greater than a predetermined value, it can be considered that the user using the electronic device 100 at this time is an authorized user of the electronic device 100, and the electronic device 100 can be unlocked.
Referring to fig. 8, the present application further provides a computer readable storage medium 200, on which a computer program 210 is stored, and the steps of the control method according to any one of the above embodiments are implemented when the computer program is executed by the processor 50.
For example, referring to fig. 6 and 8, when the program is executed by the processor 50, the following steps of the control method are implemented:
011: transmitting a first detection signal towards an object to be detected with a first power;
012: receiving a first detection signal reflected by the object to be detected after passing through the display screen 10 to obtain a distance between the object to be detected and the electronic device 100; acquiring second power from a pre-stored distance-power corresponding relation according to the distance;
013: emitting a second detection signal towards the object to be detected with a second power;
014: and receiving a second detection signal reflected by the object to be detected after passing through the display screen to acquire a depth information image of the object to be detected.
For another example, referring to fig. 2 and 8, when the program is executed by the processor 50, the following steps of the control method are implemented:
02: acquiring two-dimensional image information of an object to be detected; and
03: when the face exists in the two-dimensional image information, the depth image obtaining module 30 is started.
The computer-readable storage medium 200 may be disposed in the electronic device 200, or may be disposed in a cloud server, and at this time, the electronic device 200 can communicate with the cloud server to obtain the corresponding computer program 210.
It will be appreciated that the computer program 210 comprises computer program code. The computer program code may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying computer program code, recording medium, U-disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), software distribution medium, and the like.
The processor 50 may be referred to as a driver board. The driver board may be a Central Processing Unit (CPU), or may be other general purpose processor 50, a Digital signal processor 230 (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable gate array (FPGA) or other Programmable logic device, discrete gate or transistor logic, discrete hardware components, or the like.
In the description herein, reference to the description of the terms "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example" or "some examples" or the like means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
Although embodiments of the present application have been shown and described above, it is to be understood that the above embodiments are exemplary and not to be construed as limiting the present application, and that changes, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.
Claims (12)
1. A control method for electronic equipment is characterized in that the electronic equipment comprises a depth image acquisition module, a shell and a display screen, wherein the depth image acquisition module is arranged in the shell and positioned below the display screen, and comprises a transmitter and a receiver; the control method comprises the following steps:
the emitter emits a detection signal to the display screen direction while the display screen is refreshed, and the receiver receives the detection signal which passes through the display screen and is reflected by an object to be detected so as to obtain a depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the emitter.
2. The control method according to claim 1, wherein the transmitting a detection signal to the display screen by the transmitter while the display screen is refreshed, and the receiving the detection signal reflected by the object to be detected after passing through the display screen by the receiver to obtain the depth information image of the object to be detected comprises:
emitting a first detection signal towards the object to be detected with a first power;
receiving the first detection signal reflected by the object to be detected after passing through the display screen so as to obtain the distance between the object to be detected and the electronic equipment; acquiring second power from a pre-stored distance-power corresponding relation according to the distance;
emitting the second detection signal towards the object to be detected with a second power;
and receiving the second detection signal reflected back by the object to be detected after passing through the display screen to acquire a depth information image of the object to be detected.
3. The control method according to claim 2, characterized by comprising:
the display screen displays images at a first refresh frequency while transmitting the first detection signal, the first detection signal having a projection frequency that is the same as the first refresh frequency;
and simultaneously transmitting the second detection signal, displaying an image by the display screen at a second refreshing frequency, wherein the projection frequency of the second detection signal is the same as the second refreshing frequency, and the first refreshing frequency is less than the second refreshing frequency.
4. The control method according to claim 2 or 3, characterized by comprising:
acquiring two-dimensional image information of the object to be detected; and
and when the face exists in the two-dimensional image information, starting the depth image acquisition module.
5. The control method according to claim 4, characterized by comprising:
comparing the depth information image with a preset depth image;
and when the similarity between the depth information image and the preset image is greater than a preset value, unlocking the electronic equipment.
6. An electronic device, characterized in that the electronic device comprises:
a housing;
the display screen is arranged on the shell; and
the depth image acquisition module is arranged in the shell and positioned below the display screen, and comprises a transmitter and a receiver; the transmitter transmits a detection signal to the display screen while the display screen displays an image, and the receiver receives the detection signal reflected by an object to be detected after the detection signal passes through the display screen so as to obtain a depth information image of the object to be detected; wherein the refresh frequency of the display screen is the same as the projection frequency of the emitter.
7. The electronic device of claim 6,
the transmitter is used for transmitting a first detection signal towards the object to be detected with first power;
the receiver is used for receiving the first detection signal reflected by the object to be detected after the first detection signal passes through the display screen so as to obtain the distance between the object to be detected and the electronic equipment;
the transmitter is further configured to transmit the second detection signal to the object to be detected with a second power, where the second power is obtained from a pre-stored distance-power correspondence according to the distance;
the receiver receives the second detection signal reflected by the object to be detected after the second detection signal passes through the display screen so as to acquire a depth information image of the object to be detected.
8. The electronic device of claim 7,
the emitter emits the first detection signal, and the display screen displays images at a first refreshing frequency, wherein the projection frequency of the first detection signal is the same as the first refreshing frequency;
and the display screen displays images at a second refreshing frequency while the transmitter transmits the second detection signal, the projection frequency of the second detection signal is the same as the second refreshing frequency, and the first refreshing frequency is smaller than the second refreshing frequency.
9. The electronic device of claim 7 or 8, further comprising:
the camera module is used for acquiring two-dimensional image information of the object to be detected; wherein:
and when the face exists in the two-dimensional image information, the depth image acquisition module is started.
10. The electronic device of claim 9, further comprising:
a processor for comparing the depth information image with a preset depth image; wherein:
and when the similarity between the depth information image and the preset image is greater than a preset value, unlocking the electronic equipment.
11. The electronic device of claim 6, wherein the display screen comprises:
a first substrate;
the second substrate is arranged on one side of the first substrate, at least one through hole is formed in the second substrate, and the depth image acquisition module is arranged in the through hole; and
and the connecting layer is used for connecting the first substrate and the second substrate, and the difference between the refractive index of the connecting layer and the refractive index of the air in the through hole is in a preset range.
12. A non-transitory computer-readable storage medium containing a computer program, wherein the computer program, when executed by a processor, causes the processor to execute the control method of any one of claims 1 to 5.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010353593.5A CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
| PCT/CN2021/079072 WO2021218374A1 (en) | 2020-04-29 | 2021-03-04 | Control method, electronic device, and computer readable storage medium |
| TW110112946A TWI791208B (en) | 2020-04-29 | 2021-04-09 | Control method, electronic device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010353593.5A CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111461069A true CN111461069A (en) | 2020-07-28 |
| CN111461069B CN111461069B (en) | 2023-05-30 |
Family
ID=71683050
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010353593.5A Active CN111461069B (en) | 2020-04-29 | 2020-04-29 | Control method, electronic device, and computer-readable storage medium |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN111461069B (en) |
| TW (1) | TWI791208B (en) |
| WO (1) | WO2021218374A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021218374A1 (en) * | 2020-04-29 | 2021-11-04 | Oppo广东移动通信有限公司 | Control method, electronic device, and computer readable storage medium |
| CN114333661A (en) * | 2022-01-05 | 2022-04-12 | 苏州华兴源创科技股份有限公司 | Display panel industrial detection method, system, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105451011A (en) * | 2014-08-20 | 2016-03-30 | 联想(北京)有限公司 | Method and device for adjusting power |
| CN106850989A (en) * | 2017-02-08 | 2017-06-13 | 广东欧珀移动通信有限公司 | Display screen condition control method and device |
| CN108615012A (en) * | 2018-04-27 | 2018-10-02 | Oppo广东移动通信有限公司 | Distance reminding method, electronic device and non-volatile computer readable storage medium storing program for executing |
| CN108803917A (en) * | 2018-03-28 | 2018-11-13 | 广东欧珀移动通信有限公司 | Control method, control device, electronic device, computer storage media and equipment |
| CN109167904A (en) * | 2018-10-31 | 2019-01-08 | Oppo广东移动通信有限公司 | Image acquiring method, image acquiring device, structure optical assembly and electronic device |
| CN110134034A (en) * | 2019-03-26 | 2019-08-16 | 华为技术有限公司 | A kind of optical sensor condition control method and electronic equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140085245A1 (en) * | 2012-09-21 | 2014-03-27 | Amazon Technologies, Inc. | Display integrated camera array |
| CN107748869B (en) * | 2017-10-26 | 2021-01-22 | 奥比中光科技集团股份有限公司 | 3D face identity authentication method and device |
| CN209170443U (en) * | 2018-12-28 | 2019-07-26 | 深圳奥比中光科技有限公司 | Electronic equipment |
| CN109840475A (en) * | 2018-12-28 | 2019-06-04 | 深圳奥比中光科技有限公司 | Face identification method and electronic equipment |
| CN111461069B (en) * | 2020-04-29 | 2023-05-30 | Oppo广东移动通信有限公司 | Control method, electronic device, and computer-readable storage medium |
-
2020
- 2020-04-29 CN CN202010353593.5A patent/CN111461069B/en active Active
-
2021
- 2021-03-04 WO PCT/CN2021/079072 patent/WO2021218374A1/en active Application Filing
- 2021-04-09 TW TW110112946A patent/TWI791208B/en active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105451011A (en) * | 2014-08-20 | 2016-03-30 | 联想(北京)有限公司 | Method and device for adjusting power |
| CN106850989A (en) * | 2017-02-08 | 2017-06-13 | 广东欧珀移动通信有限公司 | Display screen condition control method and device |
| WO2018145555A1 (en) * | 2017-02-08 | 2018-08-16 | 广东欧珀移动通信有限公司 | Display screen state control method and apparatus, storage medium, and electronic device |
| CN108803917A (en) * | 2018-03-28 | 2018-11-13 | 广东欧珀移动通信有限公司 | Control method, control device, electronic device, computer storage media and equipment |
| CN108615012A (en) * | 2018-04-27 | 2018-10-02 | Oppo广东移动通信有限公司 | Distance reminding method, electronic device and non-volatile computer readable storage medium storing program for executing |
| CN109167904A (en) * | 2018-10-31 | 2019-01-08 | Oppo广东移动通信有限公司 | Image acquiring method, image acquiring device, structure optical assembly and electronic device |
| CN110134034A (en) * | 2019-03-26 | 2019-08-16 | 华为技术有限公司 | A kind of optical sensor condition control method and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021218374A1 (en) * | 2020-04-29 | 2021-11-04 | Oppo广东移动通信有限公司 | Control method, electronic device, and computer readable storage medium |
| CN114333661A (en) * | 2022-01-05 | 2022-04-12 | 苏州华兴源创科技股份有限公司 | Display panel industrial detection method, system, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202141972A (en) | 2021-11-01 |
| TWI791208B (en) | 2023-02-01 |
| WO2021218374A1 (en) | 2021-11-04 |
| CN111461069B (en) | 2023-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9866748B2 (en) | System and method for controlling a camera based on processing an image captured by other camera | |
| EP3191888B1 (en) | Scanning laser planarity detection | |
| EP3872658B1 (en) | Face recognition method and electronic device | |
| US11379960B2 (en) | Image processing method, image processing apparatus, and wearable device | |
| CN111461069B (en) | Control method, electronic device, and computer-readable storage medium | |
| US11514872B2 (en) | Mitigating display interference with captured image by controlling display brightness | |
| US11410400B2 (en) | Method and system for maintaining color calibration using common objects | |
| US20170336864A1 (en) | System and method of adjusting a device display based on eyewear properties | |
| US11900579B2 (en) | Generating calibration images by merging captured recalibration images with previously captured calibration images | |
| US11615517B2 (en) | Mitigating display interference with captured image using calibration images | |
| CN106843782B (en) | Method for adjusting color of image of electronic equipment and electronic equipment | |
| EP3664445B1 (en) | Image processing method and device therefor | |
| CN115804025A (en) | Shutter camera pipeline exposure timestamp error determination | |
| US20190219832A1 (en) | Method for tuning a three-dimensional image and a display apparatus thereof | |
| Kane et al. | System gamma as a function of image-and monitor-dynamic range | |
| TWI734092B (en) | Method and apparatus of depth fusion | |
| US9282317B2 (en) | Method and apparatus for processing an image and generating information representing the degree of stereoscopic effects | |
| WO2020019682A1 (en) | Laser projection module, depth acquisition apparatus and electronic device | |
| JPWO2016027527A1 (en) | Information processing apparatus, information processing method, and program | |
| US20190045093A1 (en) | Wearable Device Capable of Thermal Imaging | |
| TWI719440B (en) | Stereo match method and apparatus thereof | |
| US10652480B2 (en) | Display exposure monitoring module | |
| CN117542325A (en) | Compensation device, method, equipment and storage medium of display panel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |