WO2020038064A1

WO2020038064A1 - Control method and device, depth camera, electronic device, and readable storage medium

Info

Publication number: WO2020038064A1
Application number: PCT/CN2019/090078
Authority: WO
Inventors: 武隽
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-08-22
Filing date: 2019-06-05
Publication date: 2020-02-27
Also published as: CN108833889B; CN108833889A

Abstract

A control method for a light emitter (100), a control device (90), a depth camera (300), an electronic device (800) and a computer readable storage medium (901). The control method comprises: acquiring a projection distance between a light emitter (100) and a target body in a scene (01); determining, according to the projection distance, a target light emission frequency of the light emitter (100) (02); and controlling the light emitter (100) to emit light at the target light emission frequency (03).

Description

Control method and device, depth camera, electronic device and readable storage medium

Priority information

This application claims the priority and rights of the patent application filed with the State Intellectual Property Office of China on August 22, 2018, with a patent application number of 201810962843.8, and the entirety thereof is incorporated herein by reference.

Technical field

The present application relates to the field of three-dimensional imaging technology, and in particular, to a control method, a control device, a depth camera, an electronic device, and a computer-readable storage medium.

Background technique

Time of flight (TOF) imaging system can calculate the depth information of the measured object by calculating the time difference between the moment when the optical transmitter emits the optical signal and the moment when the optical receiver receives the optical signal. Light emitters typically include a light source and a diffuser. The light from the light source is diffused by the diffuser and then casts a uniform surface light into the scene.

Summary of the Invention

Embodiments of the present application provide a control method, a control device, a depth camera, an electronic device, and a computer-readable storage medium.

A method for controlling a light transmitter according to an embodiment of the present application includes: obtaining a projection distance between the light transmitter and a target subject in a scene; determining a target light emission frequency of the light transmitter according to the projection distance; The light emitter emits light at the target emission frequency.

The control device for an optical transmitter according to the embodiment of the present application includes a first acquisition module, a determination module, and a control module. The first obtaining module is configured to obtain a projection distance between the light emitter and a target subject in a scene. The determining module is configured to determine a target light emitting frequency of the light transmitter according to the projection distance. The control module is configured to control the light emitter to emit light at the target emission frequency.

The depth camera of the embodiment of the present application includes a light emitting emitter and a processor. The processor is configured to obtain a projection distance between the light emitter and a target subject in a scene; determine a target light emission frequency of the light emitter according to the projection distance; and control the light emitter to use the target Luminous frequency glows.

An electronic device according to an embodiment of the present application includes the above-mentioned depth camera, one or more processors, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be provided by the The one or more processors execute the program, and the program includes instructions for performing the foregoing control method.

The computer-readable storage medium of the embodiment of the present application includes a computer program used in combination with an electronic device, and the computer program can be executed by a processor to complete the control method described above.

Additional aspects and advantages of the present application will be given in part in the following description, part of which will become apparent from the following description, or be learned through practice of the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and / or additional aspects and advantages of this application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic three-dimensional structure diagram of an electronic device according to some embodiments of the present application.

FIG. 2 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 3 is a schematic block diagram of a control device for a light transmitter according to some embodiments of the present application.

FIG. 4 is a schematic diagram of the operation of a TOF depth camera according to some embodiments of the present application.

FIG. 5 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

6 is a schematic block diagram of a first acquisition module of a control device according to some embodiments of the present application.

FIG. 7 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

8 is a schematic block diagram of a first acquisition module of a control device according to some embodiments of the present application.

FIG. 9 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 10 is a schematic block diagram of a control device according to some embodiments of the present application.

11 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 12 is a schematic block diagram of a second computing unit of a control device according to some embodiments of the present application.

13 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

14 is a schematic block diagram of a second computing unit of a control device according to some embodiments of the present application.

15 is a schematic flowchart of a method for controlling a light transmitter according to some embodiments of the present application.

FIG. 16 is a schematic block diagram of a second computing unit of a control device according to some embodiments of the present application.

FIG. 17 is a schematic three-dimensional structure diagram of an electronic device according to some embodiments of the present application.

FIG. 18 is a schematic diagram of a three-dimensional structure of a depth camera according to some embodiments of the present application.

FIG. 19 is a schematic plan view of a depth camera according to some embodiments of the present application.

FIG. 20 is a schematic cross-sectional view of the depth camera in FIG. 19 along the line XX-XX.

FIG. 21 is a schematic structural diagram of a light emitter according to some embodiments of the present application.

22 and 23 are schematic structural diagrams of a light source of a light emitter according to some embodiments of the present application.

FIG. 24 is a schematic block diagram of an electronic device according to some embodiments of the present application.

25 is a schematic diagram of a connection between a computer-readable storage medium and an electronic device according to some embodiments of the present application.

detailed description

Hereinafter, embodiments of the present application will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present application, and should not be construed as limiting the present application.

See Figure 1. The present application provides a method for controlling the light transmitter 100. The control method includes: obtaining a projection distance between the light emitter 100 and a target subject in the scene; determining a target light emitting frequency of the light emitter 100 according to the projection distance; and controlling the light emitter 100 to emit light at the target light emitting frequency.

Referring to FIG. 5, in some embodiments, acquiring a projection distance between the light emitter 100 and a target subject in a scene includes: acquiring a captured image of the scene; processing the captured image to determine whether a human face exists in the captured image; When a human face exists in the captured image, the first proportion of the human face in the captured image is calculated; and the projection distance is calculated according to the first proportion.

Referring to FIG. 7, in some embodiments, obtaining a projection distance between the light emitter 100 and a target subject in the scene includes: controlling the light emitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene; The depth information calculates a projection distance between the light emitter 100 and the target subject.

Please refer to FIG. 9. In some embodiments, after the step of obtaining the projection distance between the light emitter 100 and the target subject in the scene, the control method further includes: obtaining the ambient brightness of the scene; Target light emitting power of the light emitter 100; controlling the light emitter 100 to emit light at the target light emitting power.

Referring to FIG. 11, in some embodiments, calculating the projection distance according to the first scale includes: calculating a second ratio of a preset feature area of a human face in a captured image to the human face; and according to the first and second scales. Calculate the projection distance.

Referring to FIG. 13, in some embodiments, calculating the projection distance according to the first ratio includes: determining whether the target subject is wearing glasses according to the captured image; and calculating the projection distance according to the first ratio and the distance coefficient when the target subject wears glasses.

Referring to FIG. 15, in some embodiments, calculating the projection distance according to the first ratio includes: determining the age of the target subject according to the captured image; and calculating the projection distance according to the first ratio and age.

Please refer to FIG. 2 and FIG. 3 together. The present application further provides a control device 90 of the optical transmitter 100. The control device 90 includes a first acquisition module 91, a determination module 92, and a control module 93. The first acquisition module 91 is configured to acquire a projection distance between the light emitter 100 and a target subject in a scene. The determining module 92 is configured to determine a target emission frequency of the light transmitter 100 according to the projection distance. The control module 93 is configured to control the light emitter 100 to emit light at a target emission frequency.

Referring to FIG. 6, in some embodiments, the first acquisition module 91 includes a first acquisition unit 911, a processing unit 912, a first calculation unit 913, and a second calculation unit 914. The first acquiring unit 911 is configured to acquire a captured image of a scene. The processing unit 912 is configured to process the captured image to determine whether a human face exists in the captured image. The first calculation unit 913 is configured to calculate a first proportion of a human face in a captured image when a human face exists in the captured image. The second calculation unit 914 is configured to calculate a projection distance according to the first ratio.

Referring to FIG. 8, in some embodiments, the first obtaining module 91 includes a first control unit 915 and a third calculation unit 916. The first control unit 915 is used to control the light emitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene. The third calculation unit 916 is configured to calculate a projection distance between the light emitter 100 and the target subject according to the initial depth information.

Referring to FIG. 10, in some embodiments, the control device 90 further includes a second obtaining module 94 and a calculation module 95. The second acquisition module 94 may be configured to acquire the ambient brightness of the scene. The calculation module 95 is configured to calculate a target luminous power of the light transmitter 100 according to the ambient brightness and the projection distance. The control module 93 is further configured to control the light emitter 100 to emit light at a target light emission power.

Referring to FIG. 12, in some embodiments, the second calculation unit 914 includes a first calculation sub-unit 9141 and a second calculation sub-unit 9142. The first calculation subunit 9141 is configured to calculate a second proportion of the preset feature area of the human face in the captured image. The second calculation subunit 9142 is configured to calculate a projection distance according to the first scale and the second scale.

Referring to FIG. 14, in some embodiments, the second calculation unit 914 further includes a first determination sub-unit 9143 and a third calculation sub-unit 9144. The first determining subunit 9143 is configured to determine whether the target subject is wearing glasses according to the captured image, and the third calculating subunit 9144 is used to calculate the projection distance according to the first ratio and the distance coefficient when the target subject is wearing glasses.

Referring to FIG. 16, in some embodiments, the second calculation unit 914 further includes a second determination sub-unit 9145 and a fourth calculation sub-unit 9146. The second judging subunit 9145 is configured to judge the age of the target subject according to the captured image. The fourth calculation subunit 9146 is configured to calculate a projection distance according to the first ratio and age.

Referring to FIG. 2, the present application further provides a depth camera 300. The depth camera 300 includes a light transmitter 100, a light receiver 200, and a processor 805. The processor 805 may be configured to obtain a projection distance between the light emitter 100 and a target subject in the scene, determine a target light emission frequency of the light emitter 100 according to the projection distance, and control the light emitter 100 to emit light at the target light emission frequency.

Please refer to FIG. 1 again. In some embodiments, the processor 805 is configured to obtain a captured image of a scene, process the captured image to determine whether a face exists in the captured image, and calculate a person in the captured image when a face exists in the captured image. The first proportion occupied by the face, and the projection distance is calculated based on the first proportion.

Please refer to FIG. 1 again. In some embodiments, the processor 805 is further configured to control the light emitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene, and calculate the light emitter 100 and the target subject according to the initial depth information. The projection distance between.

Please refer to FIG. 1 again. In some embodiments, the processor 805 is configured to obtain the ambient brightness of the scene, calculate the target light emitting power of the light transmitter 100 according to the environment brightness and the projection distance, and control the light emitter 100 to use the target light emitting power Glow.

Please refer to FIG. 1 again. In some embodiments, the processor 805 may be configured to calculate a second proportion of the preset feature area of the human face in the captured image to the human face, and calculate the projection distance according to the first proportion and the second proportion.

Please refer to FIG. 1 again. In some embodiments, that is, the processor 805 is further configured to determine whether the target subject is wearing glasses according to the captured image, and calculate the projection according to the first scale and distance coefficient when the target subject is wearing glasses. distance.

Please refer to FIG. 1 again. In some embodiments, the processor 805 is further configured to determine the age of the target subject according to the captured image, and calculate the projection distance according to the first ratio and age.

Referring to FIG. 24, the present application further provides an electronic device 800. The electronic device 800 includes the depth camera 300, one or more processors 805, a memory 806, and one or more programs 807 according to any one of the foregoing embodiments. One or more programs 807 are stored in the memory 806 and are configured to be executed by one or more processors 805. The program 807 includes instructions for executing the control method of the optical transmitter 100 according to any one of the foregoing embodiments.

Referring to FIG. 25, the present application further provides a computer-readable storage medium 901. The computer-readable storage medium 901 includes a computer program 902 used in conjunction with the electronic device 800. The computer program 902 can be executed by the processor 805 to complete the method for controlling the optical transmitter 100 according to any one of the foregoing embodiments.

Please refer to FIG. 1 and FIG. 2 together. The present application provides a method for controlling an optical transmitter 100. Control methods include:

01: Obtain the projection distance between the light emitter 100 and the target subject in the scene;

02: determining the target emission frequency of the light transmitter 100 according to the projection distance; and

03: The light emitter 100 is controlled to emit light at a target emission frequency.

Please refer to FIG. 2 and FIG. 3 together. The present application further provides a control device 90 of the optical transmitter 100. The control method of the light transmitter 100 according to the embodiment of the present application may be executed by the control device 90 of the light transmitter 100 according to the embodiment of the present application. Specifically, the control device 90 includes a first acquisition module 91, a determination module 92, and a control module 93. Step 01 may be implemented by the first obtaining module 91. Step 02 may be implemented by the determination module 92. Step 03 may be implemented by the control module 93. That is, the first obtaining module 91 may be used to obtain a projection distance between the light emitter 100 and a target subject in the scene. The determination module 92 may be configured to determine a target light emission frequency of the light transmitter 100 according to the projection distance. The control module 93 may be configured to control the light emitter 100 to emit light at a target light emission frequency.

Please refer to FIG. 2 again, this application further provides a depth camera 300. The depth camera 300 includes a light transmitter 100, a light receiver 200, and a processor 805.

Steps

01, 02, and 03 can be implemented by the processor 805. That is to say, the processor 805 may be configured to obtain a projection distance between the light emitter 100 and a target subject in the scene, determine a target light emission frequency of the light emitter 100 according to the projection distance, and control the light emitter 100 to emit light at the target light emission frequency. .

The depth camera 300 according to the embodiment of the present application can be applied to the electronic device 800. The processor 805 in the depth camera 300 according to the embodiment of the present application and the processor 805 of the electronic device 800 may be the same processor 805 or two independent processors 805. In the specific embodiment of the present application, the processor 805 in the depth camera 300 and the processor 805 of the electronic device 800 are the same processor 805. The electronic device 800 may be a mobile phone, a tablet computer, a smart wearable device (a smart watch, a smart bracelet, a smart glasses, a smart helmet), a drone, etc., and is not limited herein.

Specifically, the depth camera 300 according to the embodiment of the present application is a time of flight (TOF) depth camera. A TOF depth camera generally includes a light transmitter 100 and a light receiver 200. The light receiver 200 is configured to project a laser light into the scene, and the light receiver 200 receives the laser light reflected by a person or an object in the scene. The TOF depth camera usually obtains depth information in two ways: direct acquisition and indirect acquisition. In the direct acquisition mode, the processor 805 can calculate the flight time of the laser in the scene according to the time point when the optical receiver 200 emits the laser light and the time point when the light receiver 200 receives the laser light, and calculate the scene's Depth information. In the indirect acquisition mode, the light transmitter 100 emits laser light with a certain modulation frequency to the scene after pulse modulation, and the light receiver 200 collects the laser light in one or more complete pulse periods reflected back. Each pixel of the light receiver 200 is composed of a light-sensitive device. The light-sensitive device is connected to multiple high-frequency switches, which can direct current into different capacitors that can store electric charges. In this way, the processor 805 controls the on-off of the high-frequency switch. , The received laser under one or more complete pulse periods is divided into two parts, and the distance between the object and the TOF depth camera can be calculated according to the current corresponding to the infrared light of these two parts. For example, as shown in Fig. 4, the charges accumulated by the two lasers are Q1 and Q2, and the duration of the laser in a pulse period is T, then the propagation time of the laser in the scene

Corresponding distance

Where c is the speed of light. When a person or object in the scene is far away from the TOF depth camera, if the light emission frequency is high at this time, on the one hand, the duration T of the laser light in a pulse period is short, and the integration time of the laser device to accumulate laser light is short. On the one hand, the distance is longer, the laser flight time is longer, and the loss is more. This will cause the values Q1 and Q2 of the laser accumulation to be small, which will affect the accuracy of depth information acquisition.

Before acquiring the depth information of the scene, the control method, control device 90 and depth camera 300 of the light transmitter 100 according to the embodiments of the present application first detect the projection distance between the target subject and the depth camera 300 in the scene, and then according to the projection distance To determine the target light emission frequency of the light emitter 100, and finally control the light emitter 100 to emit light at the target light emission frequency. The projection distance has a mapping relationship with the target emission frequency. For example, the projection distance is a specific value, the target emission frequency is also a specific value, and the projection distance corresponds to the target emission frequency one by one. Or, the projection distance is a range, and the target The light emission frequency is a specific value, and the projection distance corresponds to the target light emission frequency one to one. The mapping relationship between the projection distance and the target luminous frequency may be determined based on calibration data of a large number of experiments before the depth camera 300 leaves the factory. The mapping relationship between the projection distance and the target luminous frequency satisfies the law that the target luminous frequency decreases as the projection distance increases. For example, when the projection distance is 1.5 meters, the target light emitting frequency of the light transmitter 100 is 100 MHz; when the projection distance is 3 meters, the target light emitting frequency of the light transmitter 100 is 60 MHz; when the projection distance is 5 meters, the The target light emission frequency is 30 MHz, etc., so that when the projection distance is increased, the integration time of the laser light accumulated by the photosensitive device is increased by reducing the target light emission frequency to further improve the accuracy of obtaining depth information.

Referring to FIG. 5, in some embodiments, obtaining the projection distance between the light emitter 100 and the target subject in the scene in step 01 includes:

011: Get the captured image of the scene;

012: Process the captured image to determine whether a human face exists in the captured image;

013: Calculate the first proportion of the face in the captured image when a face is present in the captured image; and

014: Calculate the projection distance according to the first ratio.

Referring to FIG. 6, in some embodiments, the first acquisition module 91 includes a first acquisition unit 911, a processing unit 912, a first calculation unit 913, and a second calculation unit 914. Step 011 may be implemented by the first obtaining unit 911. Step 012 may be implemented by the processing unit 912. Step 013 may be implemented by the first calculation unit 913. Step 014 may be implemented by the second calculation unit 914. That is to say, the first acquisition unit 911 may be configured to acquire a captured image of a scene. The processing unit 912 may be configured to process the captured image to determine whether a human face exists in the captured image. The first calculation unit 913 may be configured to calculate a first proportion of a human face in the captured image when a human face exists in the captured image. The second calculation unit 914 may be configured to calculate the projection distance according to the first ratio. The first obtaining unit 911 may be an infrared camera (which may be the light receiver 200) or a visible light camera 400. When the first obtaining unit 911 is an infrared camera, the captured image is an infrared image; when the first obtaining unit 911 is a visible light camera At 400, the captured image is a visible light image.

Please refer to FIG. 1 again. In some embodiments, step 011, step 012, step 013, and step 014 may be implemented by the processor 805. That is to say, the processor 805 may be configured to obtain a captured image of a scene, process the captured image to determine whether a human face exists in the captured image, calculate a first proportion of the human face in the captured image when a human face exists in the captured image, And calculating the projection distance according to the first scale.

Specifically, the processor 805 first recognizes whether a human face exists in the captured image based on a human face recognition algorithm. When a face exists in the captured image, the processor 805 extracts the face area and calculates the number of pixels occupied by the face area. Subsequently, the processor 805 divides the number of pixels in the face area by the total number of pixels in the captured image. Count to get the first proportion of the face in the captured image, and finally calculate the projection distance based on the first proportion. Generally, when the first ratio is larger, the target subject is closer to the depth camera 300, that is, the target subject is closer to the light transmitter 100, and the projection distance is smaller. When the first proportion is larger, the target subject and the depth camera are explained. The distance of 300 is longer, that is, the target subject is farther from the light transmitter 100, and the projection distance is larger. Therefore, the relationship between the projection distance and the first ratio satisfies that the projection distance increases as the first ratio decreases. In one example, when the captured image contains multiple faces, the face with the largest area among the multiple faces may be selected as the face area to calculate the first proportion; or the area of multiple faces may also be selected To calculate the first proportion; or, the face of the holder of the electronic device 800 can be identified from multiple faces, and the first proportion can be calculated by using the face of the holder as the face area. Determining the target light emission frequency based on the distance between the holder and the depth camera 300 can improve the accuracy of obtaining the depth information corresponding to the holder and improve the user experience.

The first ratio has a mapping relationship with the projection distance. For example, the first ratio is a specific value and the projection distance is also a specific value. The first ratio corresponds to the projection distance one by one. Or, the first ratio is a range and the projection distance is For a specific value, the first ratio is a one-to-one correspondence with the projection distance; or, the first ratio is a range and the projection distance is also a range, and the first ratio corresponds to the projection distance one-to-one. Specifically, the mapping relationship between the first scale and the projection distance may be calibrated in advance. At the time of calibration, the user is directed to stand at more than a predetermined projection distance from the infrared camera or visible light camera 400, and the infrared camera or visible light camera 400 sequentially captures captured images. The processor 805 calculates the calibration ratio of the face to the captured image in each captured image, and then stores the corresponding relationship between the calibrated ratio in each captured image and the predetermined projection distance. Based on the actually measured first ratio in subsequent use Find the projection distance corresponding to the first ratio in the above mapping relationship. For example, the user is instructed to stand at a projection distance of 10 cm, 20 cm, 30 cm, 40 cm, an infrared camera or a visible light camera 400 sequentially captures captured images, and the processor 805 calculates a projection distance of 10 cm from the multiple captured images , 20 cm, 30 cm, and 40 cm respectively corresponding to the calibration ratio of 80%, 60%, 45%, 30%, and the mapping relationship between the calibration ratio and the predetermined projection distance 10cm-80%, 20cm-60%, 30cm-45 %, 40cm-30% are stored in the memory of the electronic device 800 (shown in FIG. 24) in the form of a mapping table. In subsequent use, directly find the projection distance corresponding to the first ratio in the mapping table.

Alternatively, the projection distance and the first ratio are calibrated in advance. During calibration, the user is directed to stand at a predetermined projection distance from the infrared camera or visible light camera 400, and the infrared camera or visible light camera 400 collects captured images. The processor 805 calculates the calibration ratio of the human face in the captured image, and then stores the correspondence between the calibration ratio in the captured image and the predetermined projection distance. In subsequent use, based on the correspondence between the calibration ratio and the predetermined projection distance The relationship calculates the projection distance. For example, to guide the user to stand at a position with a projection distance of 30 cm, the infrared camera or visible light camera 400 captures the captured image, the processor 805 calculates that the proportion of the human face in the captured image is 45%, and in actual measurement, when When the first ratio is calculated as R, according to the properties of similar triangles,

Among them, D is an actual projection distance calculated according to the actually measured first ratio R.

In this way, according to the first proportion of the human face in the captured image, the projection distance between the target subject and the light emitter 100 can be reflected more objectively.

Referring to FIG. 7, in some embodiments, obtaining the projection distance between the light emitter 100 and the target subject in the scene in step 01 includes:

015: controlling the light emitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene; and

016: Calculate a projection distance between the light emitter 100 and the target subject according to the initial depth information.

Referring to FIG. 8, in some embodiments, the first obtaining module 91 includes a first control unit 915 and a third calculation unit 916. Step 015 may be implemented by the first control unit 915. Step 015 may be implemented by the third calculation unit 916. That is, the first control unit 915 may be used to control the light transmitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene. The third calculation unit 916 may be configured to calculate a projection distance between the light emitter 100 and the target subject according to the initial depth information.

Please refer to FIG. 1 again. In some embodiments, step 015 and step 016 may both be implemented by the processor 805. That is, the processor 805 may also be used to control the light emitter 100 to emit light at a predetermined light emission frequency to detect initial depth information of the scene, and calculate a projection distance between the light emitter 100 and the target subject according to the initial depth information.

Specifically, the processor 805 controls the light transmitter 100 to emit laser light at a predetermined light emission frequency, the light receiver 200 receives the laser light reflected by a person or an object in the scene, and the processor 805 calculates an initial scene based on the reception result of the light receiver 200 Depth information. Wherein, the predetermined light emission frequency is less than a preset threshold, that is, when the initial depth information of the scene is obtained, the light emitter 100 emits light at a lower light emission frequency. The lower light emission frequency can reduce the power consumption of the electronic device 800. On the other hand, at this time, the projection distance between the target subject and the depth camera 300 is unknown, and it is also unknown whether the target subject is a user. If the light is directly emitted at a higher light frequency, if the target subject is the user and the target subject and the depth camera 300 If the distance is relatively short, the high-frequency emission of the laser light is likely to cause harm to the eyes of the user, and the light emission at a lower light emission frequency does not have the above-mentioned hidden dangers.

After the processor 805 calculates the initial depth information of the scene, the target subject is further determined from the scene to further determine the initial depth information of the target subject. Specifically, the target subject is generally located in the central area of the field of view of the light receiver 200. Therefore, the central area of the field of view of the light receiver 200 can be used as the area where the target subject is located, so that the initial depth information of the pixels in the central area is used as The initial depth information of the target subject. Generally, there are multiple values of the initial depth information of the target subject. The processor 805 can calculate the average or median value of the multiple initial depth information, and use the average or median value as the projection between the light emitter 100 and the target subject. distance. In this way, the projection distance between the target subject and the light emitter 100 is calculated, and the target light emitting frequency of the light emitter 100 is determined based on the projection distance, so that the light emitter 100 emits light according to the target light emitting frequency, and the depth of the obtained target subject is increased. The accuracy of the information.

In some embodiments, after processing the captured image to determine whether a face exists in the captured image in step 012, if there is no face in the captured image, the processor 805 may further perform

steps

015 and 016 to determine the target subject and The projection distance between the light emitters 100. In this way, when a human face does not exist in the captured image, the projection distance between the target subject and the light emitter 100 can also be determined.

In some embodiments, after controlling the light transmitter 100 to emit light at a predetermined light emission frequency to detect the initial depth information of the scene in step 015, the processor 805 may control the infrared camera (which may be the light receiver 200) or the visible light camera 400 to capture and shoot image. It is assumed that the captured image is collected by the visible light camera 400. Generally, in order to capture a three-dimensional color image of a person or to three-dimensionally model a scene, the visual field of the visible light camera 400 and the light receiver 200 in the electronic device 800 usually has a large overlap. Before the electronic device 800 leaves the factory, the manufacturer will also calibrate the relative position between the visible light camera 400 and the light receiver 200 and obtain multiple calibration parameters for matching the color information of the subsequent visible light image and the depth information of the depth image. . Therefore, after the captured image is obtained by the processor 805, the processor 805 can first identify whether a human face exists in the captured image, and when there is a human face, find it based on the matching relationship between the captured image and the initial depth image formed by the initial depth information. The initial depth information corresponding to the face, and the initial depth information corresponding to the face is used as the depth information of the target subject. If there is no human face in the captured image, the initial depth information of the pixels in the central area is used as the initial depth information of the target subject. As such, when there is a user in the scene, the projection distance between the user and the depth camera 300 can be measured more accurately.

Referring to FIG. 9, in some embodiments, the control method after step 01 further includes:

04: Get the ambient brightness of the scene;

05: Calculate the target luminous power of the light transmitter 100 based on the ambient brightness and the projection distance; and

06: The light emitter 100 is controlled to emit light at the target light emission power.

Referring to FIG. 10, in some embodiments, the control device 90 further includes a second obtaining module 94 and a calculation module 95. Step 04 may be implemented by the second acquisition module 94. Step 05 may be implemented by the calculation module 95. Step 06 may be implemented by the control module 93. That is to say, the second acquisition module 94 can be used to acquire the ambient brightness of the scene. The calculation module 95 may be configured to calculate a target luminous power of the light transmitter 100 according to the ambient brightness and the projection distance. The control module 93 can also be used to control the light emitter 100 to emit light at a target light emission power.

Please refer to FIG. 1 again. In some embodiments, step 04, step 05, and step 06 can all be implemented by the processor 805. That is to say, the processor 805 can be used to obtain the ambient brightness of the scene, calculate the target light emitting power of the light transmitter 100 according to the environment brightness and the projection distance, and control the light transmitter 100 to emit light at the target light emitting power.

Among them, step 04, step 05, and step 02 may be performed synchronously, and steps 06 and 03 may be performed simultaneously. At this time, the processor 805 controls the light transmitter 100 to emit light at the target light emission frequency, and also controls the light transmitter 100 Light is emitted at the target light emission power.

Specifically, the ambient brightness can be detected by a light sensor. The processor 805 reads the ambient brightness it detects from the light sensor. Alternatively, the ambient brightness may also be detected by an infrared camera (which may be the light receiver 200) or the visible light camera 400. The infrared camera or the visible light camera 400 captures an image of the current scene, and the processor 805 calculates the brightness value of the image as the ambient brightness.

After determining the ambient brightness and the projection distance, the processor 805 calculates the target luminous power of the scene based on the two parameters of the ambient brightness and the projection distance. It can be understood that, first, when the ambient brightness is high, there are more infrared light components in the ambient light, and the infrared light in the ambient light and the infrared laser light emitted by the light transmitter 100 overlap with each other. When the optical receiver 200 receives both the infrared laser light emitted by the optical transmitter 100 and the infrared light in the ambient light, if the light emitting power of the infrared laser emitted by the optical transmitter 100 is low, the The ratio between the infrared laser light from the light transmitter 100 and the infrared light from the ambient light is not much different. This will cause the time point when the light receiver 200 receives the light is not accurate, or the values of Q1 and Q2 are not accurate enough. It will reduce the accuracy of acquiring depth information. Therefore, it is necessary to increase the transmission power of the infrared laser emitted by the optical transmitter 100 to reduce the influence of the infrared light in the environment on the optical receiver 200 receiving the infrared laser from the optical transmitter 100; When the brightness is low, the infrared light component contained in the ambient light is less. At this time, if the light emitter 100 emits light with a higher light emitting power, the power of the electronic device 800 will be increased. Consuming. In addition, when the projection distance is long, the flight time of the laser is long, the flight distance is long, and the loss of the laser is large, which further causes the values of Q1 and Q2 to be smaller, which affects the accuracy of the depth information acquisition. Therefore, when the projection distance is large, the transmission power of the infrared laser emitted by the optical transmitter 100 can be appropriately increased.

Specifically, when the ambient brightness is higher than the preset brightness and the projection distance is greater than a predetermined distance, the target light emitting power of the light transmitter 100 is greater than or equal to the first predetermined power P1. When the ambient brightness is less than the preset brightness and the projection distance is less than a predetermined distance, the target light emitting power of the light transmitter 100 is less than or equal to the second predetermined power P2. The first predetermined power P1 is greater than the second predetermined power P2. When the ambient brightness is greater than the preset brightness and the projection distance is less than a predetermined distance, or when the ambient brightness is less than the preset brightness and the projection distance is greater than a predetermined distance, the target light emitting power of the light transmitter 100 is between the second predetermined power P2 and the first predetermined power P1 In other words, the value range of the target luminous power of the optical transmitter 100 is (P2, P1).

In this way, jointly determining the target light emitting power of the light transmitter 100 based on the ambient brightness and the projection distance can reduce the power consumption of the electronic device 800 on the one hand and improve the accuracy of obtaining the depth information of the scene on the other.

Referring to FIG. 11, in some embodiments, calculating the projection distance according to the first scale in step 014 includes:

0141: Calculate the second proportion of the preset feature area of the human face in the captured image; and

0142: Calculate the projection distance according to the first scale and the second scale.

Referring to FIG. 12, in some embodiments, the second calculation unit 914 includes a first calculation sub-unit 9141 and a second calculation sub-unit 9142. Step 0141 may be implemented by the first calculation subunit 9141, and step 0142 may be implemented by the second calculation subunit 9142. That is to say, the first calculation subunit 9141 may be configured to calculate a second proportion of the preset feature area of the human face in the captured image to the human face. The second calculation subunit 9142 may be configured to calculate the projection distance according to the first scale and the second scale.

Please refer to FIG. 1 again. In some embodiments, step 0141 and step 0142 may both be implemented by the processor 805. That is to say, the processor 805 may be configured to calculate a second ratio of a preset feature area of a human face in the captured image to the human face, and calculate a projection distance according to the first ratio and the second ratio.

It can be understood that the face sizes of different users are different, so that when different users are at the same distance, the first proportion of the faces in the captured images is different. The second ratio is a ratio of the preset features of the human face to the human face. The preset feature area may select a feature area with a small difference between different user individuals. For example, the preset feature trend area is the binocular distance of the user. When the second ratio is large, the user's face is small, and the projection distance calculated based on the first ratio is too large; when the second ratio is small, the user's face is large, only based on the first The calculated projection distance is too small. In actual use, the first ratio, the second ratio, and the projection distance can be calibrated in advance. Specifically, the user is directed to stand at a predetermined projection distance position, collect a captured image, and then calculate a first calibration ratio and a second calibration ratio corresponding to the captured image, and store the predetermined projection distance, the first calibration ratio, and the second The corresponding relationship of the scales is calibrated, so as to calculate the projection distance according to the actual first scale and the second scale in subsequent use. For example, instruct the user to stand at a projection distance of 25 cm and collect the captured image, and then calculate the first calibration ratio corresponding to the captured image to be 50% and the second calibration ratio to be 10%. In actual measurement, when calculated, When the first ratio is R1 and the second ratio is R2, according to the similar properties of the triangle,

Among them, D1 is the initial projection distance calculated according to the actually measured first ratio R1, which can be further based on the relationship

A calibrated projection distance D2, which is further calculated according to the actually measured second ratio R2, is obtained, and D2 is used as the final projection distance. In this way, the projection distance calculated according to the first ratio and the second ratio takes into account the individual differences between different users, and can obtain a more objective projection distance. It can further determine a more accurate target light emission frequency based on a more accurate projection distance. And target luminous power.

Referring to FIG. 13, in some embodiments, calculating the projection distance according to the first proportion in step 014 includes:

0143: judging whether the target subject is wearing glasses based on the captured image; and

0144: Calculate the projection distance according to the first scale and the distance coefficient when the target subject wears glasses.

Referring to FIG. 14, in some embodiments, the second calculation unit 914 further includes a first determination sub-unit 9143 and a third calculation sub-unit 9144. Step 0143 may be implemented by the first judging subunit 9143. Step 0144 may be implemented by the third calculation subunit 9144. That is to say, the first judging sub-unit 9143 may be used to judge whether the target subject is wearing glasses according to the captured image, and the third calculating sub-unit 9144 may be used to calculate the projection distance according to the first ratio and the distance coefficient when the target subject is wearing glasses.

Please refer to FIG. 1 again. In some embodiments, step 0143 and step 0144 may be implemented by the processor 805. That is, the processor 805 may be further configured to determine whether the target subject is wearing glasses according to the captured image, and calculate the projection distance according to the first ratio and the distance coefficient when the target subject is wearing glasses.

It can be understood that whether the user wears glasses can be used to characterize the health status of the user's eyes. Specifically, if the user wears glasses, it indicates that the user's eyes have suffered from related eye diseases or poor eyesight. The optical transmitter 100 emits laser light to the user wearing the glasses. At this time, the light emitting power of the light transmitter 100 needs to be reduced so that the energy of the laser light emitted by the light transmitter 100 is small, so as not to cause damage to the eyes of the user. The preset distance coefficient can be a coefficient between 0 and 1, such as 0.6, 0.78, 0.82, 0.95, etc., for example, the initial projection distance is calculated according to the first ratio, or the first distance and the second ratio are calculated. After the calibrated projection distance, the initial projection distance or the calibrated projection distance is multiplied by the distance coefficient to obtain the final projection distance, and the target luminous power is determined according to the projection distance and the ambient brightness. In this way, it is possible to avoid that the power of the emitted laser is too large to hurt the user suffering from eye disease or poor vision.

Referring to FIG. 15, in some embodiments, calculating the projection distance according to the first scale in step 014 includes:

0145: judging the age of the target subject based on the captured image; and

0146: Calculate the projection distance according to the first ratio and age.

Referring to FIG. 16, in some embodiments, the second calculation unit 914 further includes a second determination sub-unit 9145 and a fourth calculation sub-unit 9146. Step 0145 may be implemented by the second judgment sub-unit 9145. Step 0146 may be implemented by the fourth calculation subunit 9146. That is to say, the second judging subunit 9145 can be used to judge the age of the target subject based on the captured image. The fourth calculation subunit 9146 may be configured to calculate the projection distance according to the first ratio and the age.

Please refer to FIG. 1 again. In some embodiments, step 0145 and step 0146 may be implemented by the processor 805. That is, the processor 805 may be further configured to determine the age of the target subject based on the captured image, and calculate the projection distance based on the first ratio and age.

People of different ages have different tolerances to infrared lasers. For example, children and the elderly are more susceptible to laser burns. For adults, lasers of appropriate intensity may cause harm to children. In this embodiment, the number, distribution, and area of feature points of facial wrinkles in the captured image can be extracted to determine the user's age, for example, the number of wrinkles at the corners of the eyes can be used to determine the user's age, or further combined with the user's forehead How many wrinkles are there to determine the user's age. After judging the user's age, the proportion coefficient can be obtained according to the age of the user. Specifically, the correspondence between age and the proportion coefficient can be found in a query table. For example, when the age is under 15 years, the proportion coefficient is 0.6 and the age is between When the age is 15 to 20, the scale factor is 0.8; when the age is 20 to 45, the scale factor is 1.0; when the age is 45 or more, the scale factor is 0.8. After knowing the scale factor, the initial projection distance calculated from the first scale or the calibrated projection distance calculated from the first and second scales can be multiplied by the scale factor to obtain the final projection distance. Determine the target luminous power according to the projection distance and the ambient brightness. In this way, excessive power of the emitted laser can be avoided to hurt young users or older users.

Please refer to FIG. 1 and FIG. 17 together. In some embodiments, the electronic device 800 according to the embodiment of the present application further includes a housing 801. The housing 801 may serve as a mounting carrier for the functional elements of the electronic device 800. The housing 801 can provide protection for the functional elements from dust, drop, and water. The functional elements can be a display screen 802, a visible light camera 400, a receiver, and the like. In the embodiment of the present application, the housing 801 includes a main body 803 and a movable bracket 804. The movable bracket 804 can move relative to the main body 803 under the driving of a driving device. For example, the movable bracket 804 can slide relative to the main body 803 to slide. Enter or slide out of the main body 803 (as shown in FIG. 17). Some functional elements (such as the display 802) can be installed on the main body 803, and other functional elements (such as the depth camera 300, the visible light camera 400, and the receiver) can be installed on the movable bracket 804. The movement of the movable bracket 804 can drive the other A part of the functional elements is retracted into or protruded from the main body 803. Of course, FIG. 1 and FIG. 17 are merely examples of a specific form of the casing 801, and cannot be understood as a limitation on the casing 801 of the present application.

The depth camera 300 is mounted on a casing 801. Specifically, the housing 801 may be provided with an acquisition window, and the depth camera 300 is aligned with the acquisition window to enable the depth camera 300 to acquire depth information. In a specific embodiment of the present application, the depth camera 300 is mounted on a movable bracket 804. When the user needs to use the depth camera 300, he can trigger the movable bracket 804 to slide out from the main body 803 to drive the depth camera 300 to protrude from the main body 803. When the depth camera 300 is not needed, the movable bracket 804 can be triggered to slide in The main body 803 is retracted into the main body by driving the depth camera 300.

Please refer to FIG. 18 to FIG. 20 together. In some embodiments, in addition to the light transmitter 100 and the light receiver 200, the depth camera 300 further includes a first substrate assembly 71 and a spacer 72. The first substrate assembly 71 includes a first substrate 711 and a flexible circuit board 712 connected to each other. The spacer 72 is disposed on the first substrate 711. The light emitter 100 is used for projecting laser light outward, and the light emitter 100 is disposed on the cushion block 72. The flexible circuit board 712 is bent and one end of the flexible circuit board 712 is connected to the first substrate 711 and the other end is connected to the light emitter 100. The light receiver 200 is disposed on the first substrate 711. The light receiver 200 is configured to receive laser light reflected by a person or an object in the target space. The light receiver 200 includes a housing 741 and an optical element 742 provided on the housing 741. The housing 741 is integrally connected with the pad 72.

Specifically, the first substrate assembly 71 includes a first substrate 711 and a flexible circuit board 712. The first substrate 711 may be a printed wiring board or a flexible wiring board. A control circuit of the depth camera 300 and the like may be laid on the first substrate 711. One end of the flexible circuit board 712 may be connected to the first substrate 711, and the other end of the flexible circuit board 712 is connected to the circuit board 50 (shown in FIG. 20). The flexible circuit board 712 can be bent at a certain angle, so that the relative positions of the devices connected at both ends of the flexible circuit board 712 can be selected.

The spacer 72 is disposed on the first substrate 711. In one example, the spacer 72 is in contact with the first substrate 711 and is carried on the first substrate 711. Specifically, the spacer 72 may be combined with the first substrate 711 by means of adhesion or the like. The material of the spacer 72 may be metal, plastic, or the like. In the embodiment of the present application, a surface on which the pad 72 is combined with the first substrate 711 may be a flat surface, and a surface on which the pad 72 is opposite to the combined surface may also be a flat surface, so that the light emitter 100 is disposed on the pad 72. It has better smoothness.

The light receiver 200 is disposed on the first substrate 711, and the contact surface between the light receiver 200 and the first substrate 711 is substantially flush with the contact surface between the pad 72 and the first substrate 711 (that is, the installation starting point of the two is at On the same plane). Specifically, the light receiver 200 includes a housing 741 and an optical element 742. The casing 741 is disposed on the first substrate 711, and the optical element 742 is disposed on the casing 741. The casing 741 may be a lens holder and a lens barrel of the light receiver 200, and the optical element 742 may be an element such as a lens disposed in the casing 741. Further, the light receiver 200 further includes a photosensitive chip (not shown), and the laser light reflected by a person or an object in the target space passes through the optical element 742 and is irradiated into the photosensitive chip, and the photosensitive chip responds to the laser. In the embodiment of the present application, the housing 741 and the cushion block 72 are integrally connected. Specifically, the casing 741 and the cushion block 72 may be integrally formed; or the materials of the casing 741 and the cushion block 72 are different, and the two are integrally formed by two-color injection molding or the like. The housing 741 and the spacer 72 may also be separately formed, and the two form a matching structure. When assembling the depth camera 300, one of the housing 741 and the spacer 72 may be set on the first substrate 711, and then the other The first substrate 711 is integrally connected with each other.

In this way, the light transmitter 100 is disposed on the pad 72, which can increase the height of the light transmitter 100, thereby increasing the height of the surface on which the laser is emitted by the light transmitter 100. The laser light emitted by the light transmitter 100 is not easily received by the light The device 200 is blocked, so that the laser light can be completely irradiated on the measured object in the target space.

Please refer to FIG. 18 to FIG. 20 together. In some embodiments, the side where the cushion block 72 is combined with the first substrate 711 is provided with a receiving cavity 723. The depth camera 300 further includes an electronic component 77 provided on the first substrate 711. The electronic component 77 is housed in the receiving cavity 723. The electronic component 77 may be an element such as a capacitor, an inductor, a transistor, or a resistor. The electronic component 77 may be electrically connected to a control line laid on the first substrate 711 and used for or controlling the operation of the light transmitter 100 or the light receiver 200. The electronic component 77 is housed in the receiving cavity 723, and the space in the pad 72 is used reasonably. It is not necessary to increase the width of the first substrate 711 to set the electronic component 77, which is beneficial to reducing the overall size of the depth camera 300. The number of the receiving cavities 723 may be one or more, and the receiving cavities 723 may be spaced apart from each other. When mounting the pad 72, the receiving cavity 723 and the electronic component 77 may be aligned and the pad 72 may be disposed on the first substrate 711.

Please continue to refer to FIG. 18 to FIG. 20 together. In some embodiments, the cushion block 72 is provided with an avoiding through hole 724 connected to at least one receiving cavity 723, and at least one electronic component 77 extends into the avoiding through hole 724. It can be understood that when the electronic component 77 needs to be accommodated in the avoiding through hole, the height of the electronic component 77 is required to be not higher than the height of the receiving cavity 723. For electronic components having a height higher than the receiving cavity 723, an avoiding through hole 724 corresponding to the receiving cavity 723 may be provided, and the electronic component 77 may partially extend into the avoiding through hole 724 so as not to increase the height of the cushion 72. Arranges the electronic component 77.

Please refer to FIGS. 18 to 20 together. In some embodiments, the first substrate assembly 711 further includes a reinforcing plate 713, and the reinforcing plate 713 is coupled to a side of the first substrate 711 opposite to the pad 72. The reinforcing plate 713 may cover one side of the first substrate 711, and the reinforcing plate 713 may be used to increase the strength of the first substrate 711 and prevent deformation of the first substrate 711. In addition, the reinforcing plate 713 may be made of a conductive material, such as metal or alloy. When the depth camera 300 is mounted on the electronic device 800, the reinforcing plate 713 may be electrically connected to the casing 801 to ground the reinforcing plate 713. And the interference of the static electricity of the external components on the depth camera 300 is effectively reduced.

Please refer to FIG. 18 to FIG. 20 again. In some embodiments, the depth camera 300 further includes a connector 76 connected to the first substrate assembly 71 and used to electrically connect with electronic components external to the depth camera 300. connection.

Referring to FIG. 21, in some embodiments, the light receiver 100 includes a light source 10, a diffuser 20, a lens barrel 30, a protective cover 40, a circuit board 50, and a driver 61.

Wherein, the lens barrel 30 includes a ring-shaped lens barrel sidewall 33, and the ring-shaped lens barrel sidewall 33 surrounds a receiving cavity 62. The side wall 33 of the lens barrel includes an inner surface 331 located in the receiving cavity 62 and an outer surface 332 opposite to the inner surface. The side wall 33 of the lens barrel includes a first surface 31 and a second surface 32 opposite to each other. The receiving cavity 62 penetrates the first surface 31 and the second surface 32. The first surface 31 is recessed toward the second surface 32 to form a mounting groove 34 communicating with the receiving cavity 62. The bottom surface 35 of the mounting groove 34 is located on a side of the mounting groove 34 remote from the first surface 31. The outer surface 332 of the side wall 33 of the lens barrel is circular at one end of the first surface 31, and the outer surface 332 of the side wall 33 of the lens barrel is formed with an external thread at one end of the first surface 31.

The circuit board 50 is disposed on the second surface 32 of the lens barrel 30 and closes one end of the receiving cavity 62. The circuit board 50 may be a flexible circuit board or a printed circuit board.

The light source 10 is carried on the circuit board 50 and received in the receiving cavity 62. The light source 10 is configured to emit laser light toward the first surface 31 (the mounting groove 34) side of the lens barrel 30. The light source 10 may be a single-point light source or a multi-point light source. When the light source 10 is a single-point light source, the light source 10 may specifically be an edge-emitting laser, for example, a distributed feedback laser (Distributed Feedback Laser, DFB), etc .; when the light source 10 is a multi-point light source, the light source 10 may specifically be vertical A cavity-surface emitter (Vertical-Cavity Surface Laser, VCSEL), or the light source 10 is also a multi-point light source composed of multiple edge-emitting lasers. The vertical cavity surface emitting laser has a small height, and the use of the vertical cavity surface emitter as the light source 10 is beneficial to reducing the height of the light emitter 100 and facilitating the integration of the light emitter 100 into a mobile phone and other requirements on the thickness of the fuselage. Electronic device 800. Compared with the vertical cavity surface emitter, the temperature drift of the side-emitting laser is smaller, and the influence of the temperature on the effect of the projected laser light from the light source 10 can be reduced.

The driver 61 is carried on the circuit board 50 and is electrically connected to the light source 10. Specifically, the driver 61 may receive the modulated input signal, and convert the input signal into a constant current source and transmit it to the light source 10, so that the light source 10 is directed toward the first side 31 of the lens barrel 30 under the action of the constant current source. Laser is emitted on one side. The driver 61 of this embodiment is provided outside the lens barrel 30. In other embodiments, the driver 61 may be disposed in the lens barrel 30 and carried on the circuit board 50.

The diffuser 20 is mounted (supported) in the mounting groove 34 and abuts the mounting groove 34. The diffuser 20 is used to diffuse the laser light passing through the diffuser 20. That is, when the light source 10 emits laser light toward the first surface 31 side of the lens barrel 30, the laser light passes through the diffuser 20 and is diffused or projected outside the lens barrel 30 by the diffuser 20.

The protective cover 40 includes a top wall 41 and a protective sidewall 42 extending from one side of the top wall 41. A light through hole 401 is defined in the center of the top wall 41. The protective side wall 42 is disposed around the top wall 41 and the light through hole 401. The top wall 41 and the protection side wall 42 together form a mounting cavity 43, and the light-passing hole 401 communicates with the mounting cavity 43. The cross-section of the inner surface of the protective sidewall 42 is circular, and an inner thread is formed on the inner surface of the protective sidewall 42. The internal thread of the protective sidewall 42 is screwed with the external thread of the lens barrel 30 to mount the protective cover 40 on the lens barrel 30. The top wall 41 abuts the diffuser 20 so that the diffuser 40 is sandwiched between the top wall 41 and the bottom surface 35 of the mounting groove 34.

In this way, the opening 20 is installed in the lens barrel 30, and the diffuser 20 is installed in the installation groove 34, and the protective cover 40 is installed on the lens barrel 30 to clamp the diffuser 20 between the protective cover 40 and the installation groove. 34 between the bottom surfaces 35 so that the diffuser 20 can be fixed on the lens barrel 30. In this way, it is not necessary to fix the diffuser 20 to the lens barrel 30 by using glue, which can prevent the glue from solidifying on the surface of the diffuser 20 and affecting the microstructure of the diffuser 20 after the glue is volatilized to a gaseous state. When the glue with the lens barrel 30 decreases due to aging, the diffuser 20 falls off from the lens barrel 30.

Please refer to FIG. 22 and FIG. 23 together. In some embodiments, when adjusting the light emitting power of the light emitter 100, it can be achieved by adjusting the driving current that drives the light emitter 100 to emit light. In addition, if the light source 10 of the light emitter 100 is a vertical cavity surface emitter, the structure of the vertical cavity surface emitter at this time may be:

(1) The vertical cavity surface emitter includes a plurality of point light sources 101, which form a plurality of independently controllable fan-shaped arrays 11, and the plurality of fan-shaped arrays 11 surround a circle (as shown in FIG. 22) or a polygon ( (Not shown), at this time, the light emitting power of the light emitter 100 can be achieved by turning on the point light sources 101 of different numbers of the fan-shaped arrays 11, that is, the target light-emitting power corresponds to the target number of the turned-on fan-shaped arrays. When the fan-shaped array is not fully turned on, the part of the fan-shaped array that is turned on should be symmetrically distributed in the center, so that the laser light emitted by the light emitter 100 can be made more uniform.

(2) The vertical cavity surface emitter includes a plurality of point light sources 101, and the plurality of point light sources 101 form a plurality of sub-arrays 12, and the plurality of sub-arrays 12 include at least one circular sub-array and at least one circular sub-array, and at least one circular sub-array. And at least one circular sub-array is enclosed in a circle (as shown in FIG. 23), or the multiple sub-arrays 12 include at least one polygonal sub-array and at least one circular sub-array Polygon (not shown). At this time, the light emitting power of the light transmitter 100 can be adjusted by turning on the point light sources 101 of different numbers of the sub-arrays 12, that is, the target of the light-emitting power and the opened sub-arrays 12 Correspondence of quantity.

For example, in conjunction with FIG. 1, FIG. 2, and FIG. 24, the program 807 includes instructions for performing the following steps:

For another example, in conjunction with FIG. 5 and FIG. 24, the program 807 further includes instructions for performing the following steps:

011: Get the captured image of the scene;

014: Calculate the projection distance according to the first ratio.

For another example, in conjunction with FIG. 7, the program 807 further includes instructions for performing the following steps:

For another example, in conjunction with FIG. 9, the program 807 further includes instructions for performing the following steps:

04: Get the ambient brightness of the scene;

For another example, in conjunction with FIG. 11, the program 807 further includes instructions for performing the following steps:

For another example, in conjunction with FIG. 13, the program 807 further includes instructions for performing the following steps:

For another example, in conjunction with FIG. 15, the program 807 further includes instructions for performing the following steps:

0145: judging the age of the target subject based on the captured image; and

0146: Calculate the projection distance according to the first ratio and age.

For example, in conjunction with FIG. 1, FIG. 2, and FIG. 25, the computer program 902 may be executed by the processor 805 to complete the following steps:

For another example, in conjunction with FIG. 5 and FIG. 25, the computer program 902 can also be executed by the processor 805 to complete the following steps:

011: Get the captured image of the scene;

014: Calculate the projection distance according to the first ratio.

For another example, in conjunction with FIG. 7, the computer program 902 can also be executed by the processor 805 to complete the following steps:

For another example, in conjunction with FIG. 9, the computer program 902 can also be executed by the processor 805 to complete the following steps:

04: Get the ambient brightness of the scene;

For another example, in conjunction with FIG. 11, the computer program 902 can also be executed by the processor 805 to complete the following steps:

For another example, in conjunction with FIG. 13, the computer program 902 can also be executed by the processor 805 to complete the following steps:

For another example, in conjunction with FIG. 15, the computer program 902 may also be executed by the processor 805 to complete the following steps:

0145: judging the age of the target subject based on the captured image; and

0146: Calculate the projection distance according to the first ratio and age.

In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, material, or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Moreover, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "a plurality" is at least two, for example, two, three, etc., unless it is specifically and specifically defined otherwise.

Any process or method description in a flowchart or otherwise described herein can be understood as a module, fragment, or portion of code that includes one or more executable instructions for implementing a particular logical function or step of a process And, the scope of the preferred embodiments of this application includes additional implementations in which the functions may be performed out of the order shown or discussed, including performing the functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present application pertain.

Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those skilled in the art may, within the scope of the present application, understand the above. Embodiments are subject to change, modification, substitution, and modification.

Claims

A control method of an optical transmitter, characterized in that the control method includes:

Obtaining a projection distance between the light emitter and a target subject in the scene;

Determining a target light emission frequency of the light emitter according to the projection distance; and

Controlling the light emitter to emit light at the target emission frequency.
The control method according to claim 1, wherein the step of obtaining a projection distance between the light emitter and a target subject in a scene comprises:

Acquiring a captured image of the scene;

Processing the captured image to determine whether a human face exists in the captured image;

Calculating a first proportion of the human face in the captured image when the human face is present in the captured image; and

Calculating the projection distance according to the first ratio.
The control method according to claim 1, wherein the step of obtaining a projection distance between the light emitter and a target subject in a scene comprises:

Controlling the light emitter to emit light at a predetermined light emission frequency to detect initial depth information of the scene; and

A projection distance between the light emitter and the target subject is calculated according to the initial depth information.
The control method according to claim 2, wherein the control method further comprises:

Obtaining the ambient brightness of the scene;

Calculating a target luminous power of the light transmitter according to the ambient brightness and the projection distance; and

Controlling the light emitter to emit light at the target light emitting power.
The control method according to claim 4, wherein the step of calculating the projection distance according to the first ratio comprises:

Calculating a second ratio of the preset feature area of the human face in the captured image to the human face; and

Calculate the projection distance according to the first ratio and the second ratio.
The control method according to claim 4, wherein the calculating the projection distance according to the first ratio comprises:

Determining whether the target subject is wearing glasses according to the captured image; and

When the target subject wears glasses, calculate the projection distance according to the first scale and a distance coefficient.
The control method according to claim 4, wherein the step of calculating the projection distance according to the first ratio comprises:

Judging the age of the target subject based on the captured image; and

Calculate the projection distance according to the first ratio and the age.
A control device for a light transmitter, characterized in that the control device includes:

A first acquisition module, configured to acquire a projection distance between the light emitter and a target subject in a scene;

A determining module for determining a target light emitting frequency of the light transmitter according to the projection distance; and

A control module for controlling the light emitter to emit light at the target emission frequency.
The control device according to claim 8, wherein the first acquisition module comprises:

A first obtaining unit, configured to obtain a captured image of the scene;

A processing unit, configured to process the captured image to determine whether a human face exists in the captured image;

A first calculation unit, configured to calculate a first proportion of the human face in the captured image when the human face is present in the captured image; and

A second calculation unit is configured to calculate the projection distance according to the first ratio.
The control device according to claim 8, wherein the first obtaining module comprises:

A first control unit for controlling the light emitter to emit light at a predetermined light emission frequency to detect initial depth information of the scene; and

A third calculation unit is configured to calculate a projection distance between the light emitter and the target subject according to the initial depth information.
The control device according to claim 9, wherein the control device further comprises:

A second acquisition module, configured to acquire the ambient brightness of the scene; and

A calculation module, configured to calculate a target luminous power of the light transmitter according to the ambient brightness and the projection distance;

The control module is further configured to control the light emitter to emit light at the target light emitting power.
The control device according to claim 9, wherein the second calculation unit comprises:

A first calculation subunit, configured to calculate a second proportion of the preset feature area of the face in the captured image to the face; and

A second calculation subunit is configured to calculate the projection distance according to the second ratio and the second ratio.
The control device according to claim 9, wherein the second calculation unit comprises:

A first determining subunit, configured to determine whether the target subject is wearing glasses according to the captured image; and

A third calculation subunit is configured to calculate the projection distance according to the first scale and a distance coefficient when the target subject wears glasses.
The control device according to claim 9, wherein the second calculation unit comprises:

A second determining subunit, configured to determine the age of the target subject according to the captured image; and

A fourth calculation subunit is configured to calculate the projection distance according to the first ratio and the age.
A depth camera, characterized in that the depth camera includes a light emitter and a processor; the processor is used for:

Obtaining a projection distance between the light emitter and a target subject in the scene;

Determining a target light emission frequency of the light emitter according to the projection distance; and

Controlling the light emitter to emit light at the target emission frequency.
The depth camera according to claim 15, wherein the processor is further configured to:

Acquiring a captured image of the scene;

Processing the captured image to determine whether a human face exists in the captured image;

Calculating a first proportion of the human face in the captured image when the human face is present in the captured image; and

Calculating the projection distance according to the first ratio.
The depth camera according to claim 15, wherein the processor is further configured to:

Controlling the light emitter to emit light at a predetermined light emission frequency to detect initial depth information of the scene; and

A projection distance between the light emitter and the target subject is calculated according to the initial depth information.
The depth camera according to claim 16, wherein the processor is further configured to:

Obtaining the ambient brightness of the scene;

Calculating a target luminous power of the light transmitter according to the ambient brightness and the projection distance; and

Controlling the light emitter to emit light at the target light emitting power.
The depth camera according to claim 18, wherein the processor is further configured to:

Calculating a second ratio of the preset feature area of the human face in the captured image to the human face; and

Calculate the projection distance according to the first ratio and the second ratio.
The depth camera according to claim 18, wherein the processor is further configured to:

Determining whether the target subject is wearing glasses according to the captured image; and

When the target subject wears glasses, calculate the projection distance according to the first scale and a distance coefficient.
The depth camera according to claim 18, wherein the processor is further configured to:

Judging the age of the target subject based on the captured image; and

Calculate the projection distance according to the first ratio and the age.
An electronic device is characterized in that the electronic device includes:

The depth camera according to any one of claims 15-21;

One or more processors;

Memory; and

One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the programs include instructions for performing any of claims 1 to 7 An instruction for a control method as described.
A computer-readable storage medium, comprising a computer program used in combination with an electronic device, the computer program being executable by a processor to complete the control method according to any one of claims 1 to 7.