WO2019213864A1

WO2019213864A1 - Three-dimensional target mapping apparatus, personal identification apparatus and electronic device

Info

Publication number: WO2019213864A1
Application number: PCT/CN2018/086151
Authority: WO
Inventors: 王小明
Original assignee: 深圳阜时科技有限公司
Priority date: 2018-05-09
Filing date: 2018-05-09
Publication date: 2019-11-14
Also published as: CN108780502A

Abstract

A light source projection apparatus, a three-dimensional target mapping apparatus, a personal identification apparatus, and an electronic device. The light source projection apparatus comprises: a light source (201); a pattern component (203) provided in the direction of the light emitted by the light source (201), the pattern component (203) being provided with a bitmap pattern, wherein the bitmap pattern is arranged in a grid; and an optical element (205) provided in the direction of the light emitted by the light source (201), the optical element being used to transmit the light emitted by the light source (201) passing through the pattern component (203).

Description

Three-dimensional mapping device, identification device and electronic device for target

Technical field

The present application relates to a device for mapping a three-dimensional (3D) object, and an identification device and an electronic device including a 3D mapping device for a target.

Background technique

At present, there are more and more fields of 3D image sensing applications, such as automobiles, aviation, molds, medical, intelligent terminals, drones, robots, etc. However, the current 3D mapping method is complicated and the cost is high. It is not conducive to its rapid spread in industrialization.

Summary of the invention

In view of this, the present application is directed to providing a light source projection device, a 3D mapping device for an object, an identification device, and an electronic device to reduce the amount of calculation of the 3D mapping and reduce the cost of the 3D mapping.

The application provides a light source projection device, including:

light source;

a pattern member disposed in a light exiting direction of the light source, wherein the pattern member is provided with a dot matrix pattern, wherein the dot pattern is arranged in a grid;

An optical element is disposed in a light exiting direction of the light source for transmitting light emitted from the light source and passing through the pattern member.

In some embodiments, each grid has only a spot on each side.

In certain embodiments, the grid is square.

In some embodiments, each side of each grid of the dot pattern has at least three spots.

In some embodiments, each side of the grid pattern has three, four, or five spots per side.

In some embodiments, each side of each grid of the dot pattern has a length of 7 mm.

In certain embodiments, the spot has a diameter of 1 mm.

In some embodiments, the light source projection device projects a bitmap image with a range of 40 cm.

In some embodiments, the lattice pattern is used to modulate a light beam from the source to produce structured light.

In some embodiments, the light source is an array light source or a backlight.

In some embodiments, the backlight is an LCD light source.

In some embodiments, the array source is a VCSEL source.

In certain embodiments, the pattern component includes a glass substrate that is provided to carry the lattice pattern.

In some embodiments, the dot pattern is a metallic material.

In certain embodiments, the optical element is a lens or group of lenses.

In some embodiments, the optical element is used to function as a diffused beam and far field imaging.

In some embodiments, a collimating element is disposed between the light source and the pattern element.

The application also provides a 3D mapping device for a target, comprising:

The light source projection device according to any one of the preceding claims, wherein the dot pattern is projected to a target, wherein the dot pattern is arranged in a grid;

An image sensing device for capturing an image of a dot pattern on the target; and

a processor for processing an image of the captured lattice pattern to derive a 3D map of the target.

The present application further provides an identification device, comprising: an identification module and the above-mentioned 3D mapping device; the identification module is configured to perform identity recognition according to a 3D image of a target derived by the 3D mapping device.

In some embodiments, the identification device comprises a face recognition device.

The present application also provides an electronic device comprising the light source projection device of any of the above, or the device comprising the above-described 3D mapping for a target, or the above-described identity recognition device.

Compared with the prior art light source projection device, since the dot pattern projected onto the target by the light source projection device of the present application is arranged in a grid, only the spot on each side of the mesh is provided, and therefore, the number of projected spots Less, but the three-dimensional sensing based on the lattice pattern arranged in the grid can satisfy the judgment accuracy requirement of the 3D recognition and can be realized by the optical system, thereby facilitating the reduction of the calculation amount of the subsequent 3D mapping and recognition, thereby Conducive to reducing the cost of 3D mapping and identification.

Other features and advantages of the present application will become apparent from the following description of the exemplary embodiments.

DRAWINGS

The accompanying drawings, which are incorporated in FIG In the drawings, like reference numerals are used to refer to the like. The drawings in the following description are some embodiments of the present application, and not all embodiments. Other figures may be obtained from those of ordinary skill in the art in light of the inventive work.

1 is a structural block diagram of a 3D mapping apparatus for a target according to a first embodiment of the present application;

2 is a dot pattern provided by a second embodiment of the present application;

FIG. 3 is another dot pattern provided by the third embodiment of the present application; FIG.

4 is a schematic structural diagram of a light source projection device according to a fourth embodiment of the present application;

FIG. 5 is a schematic structural diagram of a light source projection device according to a fifth embodiment of the present application; FIG.

FIG. 6 is a structural block diagram of an identity recognition apparatus according to a sixth embodiment of the present application;

FIG. 7 is a schematic structural diagram of an electronic device according to a seventh embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application. It should be noted that, in the case of no conflict, the features in the embodiments and the embodiments in the present application may be arbitrarily combined with each other.

The following disclosure provides many different embodiments or examples for implementing the different structures of the present application. In order to simplify the disclosure of the present application, the components and settings of the specific examples are described below. Of course, they are merely examples and are not intended to limit the application. In addition, the present application may repeat reference numerals and/or reference numerals in the various examples, which are for the purpose of simplicity and clarity, and do not indicate the relationship between the various embodiments and/or settings discussed.

Further, the described features, structures may be combined in one or more embodiments in any suitable manner. In the following description, numerous specific details are set forth However, those skilled in the art should appreciate that the technical solution of the present application can be practiced without one or more of the specific details, or other structures, components, and the like. In other instances, well-known structures or operations are not shown or described in detail to avoid obscuring the application.

The method for 3D mapping of a target involved in the implementation of the present application will be described in detail below with reference to the accompanying drawings.

Referring to FIG. 1 , FIG. 1 is a 3D mapping apparatus 100 for a target according to an embodiment of the present application. The 3D mapping device 100 for the target includes:

a light source projection device 101, configured to project a dot pattern to a target, wherein the dot pattern is arranged in a grid;

An image sensing device 103 for capturing an image of a dot pattern on the target; and

The processor 105 is configured to process an image of the captured dot pattern to derive a 3D map of the target.

The dot pattern projected by the light source projection device 101 is, for example, infrared structured light.

Accordingly, the image sensing device 103 is, for example, an infrared image sensing device.

The processor 105 processes the image generated by the image sensing device 103 to derive a 3D map of the target. Wherein the 3D map refers to the 3D coordinate set of the target surface in the present application.

In an example, the processor 105 can obtain the horizontal and vertical coordinates and the intensity information according to the image generated by the image sensing device 103, and further obtain the depth information on the target according to the intensity information, thereby combining the horizontal and vertical coordinates to obtain the 3D image of the target. .

The processor 105 can include a general purpose computer processor that executes software to implement the corresponding functions. The software may be stored to the processor 105 by download or by being stored on a computer readable medium and then read and executed by the processor 105.

In the specific operation, each grid has only a spot on each side, and the grid is preferably, for example, a square. Each edge of each grid of the dot pattern can have at least three spots. As shown in Figure 2, there are three spots on each side of each grid of the dot pattern. It can also be set to four spots according to actual needs. Alternatively, as shown in FIG. 3, each side of each grid of the dot pattern has five spots. Of course, the number and size of the spots on each side of each grid can also be set according to actual needs.

Specifically, the length of each side of each mesh of the mesh pattern is, for example, 7 mm; the diameter of the spot is, for example, 1 mm; or/and the range of the projected image of the light source projection device 101 is, for example, 40 cm. It should be understood that the above various parameters are set forth by way of example only and should not be construed as limiting.

It can be understood that the light source projection device 101, the image sensing device 103, and the processor 105 can be integrated or set separately.

In this embodiment, the light source projection device 101 projects a dot pattern in a grid arrangement, that is, each grid of the dot pattern has only a spot on each side, and the dot pattern is projected onto the target by the image sensing device. 103 acquires an image of the dot pattern on the target, and then the processor 105 processes the image of the captured dot pattern to derive a 3D map of the target.

Since the dot pattern projected onto the target by the 3D mapping device 400 of the present application is arranged in a grid, only the side of the mesh is provided with a light spot, and therefore, the number of projected light spots is small, but based on the dot pattern The 3D sensing device can satisfy the 3D mapping and the judgment accuracy requirement in the post-identification, and can be realized by the optical system. Therefore, the target 3D mapping device 400 of the present application is advantageous for reducing the calculation amount of the 3D mapping, thereby Helps reduce the cost of 3D mapping.

Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of an embodiment of a light source projection device 101 provided by the present application. The light source projection device 101 includes a light source 201, a pattern member 203, and an optical element 205. The pattern member 203 is disposed in the illumination direction of the light source 201. A preset pattern is provided on the pattern member 203. The optical element 205 is disposed in the illumination direction of the light source 201. The pattern member 203 is disposed between the light source 201 and the optical element 205. The optical element 205 transmits light that is emitted from the light source 201 and passes through the pattern member 203. The optical element 205 is used to function as a diffused beam and far field imaging.

It should be noted that the light source 201 may be formed by forming a surface light source at a certain distance (preset distance), and the specific type is not limited. Further, the light source 201 can be an array light source or a backlight. Specifically, the backlight is, for example, an LCD (Liquid Crystal Display) light source. The array source is, for example, a VCSEL source.

Further, the pattern member 203 includes a glass substrate provided with a predetermined pattern. Specifically, the glass substrate is, for example, a glass substrate for fabricating an LCD. The preset pattern can be made of a metal material, that is, the predetermined pattern can be made of metal on the glass substrate, and of course, it can be made by other methods, and should not be limitedly understood. The shape of the preset pattern can be changed according to actual needs to complete the projection of different types of patterns. In this embodiment, the preset pattern is a dot pattern and arranged in a web format.

In particular, the optical element 14 is for example a lens or a lens group.

The working principle of the pattern projection device 101 of the present embodiment is briefly described as follows: the light source 201 emits a light beam, and a pattern member 203 of a predetermined pattern is disposed in the illumination direction. After the light emitted by the light source 201 passes through the pattern member 203, the transmitted light is carried. The information of the preset pattern is transmitted through the optical element 205 disposed in the illumination direction, thereby completing the entire projection process.

Since the combination scheme of the pattern member 203 and the optical element 205 is easy to design and low in cost, the light source projection device 101 of the present application can reduce design and production costs compared to the conventional pattern projection device.

Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of another embodiment of a light source projection device 101 provided by the present application. In the present embodiment, the light source projection device 101 further includes a collimating element 207 disposed between the light source 201 and the pattern member 203 for aligning the light beams emitted from the light source 201 to form a parallel The light beam; after entering the pattern member 203, the parallel beam is modulated into patterned structured light.

However, in other embodiments, the light source projection device 101 may be other suitable devices, and is not limited to the above embodiments.

In addition, the above description may be implemented individually or in combination in various ways, and these modifications are all within the scope of the present application.

Please refer to FIG. 6. FIG. 6 is a structural block diagram of an identity recognition apparatus according to an embodiment of the present application. The identity recognition device 400 includes an identification module 401 and a 3D mapping device 100 for the target. The identification module 401 is configured to perform identity recognition according to a 3D map of the target derived by the device 400.

Specifically, the identification module 401 compares, for example, the 3D map of the target derived by the device 400 with the pre-stored 3D map. If the matching is successful, the identity of the target is confirmed to be valid, and the identity authentication succeeds. Otherwise, the identity authentication is performed. failure.

The pre-stored 3D is stored, for example, in a memory.

Since the identity identification device 400 has a method for 3D mapping of a target and corresponding technical features and technical effects of the device 400, details are not described herein.

Please refer to FIG. 7. FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 500 includes an identity recognition device 400.

The electronic device 500 corresponds to whether the corresponding function is executed according to the identity recognition result of the identity recognition device 400. The respective functions are, for example but not limited to, any one or more of an application including unlocking, paying, and starting a pre-stored application.

The electronic device 500 is, for example but not limited to, a suitable type of electronic product such as a consumer electronic product, a home electronic product, a vehicle-mounted electronic product, a financial terminal product, or the like. Among them, consumer electronic products such as but not limited to mobile phones, tablets, notebook computers, desktop monitors, computer integrated machines. Home-based electronic products such as, but not limited to, smart door locks, televisions, refrigerators, wearable devices, and the like. Vehicle-mounted electronic products such as, but not limited to, car navigation systems, car DVDs, and the like. The financial terminal products are, for example, but not limited to ATM machines, terminals for self-service business, and the like.

In the present embodiment, the electronic device 500 will be described as an example of a mobile phone. The mobile phone is, for example, a full-screen mobile phone, and the identification device 400 is disposed, for example, at the front top of the mobile phone. Of course, the mobile phone is not limited to a full screen mobile phone.

For example, when the user needs to perform boot unlocking, the screen that lifts the mobile phone or touches the mobile phone can function to wake up the identity recognition device 400. When the identity recognition device 400 is woken up and recognizes that the user in front of the mobile phone is a legitimate user, the screen is unlocked.

Of course, the identity recognition device 400 in the electronic device 500 can also be replaced with the target 3D mapping device 100.

Compared with the prior art, the 3D mapping device 100 for the target of the present application is advantageous for reducing the calculation amount of the 3D mapping, thereby reducing the cost of the 3D mapping. Therefore, the identity recognition device 400 and the electronic device of the present application are provided. The cost of 500 is lower.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example", or "some examples", etc. The specific features, structures, materials, or characteristics described in the embodiments or examples are included in at least one embodiment or example of the application. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

The above description may be implemented individually or in combination in various ways, and such modifications are within the scope of the present application.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions described in the foregoing embodiments may be modified or equivalently substituted for some of the technical features. Modifications or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A light source projection device, comprising:

light source;

a pattern member disposed in a light exiting direction of the light source, wherein the pattern member is provided with a dot matrix pattern, wherein the dot pattern is arranged in a grid;

An optical element is disposed in a light exiting direction of the light source for transmitting light emitted from the light source and passing through the pattern member.
A light source projection apparatus according to claim 1, wherein each of the grids has only a spot on each side.
The light source projection device of claim 1 wherein said grid is square.
The light source projection apparatus according to claim 3, wherein each of said grids of said dot pattern has at least three spots on each side.
The light source projection apparatus according to claim 4, wherein each of said grids of said dot pattern has three, four, or five spots on each side.
The light source projection device according to any one of claims 1 to 5, wherein each of the sides of the lattice pattern has a length of 7 mm.
The light source projection device according to any one of claims 1 to 5, wherein the spot has a diameter of 1 mm.
The light source projection device according to any one of claims 1 to 5, wherein the light source projection device projects a dot image with a range of 40 cm.
A light source projection apparatus according to claim 1, wherein the dot pattern is used to modulate a light beam from the light source to generate structured light.
The light source projection device of claim 1, wherein the light source is an array light source or a backlight.
A light source projection device according to claim 10, wherein said backlight source is an LCD light source.
The light source projection device of claim 10 wherein said array source is a VCSEL source.
A light source projection device according to claim 1, wherein said pattern member comprises a glass substrate provided with said dot pattern.
The light source projection device according to claim 1, wherein the dot pattern is made of a metal material.
A light source projection apparatus according to claim 1, wherein said optical element is a lens or a lens group.
The light source projection device of claim 1 wherein said optical element is for functioning as a diffused beam and far field imaging.
The light source projection device according to claim 1, wherein a collimating element is disposed between the light source and the pattern element.
A 3D mapping device for a target, comprising:

The light source projection device according to any one of claims 1 to 17 for projecting a dot pattern to a target, wherein the dot pattern is arranged in a grid;

An image sensing device for capturing an image of a dot pattern on the target; and

a processor for processing an image of the captured lattice pattern to derive a 3D map of the target.
An identification device, comprising: an identification module and the 3D mapping device according to claim 18; the identification module is configured to perform identity recognition according to a 3D map of the target derived by the 3D mapping device.
The identity recognition device of claim 19, wherein the identity recognition device comprises a face recognition device.
An electronic device comprising the light source projection device according to any one of claims 1 to 17, or the device for the 3D mapping of the object according to claim 18, or the method of claim 19 or 20 The identification device described.