CN220896765U - Far and near vision compatible RGB camera, imaging module and electronic equipment - Google Patents

Abstract

The application provides a far and near vision compatible RGB camera, an imaging module and electronic equipment, and relates to the technical field of optical detection. Based on the method, the long-range view function and the short-range view function of the imaging module can be considered only by one RGB camera, so that the memory power consumption and the development cost of the electronic equipment are reduced, and the resource waste is avoided.

Description

Far and near vision compatible RGB camera, imaging module and electronic equipment

Technical Field

The application relates to the technical field of optical detection, in particular to a long-and-short-range compatible RGB camera, an imaging module and electronic equipment.

Background

In recent years, with the continuous popularity of new payment methods (i.e., face-brushing payment methods), the traditional 2D face ID (i.e., two-dimensional face-brushing authentication method) cannot meet the needs of users, so that the 3D face ID (i.e., three-dimensional face-brushing authentication method) is widely applied to electronic devices such as mobile phones and tablet computers, wherein the most common expression form is an imaging module set in the electronic devices, and the imaging module can realize face-brushing authentication functions such as payment, unlocking and the like, and can also realize functions such as self-timer, code scanning and the like.

In the related art, an imaging module generally includes an emitting portion and an acquisition portion, which emits a light beam to a target through the emitting portion, and the light beam reflected back by the target is received by the acquisition portion, and then the acquisition portion can generate a corresponding image according to the received light beam, so as to perform subsequent operations such as face recognition and the like according to the generated image. Specifically, the acquisition part generally includes a front-end acquisition unit and a rear-end acquisition unit, wherein the front-end acquisition unit is used for realizing functions of face recognition, self-timer and the like of a distant object (such as a face of a user), and the rear-end acquisition unit is used for realizing a code scanning function of a close-range object (such as a one-dimensional code, a two-dimensional code and the like), that is, the front-end acquisition unit for realizing the face recognition function and the rear-end acquisition unit for realizing the code scanning function in the imaging module are relatively independent, and because the distance between the rear-end acquisition unit and the close-range object is relatively short in a code scanning scene, the rear-end acquisition unit is required to be subjected to professional micro-range design, and therefore, the memory power consumption and the development cost of the electronic equipment can be increased undoubtedly, and serious resource waste of the electronic equipment is caused.

Therefore, there is a need for an improvement in the above-described acquisition portion of an imaging module.

Disclosure of utility model

The application provides a long-and-short-range compatible RGB camera, an imaging module and electronic equipment, and aims to solve the problems that in the related art, the acquisition part of the imaging module can increase the memory power consumption and development cost of the electronic equipment and cause serious resource waste of the electronic equipment.

In order to solve the above technical problems in the related art, a first aspect of the present application provides a near-far view compatible RGB camera, which is applied to an imaging module configured with an IR camera and includes a lens unit and an image sensor disposed opposite to the lens unit; the lens unit is used for receiving the light beam reflected by the distant view target or the close view target and projecting the light beam to the image sensor; the image sensor is used for carrying out photoelectric conversion on the light beam and obtaining a corresponding RGB image; the RGB image of the near view target is used for realizing the near view function of the imaging module, the RGB image of the far view target is used for being combined with the IR image of the far view target acquired by the IR camera so as to realize the far view function of the imaging module, the near view function is a code scanning function, and the far view function is face brushing authentication. Further, the RGB camera further comprises a filtering unit, the filtering unit is arranged between the lens unit and the image sensor, and the filtering unit is used for filtering out background light in light beams received by the RGB camera.

Specifically, the distance between the lens unit and the image sensor is the image distance of the RGB camera, the image distance is determined by the focusing process before the RGB camera is put into use, the image distance enables the RGB camera to meet the preset resolution requirement, the preset resolution requirement indicates that the RGB image of the distant view target meets the distant view definition requirement, and the RGB image of the close view target meets the close view definition requirement.

A second aspect of the embodiment of the present application provides an imaging module, including an emitter, an IR camera, a control and processor, and the RGB camera according to the first aspect of the embodiment of the present application; wherein the emitter is for emitting a structured light patterned beam toward a distant or close-range target; the IR camera is used for receiving the structured light patterned beam reflected by the distant-view target or the close-view target and generating a corresponding IR image according to the structured light patterned beam; the RGB camera is used for receiving the structured light patterned beam reflected by the distant view target or the close view target and generating a corresponding RGB image according to the structured light patterned beam; the control and processor is used for receiving the IR image and the RGB image and realizing a near view function according to the RGB image of the near view target or realizing a far view function according to the IR image and the RGB image of the far view target.

A third aspect of the embodiment of the present application provides an electronic device, including the imaging module set mentioned in the second aspect of the embodiment of the present application.

As can be seen from the above description, the present application has the following advantageous effects compared with the related art: the distance between the lens unit and the image sensor is the image distance of the RGB camera, the image distance is an important parameter of the RGB camera, and any imaging module needs to be focused (namely, the image distance is adjusted) before the imaging module is put into use.

Drawings

In order to more clearly illustrate the technical solutions of the related art or embodiments of the present application, the drawings that are required to be used in the description of the related art or embodiments of the present application will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, but not all embodiments, and that other drawings may be obtained according to these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a schematic diagram of an imaging module according to an embodiment of the present application;

Fig. 2 is a schematic structural diagram of an RGB camera according to an embodiment of the present application;

FIG. 3 is a schematic diagram of depth of field calculation according to an embodiment of the present application;

fig. 4 is a diagram showing an effect of resolving power after focusing of an RGB camera according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more obvious and understandable, the present application will be clearly and completely described below with reference to the embodiments of the present application and the corresponding drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. It should be understood that the following embodiments of the present application are only for explaining the present application and are not intended to limit the present application, that is, all other embodiments obtained by persons skilled in the art without making any inventive effort based on the embodiments of the present application are within the scope of protection of the present application. Furthermore, the technical features referred to in the embodiments of the present application described below may be combined with each other as long as they do not make a conflict with each other.

In the related art, an imaging module in an electronic device such as a mobile phone, a tablet computer and the like generally includes an emitting portion and a collecting portion, wherein the emitting portion emits a light beam to a target (a distant target or a close target), and the light beam reflected by the target is received by the collecting portion, and then the collecting portion can generate a corresponding image according to the received light beam, so as to perform subsequent operations of face recognition, code scanning and the like according to the corresponding image. Specifically, the acquisition part generally includes a front-end acquisition unit and a rear-end acquisition unit, wherein the front-end acquisition unit is used for realizing functions of face recognition, self-timer and the like of a distant object (such as a face of a user), and the rear-end acquisition unit is used for realizing a code scanning function of a close-range object (such as a one-dimensional code, a two-dimensional code and the like), that is, the front-end acquisition unit for realizing the face recognition function and the rear-end acquisition unit for realizing the code scanning function in the imaging module are relatively independent, and because the distance between the rear-end acquisition unit and the close-range object is relatively short in the code scanning scene, the rear-end acquisition unit is required to be subjected to professional micro-design, and the functions can increase memory power consumption and development cost of the electronic equipment, so that serious resource waste of the electronic equipment is caused. Therefore, the embodiment of the application provides an imaging module which is different from the traditional scheme, and the imaging module is mainly different from the traditional scheme in that a long-and-short-range compatible RGB camera is adopted, and through the RGB camera, not only can a front collector and a rear collector in the traditional scheme be integrated, but also the professional macro design of the rear collector in the traditional scheme can be perfectly avoided, so that the purposes of reducing the memory power consumption and the development cost of the electronic equipment and avoiding the resource waste of the electronic equipment are achieved.

Fig. 1 is a schematic structural diagram of an imaging module according to an embodiment of the present application, in some embodiments, the imaging module 10 includes an emitter 11, an IR camera (not shown), an RGB camera 12, and a control and processor 13, where the emitter 11, the IR camera, and the RGB camera 12 are electrically connected to the control and processor 13, respectively, i.e. the emitter 11, the IR camera, and the RGB camera 12 all operate under the control of the control and processor 13. In practical applications, the emitter 11 may emit the structured light patterned beam 30 to the distant view target 20, the IR camera may receive the structured light patterned beam 30 reflected by the distant view target 20 and generate a corresponding IR image according to the structured light patterned beam 30 received by itself, the RGB camera 12 may receive the light beam reflected by the distant view target 20 to generate an RGB image, the reflected light beam is natural light, and then the control and processor 13 may receive the IR image from the IR camera and the RGB image from the RGB camera 12 and implement the distant view function according to the IR image and the RGB image of the distant view target; or when the function is realized, the RGB camera can shoot the image of the close-range target to obtain an RGB image, and the close-range function is realized according to the RGB image of the close-range target. The distant view function may include, but is not limited to, a face recognition and self-timer function for a face, and the close view function may include, but is not limited to, a code scanning function for a one-dimensional code, a two-dimensional code, and the like.

It should be understood that in the imaging module 10, the front and rear positions do not need to be distinguished as in the conventional scheme, and only one RGB camera 12 is needed, because the RGB camera 12 is specially designed according to the present application, and regarding which kind of special design, the present application will be described in detail in the following embodiments for the RGB camera 12. In addition, when the imaging module 10 performs the long-range functions such as face recognition and self-timer shooting, the IR image and the RGB image need to be combined, because the RGB image can assist the IR image to perform background segmentation, and the purpose is to obtain the face region of the long-range target, so as to perform face verification, living body detection, and the like.

As one example, the emitter 11 includes a light source 111, an emitting optical element 112, and a driver 113, in practical applications, the light source 111 may be driven by the driver 113 (which may be further controlled by the control and processor 13) to project a light beam to the emitting optical element 112, and the emitting optical element 112 may modulate the received light beam after receiving the light beam projected by the light source 111, and project the modulated structured light patterned light beam 30 to the target 20 in space; modulation of the light beam by the transmitting optical element 112 may include, but is not limited to, collimation, beam expansion, diffraction, and shaping, or even a combination of many of these modulations. In some implementations of the present embodiment, the emission optical element 112 may employ a combination of one or more lenses, microlens arrays, diffractive Optical Elements (DOEs), diffusion sheets (diffusers), wave sheets, and the like; in addition, the emission optical element 112 may be split into a plurality of optical elements according to different modulation operations performed by the emission optical element 112, for example, the emission optical element 112 may be configured as a collimating lens and a wave plate that are sequentially arranged, in which case the collimating lens may collimate the light beam emitted by the light source 111, and the wave plate may shape the collimated light beam so that the structured light patterned beam 30 that is directed to the target 20 is a structured light beam with a predetermined pattern, such as a linear array structured light beam. In some implementations of the present embodiment, the light source 111 may be a single light source 111 such as a Light Emitting Diode (LED), an edge-emitting laser (EEL), a Vertical Cavity Surface Emitting Laser (VCSEL), or a VCSEL array light source chip formed by generating a plurality of VCSELs on a monolithic semiconductor substrate.

The RGB camera 12 includes an image sensor 121, and the image sensor 121 may be an array type image sensor composed of a Charge Coupled Device (CCD), a Complementary Metal Oxide Semiconductor (CMOS), etc., and the size of the array represents the resolution of the imaging module 10, such as 320×240, etc.

As an embodiment, the control and processor 13 may use a separate dedicated circuit, such as a dedicated SOC chip, FPGA chip, ASIC chip, etc. composed of a Central Processing Unit (CPU), a memory, a bus, etc., or may use a general purpose processing circuit, such as a processing circuit in an electronic device, such as a mobile phone, a television, a tablet computer, a smart wearable device, etc., as at least a part of the control and processor 13 when the imaging module 10 is integrated into the electronic device.

The above embodiments are merely preferred implementations of the present application, and are not intended to be the only limitations on the content of the imaging module 10; in this regard, those skilled in the art can flexibly set according to the actual application scenario on the basis of the above embodiments. In addition, the purpose of reducing the memory power consumption and development cost of the electronic device and avoiding the resource waste of the electronic device is to adopt the RGB camera 12 in the imaging module 10, and the RGB camera 12 will be described in detail below.

Fig. 2 shows a schematic structural diagram of an RGB camera 12 according to an embodiment of the application, in some embodiments, the RGB camera 12 further includes a lens unit 123 and a circuit board 124 in addition to the aforementioned image sensor 121, wherein the lens unit 123 is disposed opposite to the image sensor 121, and the circuit board 124 is electrically connected to the image sensor 121. In practical applications, the lens unit 123 may receive the light beam reflected by the target 20 (distant or close view target) and project the received light beam to the image sensor 121, the image sensor 121 may photoelectrically convert the light beam received by itself and obtain a corresponding RGB image, and the circuit board 124 may be used to transmit the RGB image. Further, the RGB camera 12 further includes a filtering unit 122, the filtering unit 122 is disposed between the lens unit 123 and the image sensor 121, and the filtering unit 122 is configured to filter out the background light in the light beam received by the RGB camera 12.

In the embodiment of the present application, the distance between the lens unit 123 and the image sensor 121 is the image distance of the RGB camera 12, and the image distance is determined by the focusing process (i.e. the process of adjusting the image distance) before the RGB camera 12 is put into use, and the purpose of focusing is: the (focused image distance) is such that the RGB camera 12 meets a preset resolution requirement indicating that the RGB image of the distant subject meets the distant definition requirement and the RGB image of the close subject meets the close definition requirement. After the above objective is achieved in the focusing process before the RGB camera 12 is put into use, the near-view function of the imaging module 10 can be achieved by using the RGB image of the near-view target, and the far-view function of the imaging module 10 can be achieved by using the RGB image and the IR image of the far-view target.

It will be appreciated that the image distance is an important parameter of the RGB camera, and any imaging module needs to perform focusing (i.e. adjust the image distance) before the imaging module 10 is put into use, and similarly, in the focusing process before the imaging module 10 is put into use, the final image distance of the RGB camera 12 is determined by adjusting the distance between the lens unit 123 and the image sensor 121, and the adjustment is based on the final image distance of the RGB camera 12, so that the RGB camera 12 meets the preset resolution requirement, that is, the RGB image of the distant view target meets the distant view definition requirement, and the RGB image of the close view target also meets the close view definition requirement, the long-range view definition requirements enable long-range view functions (such as face-brushing authentication and self-shooting) of long-range view targets to be achieved, and close-range view definition requirements enable close-range view functions (such as code scanning) of close-range view targets to be achieved, namely, compared with the traditional scheme that two collectors (namely a front collector and a rear collector) are required to be arranged to respectively achieve the long-range view functions and the close-range view functions of an imaging module, the long-range view functions and the close-range view functions of the imaging module 10 can be achieved through only one RGB camera 12, and the method is equivalent to integrating the front collector and the rear collector in the traditional scheme, and avoids the micro-range design of the rear collector in the traditional scheme, so that the memory power consumption and the development cost of the electronic equipment can be effectively reduced, and the resource waste of the electronic equipment is avoided.

As one example, the RGB camera 12 may include, in addition to the image sensor 121, the lens unit 123 and the circuit board 124, a lens holder 125, where the lens holder 125 has a receiving cavity, the lens unit 123 and the image sensor 121 are disposed in the receiving cavity, the circuit board 124 may be disposed in the receiving cavity or outside the receiving cavity, and an outer edge of the lens unit 123 is screwed with an inner wall of the lens holder 125. It will be appreciated that, since the outer edge of the lens unit 123 is screwed to the inner wall of the lens holder 125, the lens unit 123 may be moved away from/close to the image sensor 121 by rotating the lens unit 123 relative to the lens holder 125, that is, during focusing before the imaging module 10 is put into use, the distance between the lens unit 123 and the image sensor 121 may be adjusted by rotating the lens unit 123 relative to the lens holder 125, that is, the image distance is adjusted, and the image distance for the RGB camera 12 to meet the preset resolution requirement is finally determined, and the image distance is fixed after focusing is completed (that is, after the imaging module 10 is put into use).

The focusing principle before the imaging module 10 is put into use will be briefly described with reference to a schematic diagram of the depth of field calculation provided by the embodiment of the present application shown in fig. 3. The imaging module 10 has the following relation:

；

Where u denotes an object distance, v denotes an image distance, F denotes a focal length of the lens unit 123, DOF denotes a depth of field (when the object distance is close to a focusing distance, the image distance is close to the focal length, the imaging plane is close to the focal plane, a calculation formula of the depth of field can be simplified as described above), L denotes the focusing distance, δ denotes an allowable circle diameter, F denotes an aperture value of photographing, Δl1 denotes a front depth of field, Δl2 denotes a rear depth of field, Δl denotes a depth of field, and it can be seen from the above-described relational expression that the rear depth of field is larger than the front depth of field.

It will be appreciated that the greater (far) the object distance, the smaller the image distance; conversely, the smaller (near) the object distance, the larger the image distance; when the object distance is infinite (infinity), the image distance is equal to the focal length. Thus, the above relationship can be further transformed and described as: the higher the lens unit 123 (the farther from the image sensor 121), the greater the image distance, and the closer the corresponding object distance (the closer the depth of field); conversely, the shorter the lens unit 123 (the closer to the image sensor 121), the smaller the image distance, and the farther the corresponding object distance (the farther the depth of field). Therefore, in focusing, the final image distance can be determined by adjusting the distance between the lens unit 123 and the image sensor 121, but in the embodiment of the present application, a distance range of 30 to 100cm is taken as a distant target, a distance range of 15 to 25cm is taken as a near target, preferably 70cm is taken as a limit distance (i.e., not more than 70 cm) of the distant target, and 16cm is taken as a limit distance (i.e., not less than 16 cm) of the near target.

Specifically, during actual focusing, the lens unit 123 is rotated to the lowest position (i.e., closest to the image sensor 121) by rotating the lens unit 123 relative to the lens holder 125, so that the image captured by the imaging module 10 becomes a completely blurred state; then, 16cm limit focusing of the close-range object is performed, that is, the lens unit 123 is gradually rotated upwards (in a direction away from the image sensor 121) to a target position by rotating the lens unit 123 relative to the lens holder 125, and the lens unit 123 and the lens holder 125 are fixed by dispensing, wherein the image distance determined by the target position indicates that the resolution of the imaging module 10 under the close-range object of 16cm meets the specification a (preset resolution requirement) as shown in fig. 4, and the resolution represented by the specification a means that the RGB image of the close-range object meets the close-range resolution requirement; then, it is checked whether the resolution of the imaging module 10 under the perspective target of 70cm meets the specification B (preset resolution requirement) shown in fig. 4, and the resolution represented by the specification B means that the RGB image of the perspective target meets the perspective definition requirement, if so, the focusing is successfully completed, in which case, the imaging module 10 can consider the perspective function and the near-perspective function only by using a single RGB camera 12, and if not, the focusing needs to be performed again. Of course, in the actual focusing process, the 70cm limit focusing of the distant view target may be performed first, and then it may be checked whether the resolving power of the imaging module 10 under the close view target of 16cm meets the specification a as shown in fig. 4. It should be noted that, taking the example of 16cm limit focusing of the close-range object, in this process, it is necessary to continuously change the position between the lens unit 123 and the image sensor 121, and take corresponding images to determine whether the resolution requirement (i.e. the specification a) of the close-range object is satisfied, and the object position can be obtained through such multiple determinations; of course, when determining whether the resolving power of the imaging module 10 under a close-range object of 16cm meets the specification a shown in fig. 4, the captured image should be a barcode image such as a one-dimensional code, a two-dimensional code, etc., and when determining whether the resolving power of the imaging module 10 under a distant-range object of 70cm meets the specification B shown in fig. 4, the captured image should be a face image. In addition, it should be noted that, as for the inexhaustible point in the above description of the focusing process, reference should be made to the focusing method in the related art, and the embodiments of the present application will not be described in detail.

The above embodiments are merely preferred implementations of the present application, and are not intended to be the only limitations on the content associated with the RGB camera 12; in this regard, those skilled in the art can flexibly set according to the actual application scenario on the basis of the above embodiments. In addition, in a preferred embodiment of the present application, the lens unit 123 is a 4P plastic lens, the focal length is f=2.51 mm, the aperture fno=2.0, the resolution of the sensor is 2592×1944, the pixel size is 1.4um, the filter uses a visible light (420-680 nm) infrared cut filter, the blue glass material, 16cm limit focusing, equivalent to 28cm peak focusing, and a theoretical view of the imaging module 10 is given herein as follows.

It should be noted that, in the present disclosure, each embodiment is described in a progressive manner, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other. For product class embodiments, the description is relatively simple as it is similar to method class embodiments, as relevant points are found in the partial description of method class embodiments.

It should also be noted that in the present disclosure, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. The utility model provides a long-and-short view compromise formula RGB camera, its characterized in that is applied to the imaging module that disposes the IR camera, RGB camera includes:

A lens unit for receiving a light beam reflected by a distant or close-range object and projecting the light beam to an image sensor;

The image sensor is arranged opposite to the lens unit and is used for carrying out photoelectric conversion on the light beam and obtaining a corresponding RGB image; the RGB image of the near view target is used for realizing the near view function of the imaging module, and the RGB image of the far view target is used for being combined with the IR image of the far view target acquired by the IR camera so as to realize the far view function of the imaging module;

the near view function is a code scanning function, and the far view function is a face brushing authentication.

2. The near-far view compatible RGB camera of claim 1, wherein a distance between the lens unit and the image sensor is an image distance of the RGB camera, the image distance is determined by a focusing process before the RGB camera is put into use, the image distance is such that the RGB camera meets a preset resolution requirement, the preset resolution requirement indicates that the RGB image of the far view target meets a far view definition requirement, and the RGB image of the near view target meets a near view definition requirement.

3. The near-far view compatible type RGB camera according to claim 1, further comprising a lens seat having a containing cavity, wherein the lens unit and the image sensor are both disposed in the containing cavity, and an outer edge of the lens unit is in threaded connection with an inner wall of the lens seat.

4. The near-far RGB camera according to claim 1, further comprising a filtering unit disposed between the lens unit and the image sensor, the filtering unit configured to filter out background light in the light beam.

5. An imaging module, comprising:

An emitter for emitting a structured light patterned beam toward a distant target;

The IR camera is used for receiving the structured light patterned beam reflected by the distant target and generating a corresponding IR image according to the structured light patterned beam;

The RGB camera of any one of claims 1 to 4, configured to receive a light beam reflected from the distant or close range object and generate a corresponding RGB image;

And the control and processor is used for receiving the IR image and the RGB image and realizing a near view function according to the RGB image of the near view target or realizing a far view function according to the IR image and the RGB image of the far view target.

6. The imaging module of claim 5, wherein the emitter comprises:

a light source for emitting a structured light patterned beam to an emitting optical element;

The emission optical element is used for modulating the structured light patterned beam and projecting the modulated structured light patterned beam to a distant target.

7. The imaging module of claim 6, wherein the emitter further comprises a driver for driving the light source to emit the structured light patterned beam.

8. The imaging module of claim 6, wherein the modulation comprises at least one of collimation, beam expansion, diffraction, and shaping.

9. The imaging module of claim 6, wherein the emission optical element is configured as a combination of one or more of a lens, a microlens array, a diffractive optical element, a diffuser, and a waveplate.

10. An electronic device comprising an imaging module according to any one of claims 5 to 9.