CN112839217A - 4D camera device and electronic equipment - Google Patents
4D camera device and electronic equipment Download PDFInfo
- Publication number
- CN112839217A CN112839217A CN201911171938.9A CN201911171938A CN112839217A CN 112839217 A CN112839217 A CN 112839217A CN 201911171938 A CN201911171938 A CN 201911171938A CN 112839217 A CN112839217 A CN 112839217A
- Authority
- CN
- China
- Prior art keywords
- target object
- light
- image
- imaging module
- spectrometer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 75
- 230000003595 spectral effect Effects 0.000 claims abstract description 23
- 239000006185 dispersion Substances 0.000 claims description 47
- 230000003287 optical effect Effects 0.000 claims description 23
- 238000001228 spectrum Methods 0.000 claims description 18
- 239000000919 ceramic Substances 0.000 abstract description 6
- 239000013078 crystal Substances 0.000 abstract description 5
- 238000012986 modification Methods 0.000 description 27
- 230000004048 modification Effects 0.000 description 27
- 238000010586 diagram Methods 0.000 description 16
- 238000000034 method Methods 0.000 description 9
- 230000010354 integration Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 235000013305 food Nutrition 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 235000013361 beverage Nutrition 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 239000008267 milk Substances 0.000 description 2
- 210000004080 milk Anatomy 0.000 description 2
- 235000013336 milk Nutrition 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003915 air pollution Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 125000002887 hydroxy group Chemical group [H]O* 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
- 238000003911 water pollution Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The invention provides a 4D camera device and electronic equipment, which comprise a spectrometer, a 3D camera and a processor module, wherein the spectrometer is connected with the 3D camera; the 3D camera comprises a light projector, a first imaging module and a second imaging module; a light projector for projecting light toward a target object; the first imaging module is used for receiving the reflected light of the target object and obtaining a depth image of the surface of the target object according to the reflected light; the second imaging module is used for acquiring a 2D image of the target object; the spectrometer is used for receiving the reflected light of the target object and generating spectral information of the reflected light of the target object; and the processor module is used for generating a 3D image of the target object according to the depth image and the 2D image of the surface of the target object, and further judging the authenticity of the target object according to the spectral information and the 3D image. The invention can identify the authenticity of the target object by integrating the 3D image and the spectral information, improves the accuracy of authenticity identification, and can be applied to identification of antique and famous ceramic products or crystal products and the like.
Description
Technical Field
The invention relates to the technical field of depth sensing equipment, in particular to a 4D camera device and electronic equipment.
Background
In recent years, with the development of the consumer electronics industry, the 3D camera having the depth sensing function is receiving increasing attention from the consumer electronics world. The current well-established depth measurement method is a structured light scheme, i.e. a specific structured light pattern is projected on an object, and then the depths of different positions of the object are calculated through the deformation or displacement of the pattern.
Structured light three-dimensional vision is based on the principle of optical triangulation. The optical projector projects the structured light with a certain mode on the surface of the object to form a light bar three-dimensional image modulated by the surface shape of the object to be measured on the surface. The three-dimensional image is detected by a camera at another location to obtain a two-dimensional distorted image of the light bar. The degree of distortion of the light bar depends on the relative position between the optical projector and the camera and the object surface profile (height). Intuitively, the displacement or offset displayed along the bar is proportional to the height of the object surface, and the kink indicates a change in plane, and the discontinuity indicates a physical gap in the surface. When the relative position between the optical projector and the camera is fixed, the three-dimensional profile of the object surface can be reproduced by the distorted two-dimensional light bar image coordinates.
The tof (time of flight) technique is a 3D imaging technique that emits measurement light from a projector and reflects the measurement light back to a receiver through a target object, thereby obtaining a spatial distance from the object to a sensor from a propagation time of the measurement light in the propagation path. Common ToF techniques include single point scanning projection methods and area light projection methods.
The spectrometer is a scientific instrument which decomposes light with complex components into spectral lines and is composed of a prism or a diffraction grating and the like, and the spectrometer can be used for measuring light rays reflected by the surface of an object. The seven colors of sunlight are visible light, but if the sunlight is decomposed by a spectrometer and arranged according to wavelength, the visible light occupies a small range in the spectrum, and the rest is a spectrum which cannot be distinguished by naked eyes, such as infrared rays, microwaves, ultraviolet rays, X rays and the like. The optical information is captured by a spectrometer, developed by a photographic negative film, or displayed and analyzed by a computerized automatic display numerical instrument, so that the element contained in the article can be detected. This technique is widely used in the detection of air pollution, water pollution, food hygiene, metal industry, and the like.
However, after searching the prior art, the prior art has no device for combining the spectrometer and the 3D camera.
Disclosure of Invention
In view of the defects in the prior art, the invention aims to provide a 4D camera device and an electronic device.
The 4D camera device provided by the invention comprises a spectrometer, a 3D camera and a processor module;
the 3D camera comprises a light projector, a first imaging module and a second imaging module;
the light projector is used for projecting light to a target object;
the first imaging module is used for receiving the reflected light of the target object and obtaining a depth image of the surface of the target object according to the reflected light;
the second imaging module is used for acquiring a 2D image of the target object;
the spectrometer is used for receiving the reflected light of the target object and generating spectral information of the reflected light of the target object;
the processor module is used for generating a 3D image of the target object according to the depth image and the 2D image of the surface of the target object, and further judging the authenticity of the target object according to the spectral information and the 3D image.
Preferably, the method for judging the authenticity of the target object comprises the following steps:
step S1: acquiring an identification pattern or identification characters of the target object on the 3D image, and determining a pre-stored image model corresponding to the target object according to the identification pattern or the identification characters;
step S2: comparing the 3D image with the image model, and triggering step S3 when the matching degree of the 3D image and the image model is greater than the threshold value of the matching degree of a preset value;
step S3: and determining the element content of the target object according to the spectrum information, and determining the authenticity of the target object according to the element content.
Preferably, the first imaging module comprises a first filter and a first image sensor;
the spectrometer comprises a dispersion element, wherein the dispersion element is used for carrying out dispersion and light splitting on the reflected light so as to form a spectrum distribution with sequentially arranged wavelengths on the first image sensor;
the dispersion element is arranged on the light-in side face, the light-out side face or the light-sensitive surface of the first optical filter.
Preferably, the second imaging module comprises a second filter and a second image sensor;
the spectrometer comprises a dispersion element, wherein the dispersion element is used for carrying out dispersion and light splitting on the reflected light of the target object so as to form spectral distribution with sequentially arranged wavelengths on the second image sensor;
the dispersion element is arranged on the light-in side face, the light-out side face or the light-sensitive surface of the second optical filter.
Preferably, the dispersive element employs any one of the following optical devices;
-a planar diffraction grating;
-a prism;
-an optical waveguide device.
Preferably, the image sensor is provided with a dispersion detector; the dispersion detector is used for detecting the spectral distribution;
the dispersion detector is a partial area of the image sensor or an independent detector.
Preferably, the spectrometer is arranged inside the 3D camera;
or the spectrometer is arranged at one end or one side face of the 3D camera, and the light inlet of the spectrometer is the same as the light inlet of the first imaging module and the light inlet of the second imaging module in direction.
Preferably, the light projector employs a discrete light beam projector for projecting a plurality of discrete collimated light beams towards the target object;
the first imaging module is used for receiving the scattered and collimated light beams reflected by the target object and obtaining the depth image of the surface of the target object according to a light spot pattern formed by a plurality of the scattered and collimated light beams.
Preferably, the light projector employs a surface light source projector for projecting floodlight towards the target object;
and the second imaging module is used for receiving floodlight reflected by the target object and obtaining a depth image of the surface of the target object according to the propagation time of the floodlight.
Preferably, the discrete beam projector comprises an edge-emitting laser and a beam projector disposed on an optical path;
the edge-emitting laser is used for projecting laser to the beam projector;
the beam projector is used for projecting the incident laser light into a plurality of discrete collimated light beams.
Preferably, the discrete beam projector comprises a laser array, a collimating lens and a beam splitting device arranged on an optical path;
the laser array is used for projecting laser of a first order of magnitude to the collimating lens;
the collimating lens is used for collimating the incident multiple laser beams and then emitting collimated light beams with a first order of magnitude;
the beam splitting device is used for splitting the incident collimated light beam with the first order of magnitude to emit a collimated light beam with a second order of magnitude;
the second order of magnitude is greater than the first order of magnitude.
Preferably, the 3D camera comprises a driving circuit connected to the light projector and the second imaging module;
the driving circuit is used for controlling the light projector and the second imaging module to be simultaneously turned on or off and controlling the output light power of the light projector by controlling the driving current of the light projector.
The electronic equipment provided by the invention comprises the 4D camera device.
Compared with the prior art, the invention has the following beneficial effects:
according to the invention, the 3D image of the target object is acquired through the 3D camera, and the spectral information of the target object is acquired through the spectrometer, so that the authenticity of the target object can be identified by integrating the 3D image and the spectral information, the authenticity identification accuracy is improved, and the method can be applied to identification of antique and famous and precious ceramic products or crystal products and the like; in addition, the integrated spectrometer and the 3D camera can be loaded on the electronic equipment, so that a user can conveniently call the spectrometer and the 3D camera, and the application scene of the electronic equipment is enlarged; according to the invention, the dispersion element is arranged on the light-in side surface, the light-out side surface or the light-sensitive surface of the image sensor, so that the integration of the spectrometer and the 3D camera is realized, and the integration cost is reduced; the invention not only can combine the spectrometer and the 3D camera, but also can independently call the spectrometer and the 3D camera, for example, the spectrometer is independently called to carry out food safety monitoring, fruit component detection, component content in milk, protein content in body-building beverage, even fat content of human body and the like.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts. Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
fig. 1 is a schematic structural diagram of a 4D imaging device in an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a 4D imaging device according to a first modification of the present invention;
FIG. 3 is a flowchart illustrating steps for determining authenticity of the target object according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the operation of a spectrometer according to a variation of the present invention;
fig. 5 is a schematic structural diagram of a 4D imaging device according to a second modification of the present invention;
fig. 6 is a schematic structural diagram of a 4D imaging device according to a third modification of the present invention;
fig. 7 is a schematic structural diagram of a 4D imaging device according to a fourth modification of the present invention;
fig. 8 is a schematic structural diagram of a 4D imaging device according to a fifth modification of the present invention;
fig. 9 is a schematic structural view of a 4D imaging device according to a sixth modification of the present invention;
fig. 10 is a schematic structural diagram of an image sensor in an embodiment of the invention.
In the figure:
1 is a lens of a 3D camera; 101 is a light projector; 102 is a second imaging module; 103 is a first imaging module; 104 is a driving circuit; 105 is a processor module; 1031 is a first filter; 1032 is the first image sensor; 1033 is a dispersion detector; 2 is a spectrometer; 201 is a dispersive element; 3 is a lens of the RGB camera; 301 is a second filter segment; 302 is a second image sensor.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. The connection may be for fixation or for circuit connection.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for convenience in describing the embodiments of the present invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed in a particular orientation, and be in any way limiting of the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
In the embodiment of the invention, the 4D camera device provided by the invention comprises a spectrometer, a 3D camera and a processor module 105;
the 3D camera comprises a light projector 101, a first imaging module 103 and a second imaging module 102;
the light projector 101 for projecting light to a target object;
the first imaging module 103 is configured to receive reflected light of the target object, and obtain a depth image of the surface of the target object according to the reflected light;
the second imaging module 102 is configured to acquire a 2D image of the target object;
the spectrometer 2 is used for receiving the target object reflected light and generating spectral information of the target object reflected light;
the processor module 105 is configured to generate a 3D image of the target object according to the depth image and the 2D image of the surface of the target object, and further determine whether the target object is true or false according to the spectral information and the 3D image.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, so that the above is the core idea of the present invention, and the above objects, features and advantages of the present invention can be more clearly understood. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic structural diagram of a 4D imaging device in an embodiment of the present invention, and as shown in fig. 1, the 4D imaging device provided by the present invention includes a spectrometer 2, a 3D camera 1, and a processor module 105;
the 3D camera 1 comprises a light projector 101, a first imaging module 103 and a second imaging module 102;
the light projector 101 for projecting light to a target object;
the first imaging module 103 is configured to receive reflected light of the target object, and obtain a depth image of the surface of the target object according to the reflected light;
the second imaging module 102 is configured to acquire a 2D image of the target object;
the spectrometer 2 is used for receiving the target object reflected light and generating spectral information of the target object reflected light;
the processor module 105 is configured to generate a 3D image of the target object according to the depth image and the 2D image of the surface of the target object, and further determine whether the target object is true or false according to the spectral information and the 3D image.
In the embodiment of the invention, the 3D image of the target object is acquired through the 3D camera, and the spectral information of the target object is acquired through the spectrometer, so that the authenticity of the target object can be identified by integrating the 3D image and the spectral information, the authenticity identification accuracy is improved, and the method can be applied to identification of antique and rare ceramic products, crystal products and the like.
In a modification of the present invention, the spectrometer 2 may be further disposed inside the 3D camera 1, as shown in fig. 2, fig. 2 is a schematic structural diagram of a 4D imaging device in a first modification of the present invention, and a person skilled in the art can understand the first modification as a modification of the embodiment shown in fig. 1, where the first imaging module 103 includes a first optical filter 1031 and a first image sensor 1032;
the spectrometer 2 comprises a dispersion element 201, wherein the dispersion element 201 is used for carrying out dispersion and light splitting on the reflected light so as to form a spectrum distribution with sequentially arranged wavelengths on the first image sensor;
the dispersive element 201 is disposed on the light incident side of the first filter 1031.
The dispersive element 201 adopts any one of the following optical devices;
-a planar diffraction grating;
-a prism;
-an optical waveguide device.
Fig. 3 is a flowchart illustrating a procedure of determining whether the target object is authentic according to an embodiment of the present invention, as shown in fig. 3, in the embodiment of the present invention, the procedure of determining whether the target object is authentic includes the following steps:
step S1: acquiring an identification pattern or identification characters of the target object on the 3D image, and determining a pre-stored image model corresponding to the target object according to the identification pattern or the identification characters;
in the embodiment of the present invention, the target object may be antique, famous and precious ceramic products or crystal products, etc.; the pre-stored image model may be a three-dimensional model created by scanning according to the genuine article of the target article.
The identification pattern can be a unique identification pattern on a target product, and can also be a two-dimensional code or a bar code on the target product; the identification words may be names of the target objects, or product numbers of the target objects.
Step S2: comparing the 3D image with the image model, and triggering step S3 when the matching degree of the 3D image and the image model is greater than the threshold value of the matching degree of a preset value;
in an embodiment of the present invention, the threshold of the matching degree may be set to a value that is set as needed, such as 95% or 98%, and the matching degree may be generated according to a degree of coincidence between the 3D image and the image model, and when the degree of coincidence is 95%, that is, when 95% of the outer contours are overlapped, the matching degree between the 3D image and the image model is determined to be 95%.
Step S3: determining the contents of a plurality of elements of the target object according to the spectrum information, and determining the authenticity of the target object according to the contents of the elements.
In the embodiment of the present invention, the authenticity of the target object is determined according to the element content, the element content may be compared with the element content of a genuine product of the target object, when the difference between the element content and the element content of the genuine product of the target object, which is a preset value, is smaller than a preset difference threshold, the target object is determined to be a genuine product, when some element is contained in the element contents, the target object is determined to be a genuine product, and when some element is contained in the element contents, a counterfeit product of the target object is determined, and specifically, the determination according to the situation may be selected according to the counterfeit identification characteristics of the target object. The difference threshold may be set according to an order of magnitude of the element content, such as one fiftieth of the element content. Such as the authenticity of the antique ceramic can be determined based on the hydroxyl group content of the target object.
The spectrometer 2 is arranged at one end or one side surface of the 3D camera 1;
the light inlets of the spectrometer 2 and the first imaging module 103 and the second imaging module 102 are in the same direction.
In the embodiment of the invention, the spectrometer 2 is arranged at the lower end of the 3D camera 1, and the spectrometer 2 and the 3D camera 1 are in an integrated structure. The spectrometer 2 may be an active spectrometer, for example, the spectrometer has a light projector, and receives the light reflected by the target object after projecting light to the target object to generate spectrum information, or a passive spectrometer, which receives the light reflected by the target object after being irradiated by ambient light to generate spectrum information.
The target object reflected light includes reflection of ambient light by the target object and/or reflection of projected light by the light projector 101 by the target object.
In one embodiment of the present invention, the light projector 101 employs a discrete light beam projector for projecting a plurality of discrete collimated light beams toward a target object;
the first imaging module 103 is configured to receive the divergent beams reflected by the target object and obtain the depth image of the target object surface according to a spot pattern formed by a plurality of the divergent beams.
The first imaging module 103 adopts an infrared camera, when the light projector 101 divides the laser emitted by the edge emitting laser into a plurality of discrete collimated light beams, and the plurality of discrete collimated light beams irradiate on the target object, a light spot image is formed, when the plurality of discrete collimated light beams irradiate on the surface of the target object, the light spot image is deformed or displaced, and after the first imaging module 103 acquires the light spot pattern on the surface of the target object, a depth image of the surface of the target object is obtained according to the deformation or displacement of the light spot pattern, so that the depth information of the surface of the target object, which is uneven, is obtained.
In one embodiment of the invention, the discrete beam projector includes an edge-emitting laser and a beam projector disposed on an optical path;
the edge-emitting laser is used for projecting laser to the beam projector;
the beam projector is used for projecting the incident laser light into a plurality of discrete collimated light beams.
The number of discrete collimated light beams is between two and tens of thousands of beams, such as 2 to 10 thousands of beams.
In one embodiment of the invention, the discrete beam projector comprises a laser array, a collimating lens and a beam splitting device which are arranged on a light path;
the laser array is used for projecting laser of a first order of magnitude to the collimating lens;
the collimating lens is used for collimating the incident multiple laser beams and then emitting collimated light beams with a first order of magnitude;
the beam splitting device is used for splitting the incident collimated light beam with the first order of magnitude to emit a collimated light beam with a second order of magnitude;
the second order of magnitude is greater than the first order of magnitude.
In an embodiment of the invention, the second order of magnitude is one to two times the first order of magnitude.
In the embodiment of the present invention, the Laser array may be formed by a plurality of Vertical Cavity Surface Emitting Lasers (VCSELs) or a plurality of Edge Emitting Lasers (EELs). A plurality of laser beams can become highly parallel collimated beams after passing through the collimating lens. According to the requirement of practical application, the beam splitting device can be adopted to realize more collimated beams according to the quantity of the discrete beams. The beam splitting device may employ a diffraction grating (DOE), a Spatial Light Modulator (SLM), and the like.
In the embodiment of the present invention, the light projector 101 employs a surface light source projector for projecting floodlight toward the target object; the surface light source projector adopts an LED light source. In a variant, other light sources, such as infrared light sources, may also be used.
The first imaging module 103 is configured to receive floodlight reflected by the target object, and obtain a depth image of the surface of the target object according to a propagation time of the floodlight.
In an embodiment of the present invention, the floodlight projected by the surface light source projector is reflected by the target object, and is partially reflected and received by the first imaging module 103, and each photodetector in the first imaging module 103 can obtain the flight time t from emission to reception of the corresponding light beam, so as to obtain the flight distance s ═ ct of the collimated light beam through the speed of light c, thereby being capable of measuring the depth information of the surface position of the target object. The depth data points of these locations construct point cloud data that can replicate the 3D morphology of the object, enabling 3D imaging of the target object.
In the embodiment of the present invention, the 3D camera 1 includes a driving circuit 104 connected to the light projector 101 and the second imaging module 102;
the driving circuit 104 is configured to control the light projector 101 and the second imaging module 102 to be turned on or off simultaneously, and can control the output optical power of the light projector 101 by controlling the driving current of the light projector 101.
The driving circuit 104 may be a separate dedicated circuit, such as a dedicated SOC chip, an FPGA chip, an ASIC chip, etc., or may include a general-purpose processor, for example, when the depth camera is integrated into an intelligent terminal, such as a mobile phone, a television, a computer, etc., a processor in the terminal may be at least a part of the processing circuit.
Fig. 4 is a schematic diagram of the spectrometer according to a variation of the present invention, as shown in fig. 4, the incident light is dispersed and dispersed by the dispersive element 201 to form a spectrum distribution with sequentially arranged wavelengths, the spectrum distribution is detected by a partial region of the image sensor 1032, and then the processor module 105 draws a spectrum curve according to the optical signal detected by the partial region of the image sensor 1032.
Fig. 5 is a schematic structural diagram of a 4D imaging device according to a second modification of the present invention; a person skilled in the art can understand this second modification as a variation of the embodiment shown in fig. 2, and as shown in fig. 5, the first imaging module 103 includes a first optical filter 1031 and a first image sensor 1032;
the spectrometer 2 comprises a dispersion element 201, wherein the dispersion element 201 is used for carrying out dispersion and light splitting on the reflected light so as to form a spectrum distribution with sequentially arranged wavelengths on the first image sensor;
the dispersive element 201 is arranged on the light exit side of the first filter 1031.
Fig. 6 is a schematic structural diagram of a 4D imaging apparatus according to a third modification of the present invention, and those skilled in the art can understand the third modification as a modification of the embodiment shown in fig. 2, and as shown in fig. 6, the first imaging module 103 includes a first optical filter 1031 and a first image sensor 1032;
the spectrometer 2 comprises a dispersion element 201, wherein the dispersion element 201 is used for carrying out dispersion and light splitting on the reflected light so as to form a spectrum distribution with sequentially arranged wavelengths on the first image sensor;
the dispersive element 201 is disposed on a light sensitive surface of the first image sensor 1032.
Fig. 7 is a schematic structural diagram of a 4D imaging device according to a fourth modification of the present invention; a person skilled in the art can understand this fourth modification as a variation of the embodiment shown in fig. 2, and as shown in fig. 7, the second imaging module 102 includes a second filter 301 and a second image sensor 302;
the spectrometer 2 includes a dispersion element 201, and the dispersion element 201 is configured to perform dispersion and splitting on the target object reflected light to form a spectrum distribution with sequentially arranged wavelengths on the second image sensor;
the dispersion element 201 is disposed on the light incident side of the second filter 301.
In a fourth modification of the present invention, the second imaging module 102 employs an RGB camera.
Fig. 8 is a schematic structural diagram of a 4D imaging device according to a fifth modification of the present invention; a person skilled in the art can understand this fourth modification as a variation of the embodiment shown in fig. 2, and as shown in fig. 8, the second imaging module 102 includes a second filter 301 and a second image sensor 302;
the spectrometer 2 includes a dispersion element 201, and the dispersion element 201 is configured to perform dispersion and splitting on the target object reflected light to form a spectrum distribution with sequentially arranged wavelengths on the second image sensor;
the dispersive element 201 is arranged on the light exit side of the second filter 301.
In a fifth modification of the present invention, the second imaging module 102 employs an RGB camera.
Fig. 9 is a schematic structural view of a 4D imaging device according to a sixth modification of the present invention; a person skilled in the art can understand this fourth modification as a variation of the embodiment shown in fig. 9, and as shown in fig. 7, the second imaging module 102 includes a second filter 301 and a second image sensor 302;
the spectrometer 2 includes a dispersion element 201, and the dispersion element 201 is configured to perform dispersion and splitting on the target object reflected light to form a spectrum distribution with sequentially arranged wavelengths on the second image sensor;
the dispersive element 201 is arranged on a light sensitive surface of the second image sensor 302.
In a sixth modification of the present invention, the second imaging module 102 employs an RGB camera.
Fig. 10 is a schematic structural diagram of an image sensor in an embodiment of the present invention, and as shown in fig. 10, the first image sensor 1032 is provided with a dispersion detector 1033; the dispersion detector 1033 is configured to detect the spectral distribution. The dispersion detector 1033 may be a part of the first image sensor 1032, or may be a separate detector disposed on the light incident side of the first image sensor 1032. In the embodiment of the present invention, the first image sensor 1032 is a contact image sensor, and may also be a CDD or CMOS image sensor. The second image sensor 302 has the same structure as the first image sensor 1032.
When the 4D camera device provided by the invention is used, the spectrograph and the 3D camera can be used together, the 3D image of the target object is obtained through the 3D camera, and the spectral information of the target object is obtained through the spectrograph, so that the authenticity of the target object can be identified by integrating the 3D image and the spectral information, the authenticity identification accuracy is improved, and the device can be applied to identification of antiques, famous and precious ceramic products, crystal products and the like; the invention not only can combine the spectrometer and the 3D camera, but also can independently call the spectrometer and the 3D camera, for example, the spectrometer is independently called to carry out food safety monitoring, fruit component detection, component content in milk, protein content in body-building beverage, even fat content of human body and the like. According to the invention, the dispersion element is arranged on the light-in side surface, the light-out side surface or the light-sensitive surface of the image sensor, so that the integration of the spectrometer and the 3D camera is realized, and the integration cost of the invention is reduced.
In an embodiment of the invention, the electronic device provided by the invention comprises the 4D imaging device. Namely, the 4D camera device can be attached to an electronic device, which may be a mobile phone, a tablet computer, a digital camera, and the like.
In the embodiment of the invention, the integrated spectrometer and the 3D camera can be loaded on the electronic equipment, so that a user can conveniently call the spectrometer and the 3D camera, and the application scene of the electronic equipment is enlarged.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention.
Claims (10)
1. A4D camera device is characterized by comprising a spectrometer, a 3D camera and a processor module;
the 3D camera comprises a light projector, a first imaging module and a second imaging module;
the light projector is used for projecting light to a target object;
the first imaging module is used for receiving the reflected light of the target object and obtaining a depth image of the surface of the target object according to the reflected light;
the second imaging module is used for acquiring a 2D image of the target object;
the spectrometer is used for receiving the reflected light of the target object and generating spectral information of the reflected light of the target object;
the processor module is used for generating a 3D image of the target object according to the depth image and the 2D image of the surface of the target object, and further judging the authenticity of the target object according to the spectral information and the 3D image.
2. The 4D imaging apparatus according to claim 1, comprising, when determining authenticity of the target object, the steps of:
step S1: acquiring an identification pattern or identification characters of the target object on the 3D image, and determining a pre-stored image model corresponding to the target object according to the identification pattern or the identification characters;
step S2: comparing the 3D image with the image model, and triggering step S3 when the matching degree of the 3D image and the image model is greater than the threshold value of the matching degree of a preset value;
step S3: determining the contents of a plurality of elements of the target object according to the spectrum information, and determining the authenticity of the target object according to the contents of the elements.
3. The 4D imaging apparatus according to claim 1, wherein the first imaging module includes a first filter and a first image sensor;
the spectrometer comprises a dispersion element, wherein the dispersion element is used for carrying out dispersion and light splitting on the reflected light so as to form a spectrum distribution with sequentially arranged wavelengths on the first image sensor;
the dispersion element is arranged on the light-in side face, the light-out side face or the light-sensitive surface of the first optical filter.
4. The 4D image capturing apparatus according to claim 1, wherein the second imaging module includes a second filter and a second image sensor;
the spectrometer comprises a dispersion element, wherein the dispersion element is used for carrying out dispersion and light splitting on the reflected light of the target object so as to form spectral distribution with sequentially arranged wavelengths on the second image sensor;
the dispersion element is arranged on the light-in side face, the light-out side face or the light-sensitive surface of the second optical filter.
5. The 4D image pickup apparatus according to claim 3 or 4, wherein the dispersion element employs any one of the following optical devices;
-a planar diffraction grating;
-a prism;
-an optical waveguide device.
6. 4D camera device according to claim 1, characterized in that the image sensor is provided with a dispersive detector; the dispersion detector is used for detecting the spectral distribution;
the dispersion detector is a partial area of the image sensor or an independent detector.
7. The 4D camera device according to claim 1, wherein the spectrometer is disposed inside the 3D camera;
or the spectrometer is arranged at one end or one side face of the 3D camera, and the light inlet of the spectrometer is the same as the light inlet of the first imaging module and the light inlet of the second imaging module in direction.
8. The 4D camera device of claim 1, wherein the light projector employs a discrete light beam projector for projecting a plurality of discrete collimated light beams toward a target object;
the first imaging module is used for receiving the scattered and collimated light beams reflected by the target object and obtaining the depth image of the surface of the target object according to a light spot pattern formed by a plurality of the scattered and collimated light beams.
9. The 4D camera device of claim 1, wherein the light projector employs a surface light source projector for projecting floodlight toward the target object;
and the first imaging module is used for receiving floodlight reflected by the target object and obtaining a depth image of the surface of the target object according to the propagation time of the floodlight.
10. An electronic apparatus characterized by comprising the 4D image pickup device according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911171938.9A CN112839217A (en) | 2019-11-22 | 2019-11-22 | 4D camera device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911171938.9A CN112839217A (en) | 2019-11-22 | 2019-11-22 | 4D camera device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112839217A true CN112839217A (en) | 2021-05-25 |
Family
ID=75922547
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911171938.9A Pending CN112839217A (en) | 2019-11-22 | 2019-11-22 | 4D camera device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112839217A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202915911U (en) * | 2012-10-19 | 2013-05-01 | 广州市盛光微电子有限公司 | Shooting device for distance measurement |
| CN106996913A (en) * | 2016-01-25 | 2017-08-01 | 苑高强 | A kind of material identifier and Internet of Things |
| CN107084790A (en) * | 2017-04-24 | 2017-08-22 | 西安交通大学 | Portable spectrometer and its spectral method of detection based on smart mobile phone |
| CN208172809U (en) * | 2018-04-18 | 2018-11-30 | 深圳阜时科技有限公司 | Image acquiring device, image reconstruction device, identity recognition device, electronic equipment |
| CN109416852A (en) * | 2016-06-30 | 2019-03-01 | 锡克拜控股有限公司 | Generate system, the method and computer program of the authenticity measurement of object |
| CN110290376A (en) * | 2019-05-24 | 2019-09-27 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
| CN110471081A (en) * | 2019-04-30 | 2019-11-19 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on synchronous ToF discrete point cloud |
-
2019
- 2019-11-22 CN CN201911171938.9A patent/CN112839217A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202915911U (en) * | 2012-10-19 | 2013-05-01 | 广州市盛光微电子有限公司 | Shooting device for distance measurement |
| CN106996913A (en) * | 2016-01-25 | 2017-08-01 | 苑高强 | A kind of material identifier and Internet of Things |
| CN109416852A (en) * | 2016-06-30 | 2019-03-01 | 锡克拜控股有限公司 | Generate system, the method and computer program of the authenticity measurement of object |
| CN107084790A (en) * | 2017-04-24 | 2017-08-22 | 西安交通大学 | Portable spectrometer and its spectral method of detection based on smart mobile phone |
| CN208172809U (en) * | 2018-04-18 | 2018-11-30 | 深圳阜时科技有限公司 | Image acquiring device, image reconstruction device, identity recognition device, electronic equipment |
| CN110471081A (en) * | 2019-04-30 | 2019-11-19 | 深圳市光鉴科技有限公司 | 3D imaging device and electronic equipment based on synchronous ToF discrete point cloud |
| CN110290376A (en) * | 2019-05-24 | 2019-09-27 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240241255A1 (en) | Detector for identifying at least one material property | |
| EP3117238B1 (en) | Optical imaging modules and optical detection modules including a time-of-flight sensor | |
| CN110221309B (en) | 3D imaging device and electronic equipment based on asynchronous ToF discrete point cloud | |
| US20230078604A1 (en) | Detector for object recognition | |
| CN113454419A (en) | Detector having a projector for illuminating at least one object | |
| CN112066906A (en) | Depth imaging device | |
| US20230081742A1 (en) | Gesture recognition | |
| KR20100112853A (en) | Apparatus for detecting three-dimensional distance | |
| KR20230107574A (en) | Depth measurement via display | |
| CN112596068A (en) | Collector, distance measurement system and electronic equipment | |
| CN210128694U (en) | Depth imaging device | |
| CN112066907B (en) | Depth imaging device | |
| CN114127520A (en) | Spectrometer device | |
| CN211785087U (en) | 4D camera device and electronic equipment | |
| US11920918B2 (en) | One shot calibration | |
| CN112834435A (en) | 4D camera device and electronic equipment | |
| US20220326358A1 (en) | Method and device for determining distances to a scene | |
| WO2018169488A1 (en) | Optoelectronic devices for collecting three-dimensional data | |
| CN112839217A (en) | 4D camera device and electronic equipment | |
| CN211785085U (en) | 4D camera device and electronic equipment | |
| CN112834433B (en) | 4D camera device and electronic equipment | |
| CN112834434A (en) | 4D camera device and electronic equipment | |
| CN114236506A (en) | Calibration method, detection method and system based on DToF | |
| KR20210138451A (en) | Camera device | |
| US20240284031A1 (en) | Emitter array with two or more independently driven areas |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210525 |
|
| WD01 | Invention patent application deemed withdrawn after publication |