CN212012837U

CN212012837U - Multispectral camera

Info

Publication number: CN212012837U
Application number: CN202021237206.3U
Authority: CN
Inventors: 杨帆; 白立群
Original assignee: Nanjing Zhenshi Intelligent Technology Co Ltd
Current assignee: Xiaoshi Technology Jiangsu Co ltd
Priority date: 2020-06-30
Filing date: 2020-06-30
Publication date: 2020-11-24
Anticipated expiration: 2030-06-30

Abstract

A multispectral camera relates to the technical field of computer vision. The utility model discloses a, photoelectric controller: the controller is used for controlling the rotating speed of the motor, measuring the rotating angle of the filter disc and triggering a shutter signal in the image sensor; a filter disk: the filter disc is positioned above the click, and narrow-band filters with different wave bands are placed on the filter disc; an image sensor: the light source is used for controlling the exposure of light sources with different wave bands and controlling the exposure time of each photosensitive pixel; single light source: the single light source is a compensation light bead illuminated by a single wave band; lens: the reflected light of the illuminated object is collected. The utility model has the advantages of solve the problem that single sensor can't acquire the image of the different wave bands of multichannel.

Description

Multispectral camera

Technical Field

The utility model relates to a computer vision technical field, concretely relates to multispectral camera.

Background

In the prior art, two or more cameras are used, and different optical filters are arranged on a lens to achieve the function of simultaneously acquiring different wave bands. However, the positions of the two cameras on the circuit board cannot be overlapped, so that the images have parallax, and the two pictures cannot be completely overlapped. The use of multiple sensors to acquire images of different wavebands significantly increases manufacturing costs, while requiring more demanding pcb manufacture than solutions for space-sensitive applications.

For example, a binocular camera needs to obtain an rgb image and an infrared image at the same time, and at present, two cameras shoot simultaneously, so that parallax exists between pictures shot by the two cameras, registration is needed, the calculation cost is increased, and even the registration also has image distortion.

SUMMERY OF THE UTILITY MODEL

The utility model provides a multispectral camera, the advantage lies in having solved the problem that single sensor can't acquire the image of multichannel different wave bands.

In order to achieve the technical purpose, the invention adopts the following technical scheme:

a multispectral camera, comprising:

the photoelectric controller: the controller is used for controlling the rotating speed of the motor, measuring the rotating angle of the filter disc and triggering a shutter signal in the image sensor;

a filter disk: the filter disc is positioned above the click, and narrow-band filters with different wave bands are placed on the filter disc;

an image sensor: the light source is used for controlling the exposure of light sources with different wave bands and controlling the exposure time of each photosensitive pixel;

single light source: the single light source is a compensation light bead illuminated by a single wave band;

lens: the reflected light of the illuminated object is collected.

Further, the motor measures the rotation angle of the filter disc through a magnetic encoder or a photoelectric encoder.

Further, the optical filter comprises an infrared filter and an 850nm narrow-band filter.

Further, the image sensor exposes a full-wave band light source, and the full-wave band refers to an infrared wave band and a visible light wave band which can be exposed to generate images; the image sensor includes a global exposure camera that controls an exposure time of each photosensitive pixel.

Further, when the filter disc rotates to face the image sensor, the photoelectric controller sends a shutter signal to the image sensor to split and combine the images of different wave bands shot by the image sensor into video streams of different wave bands.

Advantageous effects

The utility model provides a single sensor can't acquire the problem of the image of the different wave bands of multichannel. The utility model discloses a single sensor acquires infrared image and color image simultaneously to two images are the image of shooing through same camera lens, same visual angle. The utility model discloses a combination of optics and hardware can solve the problem that the image can't acquire different wave band images through single camera lens to a certain extent.

Drawings

Fig. 1 is a structural diagram of the multispectral camera according to the embodiment.

FIG. 2 is a schematic diagram of the shutter timing sequence of the present embodiment.

Fig. 3 is a flowchart of an application scenario of the present embodiment.

Detailed Description

The present invention will be described in further detail with reference to the following embodiments.

As shown in fig. 1, a multispectral camera, comprising:

the photoelectric controller: the rotating angle of the filter disc is measured; when the filter disc rotates to be opposite to the image sensor, a shutter signal is sent to the image sensor; controlling the single light source to be switched on and off; and splitting and combining the images of different wave bands shot by the image sensor into video streams of different wave bands.

A filter disk: the filter disc is positioned above the click, and narrow-band filters with different wave bands are placed on the filter disc; multispectral cameras require an infrared filter (through visible light) and a 850nm narrowband filter (through 850nm infrared light).

An image sensor: the light source is used for controlling the exposure of light sources with different wave bands and controlling the exposure time of each photosensitive pixel; can expose the full-wave band light source, and simultaneously needs a global exposure camera. The full-wave band means that both an infrared wave band and a visible light wave band can be exposed to generate images, and the global exposure camera means can control the exposure time of each photosensitive pixel.

Single light source: the single light source is a compensation light bead illuminated by a single wave band; the lamp bead only emits a light source with 850nm wave band, and is invisible to human eyes.

Lens: collecting reflected light of the illuminated object; the full-wave band can be passed through, and the focal length can be customized according to the requirement.

The utility model discloses a concrete embodiment does: and the photoelectric controller controls the rotating speed of the motor to be kept at 7200rpm, and the motor uses a magnetic encoder or a photoelectric encoder to measure the angle of the motor. And the photoelectric controller controls the 850nm infrared light supplement lamp and the visible light supplement lamp to be simultaneously lightened. The infrared filter obtains the rotation angle of the filter disc through the encoder, as shown in fig. 2, the rotation angle is a broken line of a solid line, and the shutter level signal is a broken line of a dotted line. The high level triggers the shutter signal of the global exposure camera, and the high level controls the global exposure camera to photograph and expose.

A shutter level time sequence is generated through a photoelectric controller, the global exposure camera is driven to shoot through the time sequence, and the high level duration is used for controlling the exposure time of the camera. The photoelectric controller reads two pieces of image data in sequence according to the shutter, and horizontally synthesizes the infrared image and the visible light image into one image.

And the photoelectric controller simulates UVC equipment, encodes the output in the previous step and outputs the encoded output from the USB. The standard UVC interface reads a camera picture, so that a single image sensor can simultaneously acquire an infrared image and a color image, the two images are acquired through the same lens and the same visual angle, and an IR image and an RGB image are acquired through the lens. The device can be applied to face detection.

As shown in fig. 3, the RGB is used for face detection, and the top-left, bottom-right coordinates and face key points of the face frame (x 1, y1, x2, y 2) are obtained by an algorithm. Since the focal lengths are all kept consistent using multispectral camera view angles, the ir image and face image regions are cropped directly using (x 1, y1, x2, y 2), collectively referred to as rgb-ir patch.

The infrared human face photos have very stable anti-attack capability aiming at screen and paper photo attack means, the rgb can be used for color prior as a condition for supplementing a network, and meanwhile, the rgb also has better interactivity. rgb-ir patch is input to the deep learning network for two classifications to determine whether it is a true face or a false face. And the model return value is the execution degree of the false face, a model threshold value is considered to be set, if the execution degree is greater than the threshold value, the false face is considered, and otherwise, the false face is considered.

When the false face is identified, the face identification is not carried out, so that the personal information of the user can not be stolen.

The above mentioned is only the embodiment of the present invention, and not the limitation of the patent scope of the present invention, all the equivalent transformations made by the contents of the specification and the drawings, or the direct or indirect application in the related technical field, are included in the patent protection scope of the present invention.

Claims

1. A multispectral camera, comprising:

lens: the reflected light of the illuminated object is collected.

2. The multispectral camera of claim 1, wherein the motor is configured to measure the rotation angle of the filter wheel using a magnetic encoder or a photoelectric encoder.

3. The multispectral camera of claim 1, wherein the filters comprise an infrared filter and a 850nm narrowband filter.

4. The multispectral camera of claim 1, wherein the image sensor exposes a full-band light source, wherein the full-band light source is capable of generating images by exposing both infrared and visible light bands; the image sensor includes a global exposure camera that controls an exposure time of each photosensitive pixel.

5. The multispectral camera of claim 1, wherein the electro-optical controller sends a shutter signal to the image sensor to split and merge the different band images captured by the image sensor into different band video streams when the filter wheel is rotated to face the image sensor.