WO2018153254A1

WO2018153254A1 - Multi-view camera device and monitoring system

Info

Publication number: WO2018153254A1
Application number: PCT/CN2018/075473
Authority: WO
Inventors: 杨坤
Original assignee: 杭州海康威视数字技术股份有限公司
Priority date: 2017-02-27
Filing date: 2018-02-06
Publication date: 2018-08-30
Also published as: CN108513097A

Abstract

The present application belongs to the technical field of imaging, and disclosed thereby are a multi-view camera device and a monitoring system. The multi-view camera device comprises a plurality of lens groups, and each lens group comprises at least one lens, wherein at least one lens group comprises at least two lenses, and the at least one lens comprised in each lens group has the same focal length, which is the focal length of the lens group; the focal lengths of the plurality of lens groups are different; the plurality of lenses comprised in each lens group all correspond to a single monitoring range; and the monitoring range of a lens group having the smallest focal length in the plurality of lens groups at least partially coincides with the monitoring range of any other lens group. According to the embodiments of the present application, different lens groups having different focal lengths cover different regions in a monitored range, so that targets distributed at different distances may present clear images, thereby achieving target identification in a large depth of the monitored range.

Description

Multi-view camera device and monitoring system

This application claims the priority of the Chinese patent application submitted by the State Intellectual Property Office of China, application number 201710110267.X, and the invention name "a multi-camera camera and monitoring system" on February 27, 2017. The citations are incorporated herein by reference.

Technical field

The present application relates to the field of imaging technologies, and in particular, to a multi-view camera device and a monitoring system.

Background technique

Surveillance cameras have been widely used in all aspects of people's lives. The camera is usually a camera with a lens. The scope of the lens depends on the angle of view and the focal length of the lens. Generally, the larger the field of view of the lens, the focal length. The shorter, the closer the depth of field of the lens is. After the focus is completed, a clear image can be formed in the range before and after the focus. The distance range before and after the focus is the depth of field, and the lens can be used for the target (such as license plate and face) in the depth of field by means of the image recognition device. Identification, therefore, the depth of field can also be seen as the range of recognition of the lens within its monitoring range.

For example, the existing panoramic camera (in the case of a wall-mounted camera) has an angle of view of 180° in the horizontal direction, but the focal length is short, and the depth of field of the lens is relatively close, so that recognition of recognition can be completed. The range of the area is also very close (less than 3m). That is to say, although the existing panoramic camera satisfies a wide range of monitoring, due to the limitation of the focal length, it is only possible to recognize the target in the near depth depth within the monitoring range, and the target on the far depth and depth cannot present a clear image. Cannot be identified.

Summary of the invention

The present application provides a multi-view camera and monitoring system capable of presenting a clear image of a target over a wide range of depths.

Specifically, the following technical solutions are included:

A first aspect provides a multi-view camera device, wherein the multi-view camera device includes a plurality of lens groups, wherein

Each lens group includes at least one lens, wherein at least one lens group includes at least two lenses, and at least one lens included in each lens group has the same focal length, the same focal length is a focal length of the lens group; The focal lengths of the lens groups are different; each lens group corresponds to a monitoring range;

The monitoring range of the lens group with the smallest focal length among the plurality of lens groups at least partially coincides with the monitoring range of any other lens group.

Optionally, the monitoring range of the lens group with the smallest focal length among the plurality of lens groups at least partially coincides with the monitoring range of any other lens group, including: the proportion of the overlapping portions of the other lens groups It is more than 80% of its monitoring range.

Optionally, each lens in each lens group corresponds to one depth of field, and the superposition of the depth of field of the plurality of lens groups covers the depth corresponding to the monitoring range of the lens group with the smallest focal length.

Optionally, each lens in each lens group corresponds to an imaging clear range based on the depth of field thereof, and the superimposition of the imaging clear range of all the lenses of the plurality of lens groups covers the monitoring of the lens group with the smallest focal length range.

Optionally, the monitoring range of the lens group with the smallest focal length has an angle greater than 170° in the horizontal direction and an angle greater than 80° in the vertical direction.

Optionally, the plurality of lenses included in each of the lens groups are arranged in one or more rows, and the plurality of lens groups are sequentially arranged in a vertical direction.

Optionally, the plurality of lens groups are arranged in a common center line in a vertical direction.

Optionally, the spacing between two horizontally adjacent lenses in at least one of the lens groups is the same; and/or

The spacing between two vertically adjacent lenses in at least one of the lens groups is the same.

Optionally, each of the two lenses adjacent to each other in the at least one of the lens groups has a range of images that are greater than 2% of the overlap region in the horizontal direction.

Optionally, for any two lens groups, the focal length of the lens group above is greater than the focal length of the lens group below; or for any two lens groups, the focal length of the lens group above is smaller than the focal length of the lens group below .

Optionally, for any two lens groups, the number of lenses of the lens group with a large focal length is larger than the number of lenses of the lens group with a small focal length.

Optionally, for any two lens groups, the spacing between horizontally adjacent lenses of the lens group having a large focal length is smaller than the spacing between horizontal adjacent lenses of the lens group having a small focal length; and/or

For any two lens groups, the spacing between vertically adjacent lenses of a lens group having a large focal length is smaller than the spacing between vertically adjacent lenses of a lens group having a small focal length.

A second aspect provides a monitoring system including a multi-view camera and an image recognition device,

The multi-view camera device includes a plurality of lens groups, wherein

Each lens group includes at least one lens, wherein at least one lens group includes at least two lenses, and each of the lens groups includes a plurality of lenses having the same focal length, the same focal length being a focal length of the lens group; and the plurality of The focal lengths of the lens groups are different; each lens group corresponds to a monitoring range;

The monitoring range of the lens group with the smallest focal length among the plurality of lens groups at least partially coincides with the monitoring range of the other at least one lens group;

The image recognition device is configured to identify a predetermined target image within a monitoring range of the lens group having the smallest focal length.

Optionally, each lens group corresponds to one depth of field based on the focal length thereof; and the superposition of the depth of field of the plurality of lens groups covers the depth corresponding to the monitoring range of the lens group with the smallest focal length.

Optionally, the plurality of lenses included in each of the lens groups are formed into one or more rows, and the plurality of lens groups are sequentially arranged in a vertical direction.

Optionally, for any two lens groups, the focal length of the lens group above is greater than the focal length of the lens group below; or, for any two lens groups, the focal length of the lens group above is smaller than that of the lens group below focal length.

The embodiment of the present application provides a multi-view camera device and a monitoring system capable of presenting a clear image to a target over a wide range of depth distances. Specifically, the multi-view camera device is configured to include a plurality of lens groups of different focal lengths, and each of the plurality of lenses included in each lens group corresponds to one monitoring range, and the lens group having the minimum focal length is distributed in the monitoring range thereof. The target on the depth of field distance presents a clear image, so that the target in the corresponding depth distance can be identified in the monitoring range, and other lens groups have different focal lengths and overlap with the monitoring range of the lens group with the smallest focal length. Targets distributed in other monitored depths within the monitored range present a clear image, enabling identification of targets in other areas within the surveillance range. In the embodiment of the present application, different lens groups with different focal lengths cover different depth regions in the monitored range, so that targets distributed in different distances within the monitoring range can present clear images, thereby achieving the monitored range. Target recognition is performed over a wide range of depths.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

1A is a schematic structural diagram of a lens in a lens group arranged in a row according to an embodiment of the present disclosure;

FIG. 1B is a schematic structural diagram of a lens in a lens group arranged in multiple rows in a neat manner according to an embodiment of the present application; FIG.

1C is a schematic structural diagram of a lens in a lens group arranged in a plurality of rows in a staggered manner according to an embodiment of the present disclosure;

2 is a schematic diagram of arrangement of multiple lens groups and lenses in a multi-view camera device according to an embodiment of the present application;

FIG. 3 is a schematic diagram of distribution of multiple lenses in a multi-view camera device according to an embodiment of the present application; FIG.

4 is a schematic diagram of distribution of identification ranges of multiple lenses in a multi-view camera device according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of target recognition of multiple lens groups in different depth and depth in a multi-view camera device according to an embodiment of the present invention; FIG.

Figure 6 is a plan view corresponding to Figure 5.

detailed description

In order to make the technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings. Unless otherwise defined, all technical terms used in the embodiments of the present application have the same meaning as commonly understood by those skilled in the art.

An embodiment of the present application provides a multi-view camera device, where the multi-view camera device includes a plurality of lens groups, wherein each lens group includes at least one lens, wherein at least one lens group includes at least two lenses, and each lens group The at least one lens included has the same focal length, the same focal length is the focal length of the lens group; and the focal length of each lens group is different; each lens group corresponds to one monitoring range; the lens group with the smallest focal length among the plurality of lens groups The monitoring range is at least partially coincident with the monitoring range of any other lens group.

It should be understood that the monitoring range of the lens group refers to the range of spatial regions corresponding to the pictures captured by all the lenses in the lens group.

In the multi-view camera device, each lens group corresponds to a monitoring range, wherein the monitoring range of the lens group having the smallest focal length is regarded as the preset monitoring range, and the monitoring range of the other lens groups is within the preset monitoring range. The purpose of setting up multiple lens groups is to better identify the target of the preset monitoring range. Since each lens group has different focal lengths, each lens group can display a clear image on the depth of field corresponding to its focal length within its monitoring range, and the preset monitoring range can be divided into multiple ring sectors according to the distance from the multi-view camera device. For each sub-region, each sub-region corresponds to a group of lens groups, and the farthest distance and the minimum distance of the sub-regions from the camera correspond to the depth of field of the group of lens groups, and the depth of field is mainly determined by the focal length of the lens. For example, the lens group with the minimum focal length can make the target distributed in the depth field corresponding to the focal length within the preset monitoring range present a clear image, so that the target in the corresponding depth of field in the preset monitoring range can be identified in the subsequent image processing. The other lens groups have different focal lengths and overlap with the monitoring range of the lens group with the smallest focal length, so that the target on the depth of field corresponding to the focal lengths of the other lens groups distributed in the preset monitoring range can present a clear image. Therefore, the image captured by the plurality of lens groups can be used to identify the target on the depth of field corresponding to the focal length of each lens group in the preset monitoring range.

The multi-camera camera provided by the embodiment of the present application adopts a lens group having different focal lengths, and determines a monitoring range of the multi-view camera device by a lens group with a small focal length, and presents a clear image of a target at a relatively close distance, and a lens group with a large focal length. A clear image of other distant targets within the monitored range is presented. The embodiments of the present application cover different areas of the depth of field in the monitored range by different lens groups with different focal lengths, so that the targets distributed in different distances within the monitoring range can present clear images, thereby being able to be monitored. Target recognition is performed over a large depth range of the range.

It should be noted that the lenses of the present application all include corresponding image sensors, and the range of the image captured by the lens is the image range formed on the corresponding image sensor.

Since the multi-view camera device in the present application is mainly applied to a panoramic camera, in order to satisfy the panoramic shooting, "a plurality" in the present application means at least two, that is, the multi-view camera device includes at least two lens groups, and is set. At least one lens group includes at least two lenses.

In the present invention, the monitoring range of the lens group having the smallest focal length is regarded as the preset monitoring range, and the lens group with the minimum focal length can realize the target corresponding to the nearest depth distance within the preset monitoring range, specifically the preset The selection of the monitoring range can be determined according to the actual situation, and can be a complete continuous range or a plurality of discrete discontinuous ranges; and other lens groups are used to identify targets in other depth distances within the preset monitoring range. The specific selection of other areas can be determined according to the needs of the specific actual target identification, and then the lens group corresponding to the focal length is selected for monitoring and identification.

In order to meet the needs of panoramic shooting, the preset monitoring range can be a complete continuous range, which can be superimposed by the range of images taken by multiple lenses in the lens group with the smallest focal length.

The area where the monitoring range of any other lens group and the monitoring range of the lens group with the smallest focal length can be set to occupy more than 80% of the monitoring range of any other lens group, so that the monitoring range of other lens groups is mostly at the focal length of the smallest. Within the monitoring range of the lens group, the number of lenses can be reduced as much as possible, and the cost of the device can be reduced.

Since the focal lengths of multiple lens groups are different, each lens group can display a clear image on the corresponding depth of field within its monitoring range. Each lens in each lens group corresponds to one depth of field, and the superimposition of the depth of field of the plurality of lens groups can cover the depth corresponding to the monitoring range of the lens group with the smallest focal length. In this way, any target in the depth of the surveillance range has a lens group that can present a clear image. The superposition of the present application refers to the total amount obtained by adding all the components in such a manner that the coincident portion is calculated only once.

Each lens group corresponds to an imaging clear range based on its depth of field, that is, the distance from the multi-view camera is on the corresponding depth of field, thereby facilitating recognition of the spatial extent of the target. Since different focal lengths correspond to different depths of field, the imaging clear range of lens groups with different focal lengths can cover targets at different depths within the preset monitoring range; therefore, in order to be able to monitor the range of the preset monitoring range (the lens group with the smallest focal length) All targets within the image present a clear image for easy identification, and the imaging clear range of all lenses of multiple lens groups can be set to cover the monitoring range of the lens group with the smallest focal length.

Taking the preset monitoring range as a complete continuous range as an example, the range of pictures taken by multiple lenses included in each of the other lens groups can be set into a complete range, and the stitched range and preset are set. The monitoring range is the same in the horizontal direction; since the focal lengths of the lens groups are different, the targets at different depths within the preset monitoring range can be identified. Through the target recognition of multiple lens groups over a plurality of depth distances, the recognition of all targets in a large depth range is realized, and the recognition capability of the multi-view camera device is further improved.

The "horizontal direction" refers to the direction along the horizontal plane, which is generally the width direction of the image formed by the image sensor in the lens.

Here, "the splicing of the screen range taken by multiple lenses" means that the images captured by multiple lenses can be spliced into a complete monitoring range because the focal lengths of the multiple lenses are the same, the positions are close, and the images taken by the adjacent lenses overlap. .

In the above-described multi-camera imaging device, the superimposition of the range of the images captured by the plurality of lenses in the lens group having the smallest focal length in the horizontal direction defines the monitoring range of the multi-view imaging device in the horizontal direction, and the present application The monitoring range is not strictly limited, and can be set according to the actual situation. For example, the angle of the picture taken by the multiple lenses of the lens group with the smallest focal length can be greater than 170° in the horizontal direction, and the angle in the vertical direction can be More than 80° for panoramic monitoring.

Correspondingly, by selecting the type of the lens in the other lens group, and setting the number and angle of the lens, the frame range captured by the multiple lenses of the other lens groups is stitched together with the preset image taken by the lens group having the smallest focal length. Covering approximately the same range of angles in the horizontal and vertical directions.

The lens is preferably a fixed-focus lens, and a zoom lens can also be selected to adjust the focal length to a suitable focal length.

Obviously, in order to monitor the same angular range, the number of cameras with a large focal length should be larger than the number of cameras with a small focal length.

In the embodiment of the present application, the arrangement of the plurality of lenses and the plurality of lens groups is not strictly limited, and may be arranged in a circular, square, or other shape, and the overlapping regions of the range of the images captured by the lenses in each lens group are set. This can be done by adjusting the angle of the lens in the lens group.

In actual production, in order to facilitate adjusting the angle of the lens in the lens group and facilitating the structural design of the overall imaging device, a plurality of lenses included in each lens group may be arranged in a row, and the plurality of lens groups are sequentially arranged in the vertical direction. arrangement.

Here, "vertical direction" generally refers to a direction perpendicular to "row", "row" generally refers to a line in a horizontal direction, and "vertical direction" refers to a direction perpendicular to a horizontal plane, but does not Exclude the situation where the line has a certain angle with the horizontal direction.

That is to say, a plurality of lenses in the same lens group can be arranged horizontally in a row, and a plurality of lens groups are sequentially arranged in the vertical direction. This arrangement is adopted for the lens and the lens group, and on the one hand, the structure of the overall imaging device can be adapted. The design, on the other hand, also facilitates the adjustment of the angles of multiple lenses in the lens group, so that the range of images captured by multiple lenses in each line overlaps in the horizontal direction, thereby covering the range of the monitored scene in the corresponding depth of field.

In the above-described multi-camera imaging device, in order to save the number of lenses and achieve an optimal recognition effect, a plurality of lens groups may be arranged in a vertical direction in a common center line, that is, a plurality of lenses of each lens group are symmetrically distributed. On both sides of the centerline (if a lens group includes an odd number of lenses, one of the lenses can be placed on the centerline), and the centerlines of the multiple lens groups coincide in a straight line, which enables monitoring of each lens group The total center line of the range makes the area of each lens group or the center of the area roughly the same in the horizontal direction, which is convenient for rationally arranging the number of multiple lenses in each lens group, so that the recognition effect is optimal.

In the above-described multi-view camera device, in order to adapt to the design of the multi-view camera device, each lens group may be provided to include one line lens or a plurality of lines of lenses.

“One-line lens” and “multi-line lens” can adjust the angle of the lens so that the range of images captured by multiple lenses can be spliced into a complete range, thus covering all targets at the corresponding depth distance within the monitored range. Yes, for a lens group that includes more lenses, a multi-line lens is arranged to arrange the lenses in multiple rows, which avoids a large number of lenses in one line and makes the multi-view camera device too long, thereby adapting to the design of the multi-view camera device.

The lens in the lens group is arranged in a row as shown in Fig. 1a. The lens in the lens group is arranged in multiple rows as shown in Figs. 1b and 1c, and the lens in the lens group is arranged in multiple rows. Schematic diagram of the structure, FIG. 1c is a schematic structural diagram of a case where the lens in the lens group is staggered in multiple rows, both of which can save design space in the longitudinal direction of the multi-view camera.

Further, since the range of the images captured by the plurality of lenses included in each lens group needs to be spliced into a complete range, that is, the images taken by the multiple lenses included in each lens group need to be spliced into a complete picture, in order to It is convenient to adjust the lens angle for image stitching processing, and it is preferable to set the lens in each lens group to be evenly distributed in the lens group.

That is to say, for a lens group consisting of one line of lenses (as shown in FIG. 1A), the spacing between two horizontally adjacent lenses in each lens group can be set to be the same, and by adjusting the lens angle, such a level The overlapping edges of the images taken by adjacent lenses are approximately the same size to facilitate stitching between the lenses within each lens group.

Similarly, for a lens group composed of multiple lines of lenses (as shown in FIG. 1B and FIG. 1C), a multi-line lens can be set, and the distance between two horizontally adjacent lenses in each lens group is the same and vertical. The spacing between the adjacent two lenses is also the same, which makes it easier to adjust the angle of the lens so that the overlapping edges of the images taken by the adjacent lenses in the horizontal direction are substantially the same, so that the images taken between the lenses in the lens group are splice.

Based on this, it is also possible to set the same distance between two horizontally adjacent lenses in one lens group. When there are multiple rows of lenses in one lens group, it is also possible to set between two vertically adjacent lenses in the lens group. The spacing is the same.

In the above-described multi-camera imaging device, for a lens group consisting of one line of lenses, it is possible to set a picture taken by two lenses adjacent to each other horizontally in each lens group to have a coincident area of more than 2% in the horizontal direction, on the one hand It is convenient to splicing the pictures taken by multiple shots in the same lens group, and on the other hand, it is convenient for each lens group to completely recognize the target of the identified area, and avoid the incomplete or defective target.

Similarly, for a lens group composed of multiple lines of lenses, by adjusting the lens angle, the pictures taken by adjacent lenses in each lens group are alternately overlapped, and the pictures taken by the adjacent two lenses are horizontally More than 2% of the coincident area to ensure that the picture taken by the lens in each lens group can be stitched, and the target of the captured area is guaranteed to be complete.

Based on this, it is possible to set a picture taken by each of two adjacent shots in at least one lens group to have a coincident area of more than 2% in the horizontal direction, and the overlapping area of the picture taken for each of the two shots of the other shot group is not limited. This application also does not exclude the use of other stitching methods to form a complete picture.

In the above-described multi-camera imaging device, the focal lengths of different lens groups are different from each other, and the lens groups may be arranged in a certain size order according to the focal length, or may not be arranged in a size order. Preferably, the focal lengths of the plurality of lens groups are sequentially increased or decreased in the vertical direction, and the lens group having a small focal length determines the monitoring range of the multi-view imaging device, and identifies the target in the near-depth depth distance, and the focal length is large. The lens group recognizes the objects at a relatively long depth and the focal length of the lens group is sequentially increased or decreased in the vertical direction, so that the objects near and far can be sequentially identified to cover the targets in all areas within the monitored range.

In order to ensure that all targets within the monitored range can be identified, the depth of field of each of the two adjacent lens groups in the imaging clear range of multiple lens groups can be set to have a coincidence area of more than 2% to ensure all monitoring ranges. Targets can be clearly imaged to avoid incomplete or defective targets, while avoiding target omissions.

In the above-described multi-camera imaging device, since the lens having a small focal length can capture a large angle of the screen in the horizontal direction, the lens having a large focal length can be photographed at a relatively small angle in the horizontal direction, in order to make the focal length large. The lens group and the lens group with a small focal length cover substantially the same angular range in the horizontal direction, so that all the targets of the preset monitoring range are completely covered, and the number of lenses of the lens group including the lens with a large focal length can be set to be larger than the focal length including The number of lenses in the lens group.

Similarly, since the focal length is smaller, the captured field of view is larger; the larger the focal length is, the smaller the field of view is captured, and the spacing between horizontally adjacent lenses including the lens group having a large focal length can be set to be smaller than including the focal length. The spacing between horizontally adjacent lenses of the lens group and/or the spacing between vertically adjacent lenses of the lens group including the large focal length is smaller than the spacing between vertically adjacent lenses of the lens group having a small focal length to ensure each lens The range of shots taken by multiple shots in a group can be stitched together to form a complete range.

In the above-mentioned multi-camera imaging device, the number of lens groups and the specific number of lenses in each lens group are not strictly limited, and may be set according to specific actual needs. For example, three or four lens groups may be set. Five, six, seven, etc., the number of lenses in the lens group can be set to four, five, six, seven, eight, nine, and so on.

The embodiment of the present application further provides a monitoring system, which includes any of the above-mentioned multi-view imaging devices, and further includes an image recognition device for recognizing the monitoring range of the lens group with the smallest focal length a predetermined target image, which may be a face, a license plate, or a certain behavior or the like.

The working principle of the monitoring system provided by the embodiment of the present application is: in the monitoring system, at least one lens included in the plurality of lens groups of the multi-eye camera device respectively makes each lens group correspond to one monitoring range, and the focal length is different. Each lens group can display a clear image on the corresponding depth of field within its monitoring range, wherein the monitoring range of the lens group with the smallest focal length is regarded as the preset monitoring range, and the lens group of the minimum focal length can be in the preset monitoring range. The target distributed in the corresponding depth of field represents a clear image, so that the target in the preset monitoring range can be identified by the image recognition device, and the other lens groups have different focal lengths and the focal length is the smallest. The monitoring range of the lens group overlaps, so that the targets distributed on other corresponding depths of the preset monitoring range can be clearly imaged, so that the objects in other areas within the preset monitoring range can be further identified by the image recognition device.

The monitoring system provided by the embodiment of the present application adopts a multi-eye camera device with lens groups of different focal lengths, determines the monitoring range of the multi-eye camera device by a lens group with a small focal length, and identifies the target at a relatively close distance by means of the image recognition device. The lens group with a large focal length recognizes other distant targets in the monitoring range. In the embodiment of the present application, the monitoring system with different lens groups with different focal lengths covers different depth regions in the monitored range, so that the targets distributed in different distances within the monitoring range can present clear images, thereby realizing Target recognition is performed over a large depth range of the monitoring range.

In order to meet the needs of the surveillance system for panoramic shooting, the preset monitoring range can be a complete continuous range, which can be formed by splicing the range of pictures taken by multiple lenses in the lens group with the smallest focal length.

Since the focal lengths of multiple lens groups are different, each lens group can display a clear image on the corresponding depth of field within its monitoring range. Each lens in each lens group corresponds to one depth of field, and the superimposition of the depth of field of the plurality of lens groups can cover the depth corresponding to the monitoring range of the lens group with the smallest focal length. In this way, any target in the depth of the surveillance range has a lens group that can present a clear image.

Each lens group corresponds to an imaging sharp range based on its depth of field. Since different focal lengths correspond to different depths of field, the imaging clear range of lens groups with different focal lengths can cover targets at different depths within the preset monitoring range; therefore, in order to be able to monitor the system's preset monitoring range (the lens group with the smallest focal length) All targets within the monitoring range are identified, and the imaging clear range of all the lenses of multiple lens groups can be set to cover the monitoring range of the lens group with the smallest focal length.

In the above monitoring system, the superimposition of the range of the images taken by the plurality of lenses in the lens group with the smallest focal length in the horizontal direction defines the monitoring range of the multi-view imaging device in the horizontal direction, and the monitoring range of the present application is It is not strictly limited and can be set according to the actual situation. For example, the angle of the picture taken by multiple lenses of the lens group with the smallest focal length can be greater than 170° in the horizontal direction and greater than 80 in the vertical direction. ° for panoramic monitoring.

Correspondingly, by selecting the type of lens in other lens groups, and setting the number and angle of the lens, the range of the image taken by the multiple lenses of the other lens groups is superimposed and the preset image taken by the lens group with the smallest focal length is selected. Covering approximately the same range of angles in the horizontal and vertical directions.

In the above monitoring system, in order to facilitate adjusting the angle of the lens in the lens group and facilitating the structural design of the overall imaging device, a plurality of lenses included in each lens group may be arranged in a row, and the plurality of lens groups are vertically oriented. Arranged in order.

In the above monitoring system, in order to save the number of lenses and achieve the best recognition effect, multiple lens groups may be arranged in a common center line in the vertical direction, that is, multiple lenses of each lens group are symmetrically distributed in the center. On both sides of the line (if a lens group includes an odd number of lenses, one of the lenses can be placed on the center line), and the center lines of the multiple lens groups coincide with each other, so that the monitoring range of each lens group is The center line also makes the area of each lens group or the center of the area substantially the same in the horizontal direction, which is convenient for rationally arranging the number of multiple lenses in each lens group, so that the recognition effect is optimal.

In the above monitoring system, in order to adapt to the design of the multi-view camera, each lens group may be arranged to include one line of shots or multiple lines of shots.

In the above monitoring system, the focal lengths of different lens groups are different from each other, and the lens groups may be arranged in a certain size order according to the focal length, or may not be arranged in a size order. Preferably, the focal lengths of the plurality of lens groups are sequentially increased or decreased in the vertical direction, and the lens group having a small focal length determines the monitoring range of the multi-view imaging device, and identifies the target in the near-depth depth distance, and the focal length is large. The lens group recognizes the objects at a relatively long depth and the focal length of the lens group is sequentially increased or decreased in the vertical direction, so that the objects near and far can be sequentially identified to cover the targets in all areas within the monitored range.

Further, in order to ensure that all the targets in the monitored range can be identified, each of the two adjacent recognition ranges in the recognition range of the plurality of lens groups may have a coincident area greater than 2% in the depth direction to ensure all Targets within the scope of monitoring can be identified to avoid incomplete or incomplete targets, while avoiding target omissions.

For a more detailed explanation, the following detailed description will be made in conjunction with specific examples.

As shown in FIG. 2, FIG. 2 is a schematic diagram of arrangement of multiple lens groups and lenses in a multi-view camera device according to an embodiment of the present application. The multi-view camera device includes four lens groups, which are a lens group 1, a lens group 2, a lens group 3, and a lens group 4. It should be understood that in other embodiments, the lens population may be other numbers, such as two, three, or more than four. As shown in the figure, all the lenses of each lens group are mounted on a rectangular frame, and then these frames are fixed in a large rectangular frame. However, in other embodiments, other mounting components and mounting methods may be used to mount the lens group. The multi-view camera is typically used to capture images in a surveillance system.

The lens group 1, the lens group 2, and the lens group 3 are respectively composed of one line lens, and the lens group 4 is composed of two lines of lenses, and the number of lenses included in the lens group 1 to the lens group 4 is gradually increased, wherein the lens group 1 includes The first focal length lens 11, the lens group 2 includes a lens 21 having a second focal length, the lens group 3 includes a lens 31 having a third focal length, and the lens group 4 includes a lens 41 having a fourth focal length (10 per line), At the first to fourth focal lengths, the focal length increases sequentially, that is, the focal length of the lens group 1 to the lens group 4 gradually increases. The four lens groups are arranged in a common center line in a vertical direction, that is, a straight line in the vertical direction can divide the four lens groups into two symmetrical halves.

More specifically, as shown in FIG. 3, the lens group 1 includes four lenses of G1-L1, G1-L2, G1-L3, and G1-L4, and the lens 2 includes G2-L1, G2-L2, G2-L3, and G2. -L4...G2-L9 and other 9 lenses, lens 3 includes 11 lenses such as G3-L1, G3-L2, G3-L3, G3-L4...G3-L11, lens 4 includes G4-L1, G4-L2, G4 -L3, G4-L4...G3-L20 and other 20 lenses. The identification area of each lens in each lens group at its corresponding depth distance is as shown in FIG. 4, for example, the lenses G3-L1, G3-L2, G3-L3, G3-L4...G3 in the lens group 3. -L11 covers the identification area of a certain range in the horizontal direction in turn in the corresponding depth distance.

The distance between the lens group 1, the lens group 2, the lens group 3, and the adjacent two lenses in the lens group 4 are respectively the same, and the distance between the two horizontally adjacent lenses in the lens group 1 is the first pitch; The spacing between two horizontally adjacent lenses in group 2 is the second spacing; the spacing between two horizontally adjacent lenses in lens group 3 is the third spacing; two adjacent horizontally in lens group 4 The spacing between the lenses is the fourth pitch, and the spacing between the two vertically adjacent lenses is the fifth pitch. From the first pitch to the fourth pitch, the pitch is sequentially decreased.

In use, as shown in FIG. 5 and FIG. 6, FIG. 5 is a schematic diagram of target recognition of a plurality of lens groups in different depths in the above-mentioned multi-camera imaging device; FIG. 6 is a plan view corresponding to FIG. The lens group 1, the lens group 2, the lens group 3, and the lens group 4 realize a picture that exhibits substantially the same angular range in the horizontal direction by means of intra-group stitching. The lens group 1 having the smallest focal length determines the monitoring range R of the camera, and can identify the targets of the relatively close regions, and sequentially can take the monitoring images of the lens group 2, the lens group 3, and the lens group 4 For image recognition, since the focal lengths of the lenses they include are sequentially increased, the depth distances of the corresponding pictures are successively changed, and the objects of other areas are recognized from near to far. As shown in FIG. 5 and FIG. 6, A is the target recognition range of the lens group 1 (ie, the imaging clear range, the target imaging in this range is clear and easy to be recognized), and B is the target recognition range of the lens group 2, C is The target recognition range of the lens group 3, and D is the target recognition range of the lens group 4. The target recognition ranges B, C, and D present a screen having the same angular range as the target recognition range A in the horizontal direction, and the target recognition ranges A, B, C, and D are superimposed to cover all the areas within the monitoring range R, thereby Achieve the identification of all targets over a large depth distance within the monitored area.

The above description is only for the convenience of those skilled in the art to understand the technical solutions of the present application, and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this application are intended to be included within the scope of the present application.

Claims

A multi-view camera device, wherein the multi-view camera device includes a plurality of lens groups, wherein

Each lens group includes at least one lens, wherein at least one lens group includes at least two lenses, and at least one lens included in each lens group has the same focal length, the same focal length is a focal length of the lens group; The focal lengths of the lens groups are different; each lens group corresponds to a monitoring range;

The monitoring range of the lens group with the smallest focal length among the plurality of lens groups at least partially coincides with the monitoring range of any other lens group.
The multi-camera imaging apparatus according to claim 1, wherein a monitoring range of the lens group having the smallest focal length among the plurality of lens groups at least partially coincides with a monitoring range of any one of the lens groups, including: The area of the overlap of the portions of one lens group is more than 80% of its monitoring range.
The multi-view camera apparatus according to claim 1, wherein each of the shot groups corresponds to a depth of field, and the superposition of the depth of field of the plurality of shot groups covers the shot group having the smallest focal length The monitoring range corresponds to the depth.
The multi-view camera apparatus according to claim 3, wherein each of the shot groups corresponds to an image sharpness range based on a depth of field thereof, and an image clear range of all the shots of the plurality of shot groups The superimposition covers the monitoring range of the lens group with the smallest focal length.
The multi-view camera apparatus according to claim 1, wherein the monitoring range of the lens group having the smallest focal length has an angle in the horizontal direction of more than 170° and an angle in the vertical direction of more than 80°.
The multi-view camera apparatus according to claim 1, wherein each of the plurality of lenses included in the lens group is arranged in one or more rows, and the plurality of lens groups are sequentially arranged in a vertical direction.
The multi-view imaging apparatus according to claim 1, wherein the plurality of lens groups are arranged in a center line in a vertical direction.
A multi-view camera apparatus according to claim 1, wherein

The spacing between two horizontally adjacent lenses in at least one of the lens groups is the same; and/or

The spacing between two vertically adjacent lenses in at least one of the lens groups is the same.
A multi-view camera apparatus according to claim 1, wherein

The range of pictures taken by each of the two horizontally adjacent lenses in at least one of the lens groups has a coincident area of more than 2% in the horizontal direction.
The multi-view camera device according to claim 1, wherein for any two lens groups, the focal length of the lens group located above is larger than the focal length of the lens group located below; or for any two lens groups, located above The focal length of the lens group is smaller than the focal length of the lens group located below.
The multi-view imaging apparatus according to claim 1, wherein for any two lens groups, the number of lenses of the lens group having a large focal length is larger than the number of lenses of the lens group having a small focal length.
The multi-view image pickup apparatus according to claim 1, wherein, for any two lens groups, a distance between horizontally adjacent lenses of a lens group having a large focal length is smaller than a horizontal adjacent lens of a lens group having a small focal length Spacing; and/or

For any two lens groups, the spacing between vertically adjacent lenses of a lens group having a large focal length is smaller than the spacing between vertically adjacent lenses of a lens group having a small focal length.
A monitoring system, comprising: a multi-view camera device and an image recognition device,

The multi-view camera device includes a plurality of lens groups, wherein

Each lens group includes at least one lens, wherein at least one lens group includes at least two lenses, and each of the lens groups includes a plurality of lenses having the same focal length, the same focal length being a focal length of the lens group; and the plurality of The focal lengths of the lens groups are different; each lens group corresponds to a monitoring range;

The monitoring range of the lens group with the smallest focal length among the plurality of lens groups at least partially coincides with the monitoring range of the other at least one lens group;

The image recognition device is configured to identify a predetermined target image within a monitoring range of the lens group having the smallest focal length.
The multi-view camera apparatus according to claim 13, wherein a monitoring range of the lens group having the smallest focal length among the plurality of lens groups at least partially coincides with a monitoring range of any one of the lens groups, including: The area of the overlap of the portions of one lens group is more than 80% of its monitoring range.
The monitoring system according to claim 13, wherein each of the lens groups corresponds to a depth of field based on a focal length thereof; and a superposition of depth of field of the plurality of lens groups covers a monitoring range of the lens group having the smallest focal length The depth.
A monitoring system according to claim 15, wherein each of said shot groups corresponds to an image sharpness range based on its depth of field, and an image clear range superposition of all shots of said plurality of shot groups Covering the monitoring range of the lens group with the smallest focal length.
The monitoring system according to claim 13, wherein the monitoring range of the lens group having the smallest focal length has an angle greater than 170 in the horizontal direction and an angle greater than 80 in the vertical direction.
The monitoring system according to claim 13, wherein each of the plurality of lenses included in the lens group is formed into one or more rows, and the plurality of lens groups are sequentially arranged in a vertical direction.
The monitoring system according to claim 13, wherein said plurality of lens groups are arranged in a common center line in a vertical direction.
The monitoring system according to claim 13, wherein for any two lens groups, the focal length of the lens group located above is larger than the focal length of the lens group located below; or, for any two lens groups, the lens located above The focal length of the group is smaller than the focal length of the lens group located below.