CN114187724B - Target area security and monitoring system based on hundred million-level pixel camera - Google Patents
Target area security and monitoring system based on hundred million-level pixel camera Download PDFInfo
- Publication number
- CN114187724B CN114187724B CN202111452205.XA CN202111452205A CN114187724B CN 114187724 B CN114187724 B CN 114187724B CN 202111452205 A CN202111452205 A CN 202111452205A CN 114187724 B CN114187724 B CN 114187724B
- Authority
- CN
- China
- Prior art keywords
- light field
- angle
- security
- target area
- cameras
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Abstract
The invention provides a target area security and monitoring system based on a hundred million-level pixel camera, belonging to the technical field of high-resolution image recognition and processing. The system comprises: a light field camera array comprising a plurality of light field cameras; a light field information storage array for storing light field information acquired by the light field camera array for a target area; the overlapped light field identification subsystem is used for identifying overlapped light field information in two groups of different light field information obtained by the at least two light field cameras; the target light field voxelization subsystem is used for executing voxelization processing on the target light field corresponding to the overlapped light field information to obtain a plurality of voxelization results; the security and protection and monitoring processing subsystem sends a security and protection or monitoring signal based on the plurality of voxelization results; wherein at least one of the plurality of light field cameras has more than one hundred million pixels. The invention can realize intelligent and intelligent monitoring and security identification of a hundred million-level pixel monitoring area based on a light field camera array.
Description
Technical Field
The invention belongs to the technical field of high-resolution image recognition and processing, and particularly relates to a target area security and monitoring system based on a hundred million-level pixel camera.
Background
The advent of light field cameras based on microlens arrays has made it possible to apply light field techniques to ordinary cameras. The light field camera records light field information in space, and then calculates and processes the light field, so that the functions of digital focusing, field depth continuation, even aberration correction and the like can be realized.
High resolution (high pixels) represents a high quality and high definition, high definition video image that has wide applications in military, medical, surveillance, astronomy, and the like. Particularly in the aspect of area monitoring, the high-definition video image not only greatly enhances the direct observation capability of naked eyes, but also enables the subsequent image or video identification processing result to be easier to visualize.
The chinese patent application with application number CN201410637958 proposes a light field acquisition control method, which claims to realize that the focus adjustment range of the light field image acquired by the light field camera is adjustable to a certain extent, thereby better meeting the actual application requirements of diversification of main bodies such as users or equipment.
However, when the imaging resolution exceeds the hundred million level, the amount of data generated is also drastically increased; when the light field camera is adopted to acquire image data, the light field camera not only can acquire image information (planar and two-dimensional image information), but also can generate depth map information corresponding to the picture and point cloud information corresponding to the depth map through an acquired frame of image similar to a laser radar; the light field camera can also simultaneously acquire the spatial information and the angle information of light rays during imaging, so that the dimensionality of data is correspondingly increased. Under the condition that the data dimension and the data amount are increased simultaneously, how to quickly and timely process the monitoring scene data under hundred million-level pixels becomes a technical problem which needs to be processed by the technical personnel in the field.
Disclosure of Invention
In order to solve the technical problems, the invention provides a target area security and monitoring system based on a hundred million-level pixel camera.
Structurally, the target area security and monitoring system comprises a light field camera array, a light field information storage array, an overlapped light field identification subsystem, a target light field voxelization subsystem and a security and monitoring processing subsystem.
Wherein the light field camera array comprises a plurality of light field cameras; the light field information storage array is used for storing the light field information acquired by the light field camera array aiming at a target area; the overlapped light field identification subsystem is used for identifying overlapped light field information in two groups of different light field information obtained by at least two light field cameras;
the target light field voxelization subsystem is used for executing voxelization processing on the target light field corresponding to the overlapped light field information to obtain a plurality of voxelization results.
The security and protection and monitoring processing subsystem sends out security and protection signals or monitoring signals based on the plurality of voxelization results;
the monitoring signal is used for scheduling the shooting angle of at least one light field camera in the light field information array;
the security signal prompts the manager that the current monitoring area is abnormal.
As a most prominent feature of the application scenario of the present invention, at least one of the plurality of light field cameras has more than one hundred million pixels.
As one of the further improvements of the present invention, the target light field voxelization subsystem is configured to perform voxelization processing on the target light field corresponding to the overlapped light field information at multiple viewing angles, and obtain voxelization results at multiple different viewing angles.
The security and protection and monitoring processing subsystem obtains the voxelization results under the different viewing angles and judges whether the target object contained in the voxelization results under the different viewing angles is abnormal or not;
and if the abnormality exists, sending a security signal, and prompting the current monitoring area of the manager to have the abnormality by the security signal.
And if the target area has an abnormal target object, generating the monitoring signal at the same time, wherein the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array, and the shooting angle is determined by one of a first visual angle, a second visual angle or a third visual angle.
Specifically, the first viewing angle is a first viewing angle parallel to a first coordinate axis of the cartesian coordinate system, the second viewing angle is a second viewing angle parallel to a second coordinate axis of the cartesian coordinate system, and the third viewing angle is a third viewing angle parallel to a third coordinate axis of the cartesian coordinate system.
The light field camera array used in the technical scheme of the invention comprises a first group of light field cameras, a second group of light field cameras and a third group of light field cameras;
the first group of light field cameras captures a first angular range, the second group of light field cameras captures a second angular range, and the third light field camera captures a third angular range;
the first angle range and the second angle range are overlapped, the second angle range and the third angle range are overlapped, and the first angle range and the third angle range are not overlapped.
And the shooting angles of the first and third groups of light field cameras are adjustable; the shooting angle of the second group of light field cameras is not adjustable.
According to the technical scheme, multi-angle target area monitoring can be achieved through only one light field camera array; and in addition, under the condition that the light field camera in the target area obtains hundred million levels of pixel data, multi-view voxelization processing is carried out, whether abnormity exists is judged by integrating multi-view voxelization processing results, so that the security and monitoring accuracy of the target area of hundred million levels of pixels is ensured, and the one-sidedness of single-angle monitoring processing is avoided.
Further advantages of the invention will be apparent in the detailed description section in conjunction with the drawings attached hereto.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic diagram of a target area security and surveillance system based on a hundred million pixel cameras according to an embodiment of the present invention;
FIG. 2 is a schematic block diagram of a light field camera array for use in the hundred million pixel camera based target area security and surveillance system of FIG. 1;
FIG. 3 is a schematic diagram of the principle of performing a voxelization process on light-field information;
FIG. 4 is a schematic view of a plurality of view-agnostic voxelization results used in various embodiments of the present invention;
FIG. 5 is a schematic diagram of the security and monitoring effect of the target area achieved by the present invention
Detailed Description
The invention is further described with reference to the following drawings and detailed description.
Before describing the embodiments of the present invention, technical terms related to the technical solutions of the present application are first described in order to better understand the technical solutions and the improved concepts of the present application.
Array: the device is an element array formed by arranging a plurality of elements together according to a certain shape or rule.
In the present invention, a light field camera array is an element array formed by arranging a plurality of light field cameras or a plurality of light field sensors (lenses) together according to a certain shape or rule.
The optical field, similar to the concept of electric field and magnetic field, is used to describe some characteristics of light, including the information of light intensity, position, direction, etc.;
light-field cameras (Light-field cameras), also known as Plenoptic cameras (Plenoptic cameras), capture Light rays of different origin and at different angles, in particular with a very large number of tiny lenses, each lens being responsible for processing a certain number of pixels. Theoretically, if the number of lenses is large enough, it can be achieved that the light captured across the entire light field area is clearly distinguishable.
The light field camera can not only collect image information (planar and two-dimensional image information), but also generate depth map information corresponding to the picture and point cloud information corresponding to the depth map through a collected frame image like a laser radar; the light field camera can also simultaneously acquire spatial information and angle information of light rays during imaging, and map pixels in the two-dimensional image into a multi-dimensional (more than 2-dimensional, such as three-dimensional or four-dimensional) light field according to a certain rule for re-projection to obtain focusing images with different visual angles and different phase planes.
The point cloud refers to a massive collection of points of the surface characteristics of the target.
The point cloud obtained according to the laser measurement principle comprises three-dimensional coordinates (XYZ) and laser reflection Intensity (Intensity).
The point cloud obtained according to the photogrammetry principle comprises three-dimensional coordinates (XYZ) and color information (RGB).
And combining laser measurement and photogrammetry principles to obtain a point cloud comprising three-dimensional coordinates (XYZ), laser reflection Intensity (Intensity) and color information (RGB).
After the spatial coordinates and depth information of each sampling Point on the surface of the object are obtained, a set of points is obtained, which is called Point Cloud.
Further description of light field cameras can be found in the following prior art:
Adelson E H,Wang J Y A.Single Lens Stereo with a Plenoptic Camera[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):99-106.
US7965936 B2：4D light field cameras；
Su H,Maji S,Kalogerakis E,et al.Multi-view Convolutional Neural Networks for 3D Shape Recognition[J].IEEE,2015.
Veeraraghavan A,Raskar R,Agrawal A,et al.Dappled photography:mask enhanced cameras for heterodyned light fields and coded aperture[J].Acm Trans Graph,2007,26(3):69.
the above prior art is introduced as part of the disclosure of the present invention.
In fig. 1, the target area security and monitoring system based on a hundred million-level pixel camera comprises:
a light field camera array comprising a plurality of light field cameras;
a light field information storage array for storing light field information acquired by the light field camera array for a target region;
an overlapped light field identification subsystem for identifying overlapped light field information in two groups of different light field information obtained by at least two light field cameras;
a target light field voxelization subsystem, configured to perform voxelization processing on a target light field corresponding to the overlapped light field information to obtain a plurality of voxelization results;
the security and protection and monitoring processing subsystem sends a security and protection or monitoring signal based on the plurality of voxelization results;
wherein at least one of the plurality of light field cameras has more than one hundred million pixels.
The light field camera array comprises light field cameras whose shooting angles are adjustable;
the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array.
In particular, on the basis of fig. 1, see fig. 2.
In fig. 2, the light field camera array comprises a first set of light field cameras 1, a second set of light field cameras 2 and a third set of light field cameras 3;
the first group of light field cameras 1 captures a first angular range, the second group of light field cameras 2 captures a second angular range, and the third light field cameras 3 captures a third angular range;
the first angle range and the second angle range are overlapped, the second angle range and the third angle range are overlapped, and the first angle range and the third angle range are not overlapped.
And, with reference to the right schematic view of fig. 2, the shooting angles of the first and third sets of light field cameras 1, 3 are adjustable;
the shooting angle of the second group of light field cameras 2 is not adjustable.
According to this set of configurations, there is always one set of light field cameras that fixes the shooting angle, while the other two sets of light field cameras can adjust the respective shooting ranges (angles) in opposite directions.
In a specific structure, each light field camera is composed of a plurality of lenses, video pictures shot by each lens are consistent in the vertical direction, different angles are shot in the horizontal direction respectively, and the shot pictures of each camera have a certain overlapping area, so that enough characteristics are ensured to be spliced and fused between the video pictures of the adjacent lenses.
The light field camera array comprises light field cameras whose shooting angles are adjustable;
the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array.
Therefore, the invention can realize multi-angle target area monitoring by only one light field camera array.
Preferably, in an embodiment of the present invention, the target area security and monitoring system based on the giga-level pixel camera only includes one light field camera array, and the one light field camera array includes three sets of light field cameras.
After the light field camera of fig. 1-2 finishes obtaining the light field information acquired for the target area, it is sent to a light field information storage array;
because the light field camera array is composed of a plurality of light field cameras, each light field camera captures light rays from different sources and at different angles by a very large number of tiny lenses, each lens is responsible for processing a certain number of pixels, and in practical application, the number of pixels of each light field camera can reach more than 1 hundred million under the condition that each light field camera comprises enough lenses;
in addition, the light field camera can not only collect image information (planar and two-dimensional image information), but also generate depth map information corresponding to the image and point cloud information corresponding to the depth map through a collected frame image like a laser radar; the light field camera can also simultaneously acquire the spatial information and the angle information of light rays during imaging, so that imaging pixels of the light field camera can reach hundred million levels easily, and the data volume is huge.
As a more preferred example, the imaging resolution of the light field camera array is over one hundred million.
Preferably, the light field information storage array is an annular storage stack.
The storage mode of the ring stack is adopted instead of the queue, so that the phenomenon of overflow of the storage space under the condition of large quantity can be avoided.
When the annular stack is full, the full-stack storage data can be sent to the overlapped light field identification subsystem at one time instead of being sent at any time, and data processing pressure is relieved.
The overlapping light field identification subsystem is then used to identify overlapping light field information in two different sets of light field information obtained by at least two light field cameras.
Next, a voxelization phase is entered.
The target light field voxelization subsystem is used for executing voxelization processing on the target light field corresponding to the overlapped light field information to obtain a plurality of voxelization results.
Specifically, the performing the voxelization processing to obtain a plurality of voxelization results includes:
identifying a plurality of keyframe images in the overlapping light field information that contain a target object;
acquiring spatial angle information of light rays corresponding to the light field camera when the light field camera generates the plurality of key frame images;
determining a plurality of voxelized view angles based on the spatial angle information;
and performing voxelization on the target object contained in the overlapped light field information under the plurality of voxelization view angles respectively.
The voxelization refers to dividing a three-dimensional space into grid units according to spatial positions, and the point clouds are encoded according to the grids and are uniformly calculated.
Fig. 3 shows a schematic principle diagram of performing the voxelization on point cloud data.
However, fig. 3 shows that the point cloud scene is described by slicing the pixels in the three directions x, y, and z, which are finely divided in three dimensions.
The inventor finds that when the voxel is formed in the x direction, the y direction and the z direction, the selection of the voxel size has great influence on the precision and the time consumption, and if the division is dense, the calculation amount is greatly increased, and the time consumption is increased; and the division sparseness can cause great reduction of precision and has strong subjectivity.
Therefore, in the technical solution of the present invention, the target light field voxelization subsystem is configured to perform voxelization processing on the target light field corresponding to the overlapped light field information at multiple viewing angles, and obtain voxelization results at multiple different viewing angles.
The view angles are no longer voxelized in the x, y and z directions.
Specifically, the plurality of viewing angles includes one of: a viewing angle parallel to the coordinate axes of the cartesian coordinate system, a viewing angle of the cylindrical coordinate system, a viewing angle of the spherical coordinate system.
As described in fig. 4.
Taking a cartesian coordinate system as an example, the viewing angles parallel to the coordinate axes of the cartesian coordinate system include: a viewing angle parallel to a first coordinate axis of the cartesian coordinate system, a viewing angle parallel to a second coordinate axis of the cartesian coordinate system, and a viewing angle parallel to a third coordinate axis of the cartesian coordinate system.
The security and protection and monitoring processing subsystem sends out security and protection signals based on the plurality of voxelization results, and the security and protection and monitoring processing subsystem specifically comprises:
the security and protection and monitoring processing subsystem obtains the voxelization results under the different viewing angles and judges whether the target object contained in the voxelization results under the different viewing angles is abnormal or not;
and if the abnormality exists, sending a security signal, and prompting the current monitoring area of the manager to have the abnormality by the security signal.
The security and protection and monitoring processing subsystem sends out security and protection signals based on the plurality of voxelization results, and the security and protection and monitoring processing subsystem specifically comprises:
the security and monitoring processing subsystem obtains a first pixelation result under a first visual angle parallel to a first coordinate axis of a Cartesian coordinate system, a second pixelation result under a second visual angle parallel to a second coordinate axis of the Cartesian coordinate system, and a third pixelation result under a third visual angle parallel to a third coordinate axis of the Cartesian coordinate system;
and if the depth information of the first pixelation result, the second pixelation result and the third pixelation result is not matched, judging that the target area has an abnormal target object.
As a specific implementation manner, motion pattern analysis is performed on the planar imaging information under a viewing angle (under a third viewing angle) where a third pixilated result in the light field imaging information is parallel to the Z-axis of the cartesian coordinate system, so as to obtain a first motion pattern analysis result;
performing motion mode analysis on the planar imaging information under a visual angle (under a first visual angle) parallel to the Y axis of a Cartesian coordinate system according to the first pixelation result in the light field imaging information to obtain a second motion mode analysis result;
performing motion mode analysis on the planar imaging information under the visual angle (under a second visual angle) where the second pixelation result in the light field imaging information is parallel to the Z axis of the Cartesian coordinate system to obtain a third motion mode analysis result;
judging whether the local target monitoring area is abnormal or not based on the plurality of action mode analysis results and the depth of field information corresponding to each imaging visual angle, and specifically comprising the following steps:
and if the first action pattern analysis result, the second action pattern analysis result and the third action pattern analysis result are judged to be abnormal in action, and the depth of field data of the z axis, the depth of field data of the X axis and the depth of field data of the Y axis are matched with each other, judging that the local target monitoring area is abnormal.
Here, the matching means that the target object in the monitoring area can be restored by combining the depth data of the z axis, the depth data of the X axis, and the depth data of the Y axis.
Of course, the above is only a cartesian coordinate system. In practical application, the visual angle of a cylindrical coordinate system and the visual angle of a spherical coordinate system can also be adopted; or divided into a bird's-eye view angle, a projection view angle, and the like. The step of performing the monitoring mode analysis on the target monitoring area can be performed by obtaining a plurality of planar imaging information of at least two or more from a plurality of viewing angles, performing the motion mode analysis on the planar imaging information, obtaining a plurality of motion mode analysis results, and then combining the depth of field data.
And if the target area has an abnormal target object, generating the monitoring signal at the same time, wherein the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array, and the shooting angle is determined by one of the first view angle, the second view angle or the third view angle.
FIG. 5 shows a schematic diagram of the security and monitoring effect of the target area achieved by the present invention.
In fig. 5, the left side is a second motion pattern analysis result obtained by performing motion pattern analysis on the planar imaging information under the viewing angle (under the first viewing angle) where the first pixelation result in the light field imaging information is parallel to the Y-axis of the cartesian coordinate system; the right side is a third motion mode analysis result obtained by performing motion mode analysis on the planar imaging information under the view angle (under the second view angle) in which the second pixelation result in the light field imaging information is parallel to the Z axis of the cartesian coordinate system.
As can be seen from the figure, the depth information of the planar imaging information at the viewing angle (at the first viewing angle) where the Y axis is parallel to the depth information of the planar imaging information at the viewing angle (at the second viewing angle) where the Z axis is parallel to the Z axis cannot be matched with each other, and therefore, the target object in the monitoring area cannot be restored after the Z-axis depth data, the X-axis depth data, and the Y-axis depth data are combined with each other, and thus, there is an abnormality.
At this time, the shooting angle of at least one light field camera in the light field information array needs to be scheduled to be an angle deviated to the Y axis or the Z axis, that is, shooting at the first view angle or the second view angle is clearer.
Whether the local target monitoring area is abnormal or not can be accurately judged through the multi-mode analysis result of the local multi-view angles, the limitation of single-mode analysis is avoided, and in the aspect of global identification, whether the current shooting angle is suitable for the monitoring requirement of the current target area or the target person or not can be identified from the global angle through global overlapped light field identification and multi-view angle voxelization results.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting the same, and although the present invention is described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications and equivalents may be made to the embodiments of the invention without departing from the spirit and scope of the invention, which is to be covered by the claims.
The present invention is not limited to the specific module structure described in the prior art. The prior art mentioned in the background section can be used as part of the invention to understand the meaning of some technical features or parameters. The scope of the present invention is defined by the claims.
Claims (8)
1. A target area security and monitoring system based on a hundred million-level pixel camera is characterized in that:
the system comprises:
a light field camera array comprising a plurality of light field cameras;
a light field information storage array for storing light field information acquired by the light field camera array for a target region;
an overlapped light field identification subsystem for identifying overlapped light field information in two sets of different light field information obtained by at least two light field cameras;
the target light field voxelization subsystem is used for executing voxelization processing on a target light field corresponding to the overlapped light field information under multiple viewing angles to obtain voxelization results under multiple different viewing angles;
the security and monitoring processing subsystem obtains a first pixelation result under a first visual angle parallel to a first coordinate axis of a Cartesian coordinate system, a second pixelation result under a second visual angle parallel to a second coordinate axis of the Cartesian coordinate system, and a third pixelation result under a third visual angle parallel to a third coordinate axis of the Cartesian coordinate system;
and if the depth information of the first materialization result, the second materialization result and the third materialization result is not matched, judging that an abnormal target object exists in the target area, and sending a security or monitoring signal.
2. The target area security and surveillance system based on a giga-level pixel camera of claim 1, wherein:
the light field camera array comprises light field cameras whose shooting angles are adjustable;
the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array.
3. The target area security and surveillance system based on a giga-level pixel camera of claim 1, wherein:
at least one of the plurality of light field cameras has more than one hundred million pixels.
4. The target area security and surveillance system based on a giga-level pixel camera of claim 1, wherein:
the security signal prompts the manager that the current monitoring area is abnormal.
5. A target area security and surveillance system based on a hundred million pixel camera as claimed in any one of claims 1-4, wherein:
the light field camera array comprises a first set of light field cameras, a second set of light field cameras, and a third set of light field cameras;
the first group of light field cameras captures a first angular range, the second group of light field cameras captures a second angular range, and the third group of light field cameras captures a third angular range;
the first angle range and the second angle range are overlapped, the second angle range and the third angle range are overlapped, and the first angle range and the third angle range are not overlapped.
6. The target area security and surveillance system based on a hundred million pixel camera of claim 5, wherein:
the shooting angles of the first and third groups of light field cameras are adjustable;
the shooting angle of the second group of light field cameras is not adjustable.
7. A target area security and surveillance system based on a hundred million pixel camera as claimed in claim 3 or 4, characterized in that:
the plurality of perspectives further comprises one of: the viewing angle of a cylindrical coordinate system and the viewing angle of a spherical coordinate system.
8. The target area security and surveillance system based on a giga-level pixel camera of claim 1, wherein:
and if the target area has an abnormal target object, generating the monitoring signal at the same time, wherein the monitoring signal is used for scheduling a shooting angle of at least one light field camera in the light field information array, and the shooting angle is determined by one of the first view angle, the second view angle or the third view angle.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111452205.XA CN114187724B (en) | 2021-12-01 | 2021-12-01 | Target area security and monitoring system based on hundred million-level pixel camera |
| PCT/CN2022/128144 WO2023098362A1 (en) | 2021-12-01 | 2022-10-28 | Target area security and monitoring system based on hundred-million-level pixel camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111452205.XA CN114187724B (en) | 2021-12-01 | 2021-12-01 | Target area security and monitoring system based on hundred million-level pixel camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114187724A CN114187724A (en) | 2022-03-15 |
| CN114187724B true CN114187724B (en) | 2022-07-12 |
Family
ID=80541068
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111452205.XA Active CN114187724B (en) | 2021-12-01 | 2021-12-01 | Target area security and monitoring system based on hundred million-level pixel camera |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114187724B (en) |
| WO (1) | WO2023098362A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114187724B (en) * | 2021-12-01 | 2022-07-12 | 北京拙河科技有限公司 | Target area security and monitoring system based on hundred million-level pixel camera |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011110268A1 (en) * | 2010-03-12 | 2011-09-15 | Muehlbauer Ag | Checkpoint with a camera system |
| CN102833487A (en) * | 2012-08-08 | 2012-12-19 | 中国科学院自动化研究所 | Visual computing-based optical field imaging device and method |
| CN107561311A (en) * | 2017-07-11 | 2018-01-09 | 上海交通大学 | Three-dimensional flow field method of testing based on double light-field cameras |
| CN110139045A (en) * | 2019-06-17 | 2019-08-16 | 北京拙河科技有限公司 | One kind hundred million grades of pixel videos acquisitions, processing, methods of exhibiting, apparatus and system |
| CN110991550A (en) * | 2019-12-13 | 2020-04-10 | 歌尔科技有限公司 | Video monitoring method and device, electronic equipment and storage medium |
| CN112367474A (en) * | 2021-01-13 | 2021-02-12 | 清华大学 | Self-adaptive light field imaging method, device and equipment |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105472233B (en) * | 2014-09-09 | 2019-01-18 | 北京智谷技术服务有限公司 | Optical field acquisition control method and device, optical field acquisition equipment |
| CN104243823B (en) * | 2014-09-15 | 2018-02-13 | 北京智谷技术服务有限公司 | Optical field acquisition control method and device, optical field acquisition equipment |
| CN106144801B (en) * | 2015-04-03 | 2021-05-18 | 奥的斯电梯公司 | Depth sensor based sensing for special passenger transport vehicle load conditions |
| CN206628054U (en) * | 2017-02-21 | 2017-11-10 | 南方科技大学 | A kind of image collecting device and fire hazard monitoring system based on microlens array |
| CN111818274A (en) * | 2019-04-09 | 2020-10-23 | 深圳市视觉动力科技有限公司 | Optical unmanned aerial vehicle monitoring method and system based on three-dimensional light field technology |
| US11082659B2 (en) * | 2019-07-18 | 2021-08-03 | Microsoft Technology Licensing, Llc | Light field camera modules and light field camera module arrays |
| WO2021217031A1 (en) * | 2020-04-23 | 2021-10-28 | The Regents Of The University Of California | Ultrafast light field tomography |
| CN111862184B (en) * | 2020-07-03 | 2022-10-11 | 北京航空航天大学 | Light field camera depth estimation system and method based on polar image color difference |
| CN113436130B (en) * | 2021-08-25 | 2021-12-21 | 清华大学 | Intelligent sensing system and device for unstructured light field |
| CN114187724B (en) * | 2021-12-01 | 2022-07-12 | 北京拙河科技有限公司 | Target area security and monitoring system based on hundred million-level pixel camera |
-
2021
- 2021-12-01 CN CN202111452205.XA patent/CN114187724B/en active Active
-
2022
- 2022-10-28 WO PCT/CN2022/128144 patent/WO2023098362A1/en unknown
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011110268A1 (en) * | 2010-03-12 | 2011-09-15 | Muehlbauer Ag | Checkpoint with a camera system |
| CN102833487A (en) * | 2012-08-08 | 2012-12-19 | 中国科学院自动化研究所 | Visual computing-based optical field imaging device and method |
| CN107561311A (en) * | 2017-07-11 | 2018-01-09 | 上海交通大学 | Three-dimensional flow field method of testing based on double light-field cameras |
| CN110139045A (en) * | 2019-06-17 | 2019-08-16 | 北京拙河科技有限公司 | One kind hundred million grades of pixel videos acquisitions, processing, methods of exhibiting, apparatus and system |
| CN110991550A (en) * | 2019-12-13 | 2020-04-10 | 歌尔科技有限公司 | Video monitoring method and device, electronic equipment and storage medium |
| CN112367474A (en) * | 2021-01-13 | 2021-02-12 | 清华大学 | Self-adaptive light field imaging method, device and equipment |
Non-Patent Citations (3)
| Title |
|---|
| 《3D object detection and instance segmentation from 3D range and 2D color images》;Shen Xiaoke,Stamos;《SENSORS》;20210331;第21卷(第4期);全文 * |
| 《基于深度体素卷积神经网络的三维模型识别分类》;杨军、王顺、周鹏;《光学学报》;20190430;第39卷(第4期);全文 * |
| 一种有效的基于点云特征人体识别方法;杨晶东等;《计算机应用研究》;20170515(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114187724A (en) | 2022-03-15 |
| WO2023098362A1 (en) | 2023-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109813251B (en) | Method, device and system for three-dimensional measurement | |
| CN110036410B (en) | Apparatus and method for obtaining distance information from view | |
| CN107635129B (en) | Three-dimensional trinocular camera device and depth fusion method | |
| CN104902246A (en) | Video monitoring method and device | |
| CN109883391B (en) | Monocular distance measurement method based on digital imaging of microlens array | |
| EP3144894B1 (en) | Method and system for calibrating an image acquisition device and corresponding computer program product | |
| CN111080705B (en) | Calibration method and device for automatic focusing binocular camera | |
| WO2020207172A1 (en) | Method and system for optical monitoring of unmanned aerial vehicles based on three-dimensional light field technology | |
| US20220172380A1 (en) | Three-dimensional light field technology-based optical unmanned aerial vehicle monitoring system | |
| US20210377432A1 (en) | Information processing apparatus, information processing method, program, and interchangeable lens | |
| CN108805921B (en) | Image acquisition system and method | |
| CN114187724B (en) | Target area security and monitoring system based on hundred million-level pixel camera | |
| CN112470189B (en) | Occlusion cancellation for light field systems | |
| CN114170567B (en) | Light field camera AI analysis system and method for monitoring hundred million level pixels of area | |
| WO2020163742A1 (en) | Integrated spatial phase imaging | |
| CN116051876A (en) | Camera array target recognition method and system of three-dimensional digital model | |
| Zhang et al. | Virtual image array generated by Risley prisms for three-dimensional imaging | |
| KR20160120533A (en) | Image sementation method in light field image | |
| CN210327775U (en) | Optical unmanned aerial vehicle monitoring system based on three-dimensional light field technology | |
| WO2018160989A1 (en) | Multi-camera system for tracking one or more objects through a scene | |
| CN109272453B (en) | Modeling device and positioning method based on 3D camera | |
| CN115514877B (en) | Image processing apparatus and noise reduction method | |
| CN112866546A (en) | Focusing method and device, electronic equipment and computer readable storage medium | |
| RU2806249C1 (en) | Method for obtaining high spatial resolution images by opto-electronic observation tool for remote objects | |
| Kacperski et al. | Calibration of vision systems operating in separate coordinate systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |