CN108470150A - A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera - Google Patents

A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera Download PDF

Info

Publication number
CN108470150A
CN108470150A CN201810152225.7A CN201810152225A CN108470150A CN 108470150 A CN108470150 A CN 108470150A CN 201810152225 A CN201810152225 A CN 201810152225A CN 108470150 A CN108470150 A CN 108470150A
Authority
CN
China
Prior art keywords
information
characteristic
data
biological
visible light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201810152225.7A
Other languages
Chinese (zh)
Inventor
左忠斌
左达宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianmu Love Vision (beijing) Technology Co Ltd
Tianmu Aishi Beijing Technology Co Ltd
Original Assignee
Tianmu Love Vision (beijing) Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianmu Love Vision (beijing) Technology Co Ltd filed Critical Tianmu Love Vision (beijing) Technology Co Ltd
Priority to CN201810152225.7A priority Critical patent/CN108470150A/en
Publication of CN108470150A publication Critical patent/CN108470150A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/70Multimodal biometrics, e.g. combining information from different biometric modalities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462Salient features, e.g. scale invariant feature transforms [SIFT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present invention provides a kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera.This method includes:The camera matrix formed using more Visible Light Cameras is acquired biological information, obtains several biometric images, and records the time data of acquisition biological information;Characteristic point is extracted from each width biometric image of several biometric images;Respective characteristic point in several biometric images based on extraction generates the feature point cloud data of biological characteristic;According to feature point cloud data and time data, the 3D models of the biological characteristic with time dimension are built, to realize the acquisition of biological characteristic 4 D data.The embodiment of the present invention completely restores various features of the biological characteristic on room and time, unlimited possibility is provided for the application of subsequent bio characteristic using the characteristic information of biological characteristic spatially is collected.

Description

A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera
Technical field
The present invention relates to biometrics identification technology field, especially a kind of biological characteristic based on Visible Light Camera is four-dimensional Collecting method and device.
Background technology
Biological characteristic is the intrinsic physiology or behavioural characteristic, such as fingerprint, palmmprint, iris or head face etc. of biology. Biological characteristic has certain uniqueness, i.e., the diversity ratio between certain biological characteristic of any two biology is larger, this allows for giving birth to Object feature is well suited for applying in the scenes such as the authentication information in authentication or identifying system.
Current biological attribute data is all the 2D data of space plane, related by taking the biological characteristic of head face as an example The data application of head face all rests on simple picture using upper, i.e., can only come from some specific angle to head face Data are handled, are identified and otherwise application;Again by taking the biological characteristic of hand as an example, mainly by the way of 2D come Identify that some or several hands refer to the feature in portion, part criminal refers to the collected 2D pictures in portion according to hand, copies 2D hands refer to portion's feature, and part identifying system of out-tricking brings prodigious security risk to personal information security.
Therefore, there is an urgent need for being directed to biological characteristic to carry out multidimensional data acquisition, safety is improved, and nothing is provided for subsequent application The possibility of limit.
Invention content
In view of the above problems, it is proposed that the present invention overcoming the above problem in order to provide one kind or solves at least partly State the biological characteristic 4 D data acquisition method based on Visible Light Camera of problem and corresponding device.
One side according to the ... of the embodiment of the present invention provides a kind of biological characteristic 4 D data based on Visible Light Camera and adopts Set method, including:
The camera matrix formed using more Visible Light Cameras is acquired biological information, and it is special to obtain several biologies Image is levied, and records the time data of acquisition biological information;
Characteristic point is extracted from each width biometric image of several biometric images;
Based on respective characteristic point in several biometric images described in extraction, the characteristic point cloud number of biological characteristic is generated According to;
According to the feature point cloud data and the time data, the 3D moulds of the biological characteristic with time dimension are built Type, to realize the acquisition of biological characteristic 4 D data.
Optionally, described based on respective characteristic point in several biometric images described in extraction, generate biological characteristic Feature point cloud data the step of further comprise:
According to the feature of respective characteristic point in several biometric images described in extraction, the matching of characteristic point is carried out, Establish matched characteristic point data collection;
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic spatially opposite Position, and calculate according to the relative position spatial depth information of the characteristic point in several described biometric images;
According to the spatial depth information of matched characteristic point data collection and characteristic point, the characteristic point cloud number of biological characteristic is generated According to.
Optionally, the feature of respective characteristic point is converted using scale invariant feature in several described biometric images SIFT feature describes son to describe.
Optionally, the optical information according to more Visible Light Cameras calculates each camera and exists relative to biological characteristic The step of relative position spatially, further comprises:
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic using light-stream adjustment Relative position spatially.
Optionally, the spatial depth information of the characteristic point in several described biometric images includes:Spatial positional information And colouring information.
Optionally, described according to the feature point cloud data and the time data, build the biology with time dimension The step of 3D models of feature, further comprises:
Set the reference dimension of 3D models to be built;
According to the spatial positional information of the reference dimension and the feature point cloud data, the feature point cloud data is determined In each characteristic point bulk, to build the 3D models of biological characteristic;
According to the 3D models of the biological characteristic of structure and the time data, the biological characteristic with time dimension is generated 3D models.
Optionally, the 3D models of the biological characteristic include at least one following three-dimensional data:
The spatial form characteristic of 3D models is described;
The surface texture feature data of 3D models are described;
The Facing material and light characteristic of 3D models are described.
Optionally, before the camera matrix formed using more Visible Light Cameras is acquired biological information, The method further includes being laid out more Visible Light Cameras in the following manner:
Support construction is built, arc bearing structure is set in the support construction;
More Visible Light Cameras are arranged in the arc bearing structure.
Optionally, if the biological information is head facial information, the method further includes:
The pedestal being connect with the support construction is built, on the base seat of the setting for fixed biological picture-taking position Chair;
When biology is located on the seat, more Visible Light Camera groups being arranged in the arc bearing structure are utilized At camera matrix head facial information is acquired.
Optionally, the method further includes:
Display is set in the arc bearing structure;
It is aobvious by visual means over the display after structure obtains having the 3D models of head face of time dimension Show head face 4 D data.
Optionally, the method further includes:
Before the camera matrix formed using more Visible Light Cameras is acquired head facial information, pass through display Device interface sets the parameter of taking pictures of each camera.
Optionally, if the biological information is hand information, the support construction is cabinet, the arc carrying In the cabinet, the method further includes structure setting:
Transparent glass cover board is arranged in the one side of camera lens towards more Visible Light Cameras on the cabinet;
When the hand placement of biology is on the transparent glass cover board, using being arranged in the arc bearing structure The camera matrix of more Visible Light Cameras composition is acquired hand information.
Optionally, the method further includes:
Display is set on the cabinet;
After structure obtains having the 3D models of hand of time dimension, hand is shown by visual means over the display Portion's 3D data.
Optionally, the method further includes:
Before the camera matrix formed using more Visible Light Cameras is acquired hand information, by display circle Face sets the parameter of taking pictures of each camera.
Another aspect according to the ... of the embodiment of the present invention additionally provides a kind of four dimension of biological characteristic based on Visible Light Camera According to harvester, including:
Information acquisition unit, the camera matrix for being formed using more Visible Light Cameras adopt biological information Collection, obtains several biometric images, and records the time data of acquisition biological information;
Feature point extraction unit, for extracting feature from each width biometric image of several biometric images Point;
Point cloud generation unit, for based on respective characteristic point in several biometric images described in extraction, generating life The feature point cloud data of object feature;
Construction unit, for according to the feature point cloud data and the time data, building the life with time dimension The 3D models of object feature, to realize the acquisition of biological characteristic 4 D data.
Optionally, described cloud generation unit is additionally operable to:
According to the feature of respective characteristic point in several biometric images described in extraction, the matching of characteristic point is carried out, Establish matched characteristic point data collection;
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic spatially opposite Position, and calculate according to the relative position spatial depth information of the characteristic point in several described biometric images;
According to the spatial depth information of matched characteristic point data collection and characteristic point, the characteristic point cloud number of biological characteristic is generated According to.
Optionally, the feature of respective characteristic point is converted using scale invariant feature in several described biometric images SIFT feature describes son to describe.
Optionally, described cloud generation unit is additionally operable to:
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic using light-stream adjustment Relative position spatially.
Optionally, the spatial depth information of the characteristic point in several described biometric images includes:Spatial positional information And colouring information.
Optionally, the construction unit is additionally operable to:
Set the reference dimension of 3D models to be built;
According to the spatial positional information of the reference dimension and the feature point cloud data, the feature point cloud data is determined In each characteristic point bulk, to build the 3D models of biological characteristic;
According to the 3D models of the biological characteristic of structure and the time data, the biological characteristic with time dimension is generated 3D models.
Optionally, the 3D models of the biological characteristic include at least one following three-dimensional data:
The spatial form characteristic of 3D models is described;
The surface texture feature data of 3D models are described;
The Facing material and light characteristic of 3D models are described.
Optionally, described device further includes:
Camera matrix layout unit, for using the camera square that more Visible Light Cameras form in described information collecting unit Before battle array is acquired biological information, it is laid out more Visible Light Cameras in the following manner:
Support construction is built, arc bearing structure is set in the support construction;
More Visible Light Cameras are arranged in the arc bearing structure.
Optionally, if the biological information is head facial information, described information collecting unit is additionally operable to:
The pedestal being connect with the support construction is built, on the base seat of the setting for fixed biological picture-taking position Chair;
When biology is located on the seat, more Visible Light Camera groups being arranged in the arc bearing structure are utilized At camera matrix head facial information is acquired.
Optionally, described device further includes:
First display unit, for display to be arranged in the arc bearing structure;It is obtained with time dimension in structure After the 3D models of the head face of degree, head face 4 D data is shown by visual means over the display.
Optionally, described information collecting unit is additionally operable to:
Before the camera matrix formed using more Visible Light Cameras is acquired head facial information, pass through display Device interface sets the parameter of taking pictures of each camera.
Optionally, if the biological information is hand information, the support construction is cabinet, the arc carrying In the cabinet, described information collecting unit is additionally operable to structure setting:
Transparent glass cover board is arranged in the one side of camera lens towards more Visible Light Cameras on the cabinet;
When the hand placement of biology is on the transparent glass cover board, using being arranged in the arc bearing structure The camera matrix of more Visible Light Cameras composition is acquired hand information.
Optionally, described device further includes:
Second display unit, for display to be arranged on the cabinet;The hand with time dimension is obtained in structure 3D models after, over the display pass through visual means show hand 3D data.
Optionally, described information collecting unit is additionally operable to:
Before the camera matrix formed using more Visible Light Cameras is acquired hand information, by display circle Face sets the parameter of taking pictures of each camera.
An embodiment of the present invention provides a kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera, It is specifically that the camera matrix formed using more Visible Light Cameras is acquired biological information in method, obtains several Biometric image, and record the time data of acquisition biological information;And then it is given birth to from each width of several biometric images Characteristic point is extracted in object characteristic image;Subsequently, based on respective characteristic point in several biometric images of extraction, biology is generated The feature point cloud data of feature;Later, according to feature point cloud data and time data, the biological characteristic with time dimension is built 3D models, to realize the acquisition of biological characteristic 4 D data.It can be seen that the embodiment of the present invention uses more Visible Light Cameras Control technology carries out the acquisition of biological information, can significantly improve the collecting efficiency of biological information;Also, the present invention It is special completely to restore the items of biological characteristic spatially using the characteristic information of biological characteristic spatially is collected for embodiment Sign, unlimited possibility is provided for the application of subsequent biological attribute data.
Further, parallel computation of the embodiment of the present invention based on central processing unit and graphics processor, can be rapidly and efficiently It realizes the processing of characteristic information and puts the generation of cloud in ground.Also, using scale invariant feature conversion SIFT feature description son knot The computation capability for closing special graph processor, can fast implement the generation of the matching and space characteristics point cloud of characteristic point. In addition, using unique sizing calibration method, the bulk of any characteristic point of biological characteristic can be quickly and accurately extracted, it is raw At the 3D models of the biological characteristic with time dimension, to realize the acquisition of 4 D data.
Above description is only the general introduction of technical solution of the present invention, in order to better understand the technical means of the present invention, And can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, below the special specific implementation mode for lifting the present invention.
According to the following detailed description of specific embodiments of the present invention in conjunction with the accompanying drawings, those skilled in the art will be brighter The above and other objects, advantages and features of the present invention.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows the biological characteristic 4 D data acquisition method according to an embodiment of the invention based on Visible Light Camera Flow chart;
Fig. 2 shows the flow charts of the method for more Visible Light Cameras of layout according to an embodiment of the invention;
Fig. 3 shows the signal of head face Visible Light Camera 4 D data collecting device according to an embodiment of the invention Figure;
Fig. 4 shows the schematic diagram of the internal module of bearing structure and external connection in collecting device shown in Fig. 3;
Fig. 5 shows the connection of serial ports integration module, camera matrix and central processing module in collecting device shown in Fig. 3 Schematic diagram;
Fig. 6 shows the signal of human hands Visible Light Camera 4 D data collecting device according to an embodiment of the invention Figure;
Fig. 7 shows the schematic diagram of the central control module and external connection of collecting device shown in fig. 6;
Fig. 8 shows that human hands according to an embodiment of the invention refer to the schematic diagram of portion information collection position;
Fig. 9 shows the biological characteristic 4 D data harvester according to an embodiment of the invention based on Visible Light Camera Structural schematic diagram;And
Figure 10 shows the biological characteristic 4 D data acquisition according to another embodiment of the present invention based on Visible Light Camera The structural schematic diagram of device.
Specific implementation mode
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure Completely it is communicated to those skilled in the art.
4 D data in the present invention refers to that three-dimensional space data binding time dimension data is formed by data, three-dimensional space Between binding time dimension refer to:Multiple same time intervals or different time intervals, different angle, different direction or different conditions Situations such as image or image formed data acquisition system.
In order to solve the above technical problems, an embodiment of the present invention provides a kind of, the biological characteristic based on Visible Light Camera is four-dimensional Collecting method.Fig. 1 shows that the biological characteristic 4 D data according to an embodiment of the invention based on Visible Light Camera is adopted The flow chart of set method.As shown in Figure 1, this method may comprise steps of S102 to step S108.
Step S102, the camera matrix formed using more Visible Light Cameras are acquired biological information, obtain Several biometric images, and record the time data of acquisition biological information.
Step S104 extracts characteristic point from each width biometric image of several biometric images.
Step S106, respective characteristic point in several biometric images based on extraction, generates the feature of biological characteristic Point cloud data.
Step S108 builds the 3D moulds of the biological characteristic with time dimension according to feature point cloud data and time data Type, to realize the acquisition of biological characteristic 4 D data.
The embodiment of the present invention carries out the acquisition of biological information using more Visible Light Camera control technologies, can be notable Improve the collecting efficiency of biological information;Also, the embodiment of the present invention utilizes and collects the feature of biological characteristic spatially Information, completely restores the various features of biological characteristic spatially, and the application for subsequent biological attribute data provides nothing The possibility of limit.In addition, time data of the embodiment of the present invention also based on acquisition biological information, structure have time dimension Biological characteristic 3D models, can preferably restore various features of the biological characteristic on room and time, meet subsequent Plurality of application scenes.
For the embodiment of the present invention when carrying out collecting biological feature information using a camera, this camera can be along predetermined Track turns around shooting, to realize the multi-angled shooting to biological information.
In embodiments of the present invention, 4 D data can be multiple same time intervals or different time intervals, different angles The 3D data acquisition systems of degree, different direction, different expression forms etc..
In above step S104, characteristic point is extracted from each width biometric image of several biometric images, is had Body is handled several biometric images, and respective characteristic point in several biometric images is extracted.
In the alternative embodiment of the present invention, in above step S106 in several biometric images based on extraction respectively Characteristic point, generate the feature point cloud data of biological characteristic, can be specifically to include the following steps S1061 to step S1063.
Step S1061 carries out characteristic point according to the feature of respective characteristic point in several biometric images of extraction Matching, establishes matched characteristic point data collection.
Step S1062 calculates each camera relative to biological characteristic in sky according to the optical information of more Visible Light Cameras Between on relative position, and calculate according to relative position the spatial depth information of the characteristic point in several biometric images.
Step S1063 generates biological characteristic according to the spatial depth information of matched characteristic point data collection and characteristic point Feature point cloud data.
In above step S1061, SIFT may be used in the feature of respective characteristic point in several biometric images (Scale-Invariant Feature Transform, scale invariant feature conversion) Feature Descriptor describes.SIFT feature Description has 128 feature description vectors, and the spy of 128 aspects of any characteristic point can be described on direction and scale Sign significantly improves the precision to feature description, while Feature Descriptor has independence spatially.
In step S1062, according to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic Relative position spatially, an embodiment of the present invention provides a kind of optional schemes, in this scenario, can according to more The optical information of light-exposed camera calculates the opposite position of each camera spatially relative to biological characteristic using light-stream adjustment It sets.
In the definition of light-stream adjustment, it is assumed that there are one the points in 3d space, it is by multiple phases positioned at different location Machine sees, then light-stream adjustment is to extract the coordinate of 3D points and each camera from these various visual angles information The process of relative position and optical information.
Further, the spatial depth information of the characteristic point in several biometric images referred in step S1062 can To include:Spatial positional information and colouring information, that is, can be characteristic point in the X axis coordinate of spatial position, characteristic point in space The Y axis coordinate of position, characteristic point are in the value in the channels R of the Z axis coordinate of spatial position, the colouring information of characteristic point, characteristic point The channels Alpha of the colouring information of the value in the channels G of colouring information, the value of the channel B of the colouring information of characteristic point, characteristic point Value etc..In this way, containing the spatial positional information and colouring information of characteristic point, characteristic point cloud in the feature point cloud data generated The format of data can be as follows:
X1 Y1 Z1 R1 G1 B1 A1
X2 Y2 Z2 R2 G2 B2 A2
……
Xn Yn Zn Rn Gn Bn An
Wherein, X axis coordinate of the Xn expression characteristic points in spatial position;Y axis coordinate of the Yn expression characteristic points in spatial position; Z axis coordinate of the Zn expression characteristic points in spatial position;Rn indicates the value in the channels R of the colouring information of characteristic point;Gn indicates feature The value in the channels G of the colouring information of point;Bn indicates the value of the channel B of the colouring information of characteristic point;An indicates the color of characteristic point The value in the channels Alpha of information.
In the alternative embodiment of the present invention, according to feature point cloud data and time data, structure in above step S108 The 3D models of biological characteristic with time dimension can be specifically the reference dimension for setting 3D models to be built;And then root According to the spatial positional information of reference dimension and feature point cloud data, the space ruler of each characteristic point in feature point cloud data is determined It is very little, to build the 3D models of biological characteristic;Later, according to the 3D models and time data of the biological characteristic of structure, tool is generated The 3D models of the biological characteristic of having time dimension.
May include the spatial form characteristic for describing 3D models, description in the 3D models of the biological characteristic of structure The three-dimensional datas such as the surface texture feature data of 3D models, the Facing material for describing 3D models and light characteristic, the present invention Embodiment is not restricted this.
In the alternative embodiment of the present invention, the camera square of more Visible Light Cameras composition is used in above step S102 Before battle array is acquired biological information, more Visible Light Cameras can also be laid out, as shown in Fig. 2, more of layout is visible The method of light camera may comprise steps of S202 to step S204.
Step S202 builds support construction, and arc bearing structure is arranged on the support structure.
More Visible Light Cameras are arranged in arc bearing structure by step S204.
It can be seen that the embodiment of the present invention carries out adopting for biological information using more Visible Light Camera control technologies Collection, can significantly improve the collecting efficiency of biological information.
Further, when the biological characteristic difference for needing to acquire, the specific acquisition mode of step S102 is not yet Together, it will describe in detail respectively below.
Situation one can build the pedestal being connect with support construction if biological information is head facial information, Seat of the setting for fixed biological picture-taking position on pedestal;When biology is located on seat, tied using arc carrying is arranged in The camera matrix of more Visible Light Cameras composition on structure is acquired head facial information.
In an alternate embodiment of the invention, can also display be set in arc bearing structure;It is obtained with the time in structure After the 3D models of the head face of dimension, head face 4 D data is shown by visual means over the display.
In an alternate embodiment of the invention, head facial information is carried out in the camera matrix formed using more Visible Light Cameras Before acquisition, the parameter of taking pictures of each camera can also be set by display interfaces, such as sensitivity, shutter speed, zoom times Number, aperture etc., the embodiment of the present invention is without being limited thereto.
Situation two, if biological information is hand information, support construction can be cabinet, the setting of arc bearing structure In cabinet, then transparent glass cover board is arranged in the one side of camera lens that can be on the cabinet towards more Visible Light Cameras;Work as biology Hand placement when on transparent glass cover board, utilize be arranged in arc bearing structure more Visible Light Cameras composition phase Machine matrix is acquired hand information.Here hand information can refer to specifically the information such as portion, palmmprint, the embodiment of the present invention This is not restricted.
In an alternate embodiment of the invention, display can also be set on the cabinet;The hand with time dimension is obtained in structure After the 3D models in portion, hand 3D data are shown by visual means over the display.
In an alternate embodiment of the invention, hand information is acquired in the camera matrix formed using more Visible Light Cameras Before, can also by display interfaces, set each camera parameter of taking pictures, as sensitivity, shutter speed, zoom magnification, Aperture etc., the embodiment of the present invention is without being limited thereto.
It should be noted that the biological characteristic in the embodiment of the present invention is not limited to above-mentioned head face and hand, It can also be without limitation including other biological feature, such as foot, the embodiment of the present invention.
A variety of realization methods of links in embodiment shown in FIG. 1 are described above, implement below by specific Example is described further the biological characteristic 4 D data acquisition method provided in an embodiment of the present invention based on Visible Light Camera, In specific embodiment respectively by taking head facial information, hand information collection as an example.
Specific embodiment one
The head (1-1) face Visible Light Camera 4 D data collecting device mentality of designing is as follows.
A. head face Visible Light Camera 4 D data collecting device is as shown in figure 3, the equipment may include:
Pedestal 31, the main lower support structure as entire invention equipment;
Seat 32, fixed take pictures position of human body and adjusting human height;
Support construction 33 connects bottom and other main body mechanisms of equipment;
Display 34, the operation interface of device systems work;
Bearing structure 35, camera, central processing unit, light fixed structure;
Camera matrix 36, the acquisition of human body head facial information;
Band-like light compensating lamp 37, environment light supplement use.
B. the connection relation explanation of equipment
Pedestal 31 is connected by connection structure with seat 32;
Pedestal 31 is connected by mechanism connection structure with support construction 33;
Support construction 33 is connected by mechanical connecting structure with bearing structure 35;
Display 34 is by being mechanically anchored in bearing structure 35;
Camera matrix 36 is fixed on by the fixed mode of structure in bearing structure 35;
Band-like light compensating lamp 37 is fixed on by the fixed mode of structure in bearing structure 35.
The internal module composition of (1-2) bearing structure 35 is as follows.
A. as shown in figure 4, the internal module of bearing structure 35 can be made of following several parts:
Power management module is responsible for providing the required various power supplys of whole system;
Light management module can adjust the brightness of light by central processing module;
Serial ports integration module is responsible for the both-way communication of central processing module and camera matrix;
Central processing module is responsible for system information processing, display, the control of light, seat;
Seat lifts management module, is responsible for height of seat adjustment;
It shows driven management module, is responsible for the display driving of display.
B. the connection relation of the internal module of bearing structure 35 and outside is as follows:
1) power management module is to camera matrix, serial ports integration module, light management module, central processing module, display Driven management module, seat lifting management module provide power supply;
2) serial ports integration module connection camera matrix and central processing module, realize the both-way communication between them, such as Fig. 5 It is shown;
2.1) camera is connected in a manner of serial ports with serial ports integration module in a manner of independent part
2.2) serial ports integration module is connected by USB interface with central processing module
2.3) central processing module realizes the visualized operation with camera matrix by the software interface of customized development
2.4) may be implemented to take pictures to camera in operation interface the setting of parameter
Sensitivity ISO (range 50~6400)
Shutter speed (1/4000~1/2) (second)
Zoom magnification (1~3.8x)
Aperture (big/small)
2.5) initialization operation being switched on to camera may be implemented in operation interface
2.6) order of camera image acquisition may be implemented in operation interface
2.7) setting in camera image storage path may be implemented in operation interface
2.8) browsing of camera real-time imaging and the switching of camera may be implemented in operation interface
3) light management module connection power management module, central processing module and external band-like light compensating lamp;
4) seat lifting management module connection power management module, central processing module and external seat, central processing Module realizes the up and down adjustment to height of seat by visualization interface;
5) display driven management module connection power management module, central processing module and the display of outside;
6) central processing module connection power management module, light management module, seat lifting management module, serial ports are integrated Module, display driven management module.
(1-3) equipment application method is as follows
A. starting device:After turning on the power switch, central processing module, camera matrix, band-like light compensating lamp is respectively started.
B. parameter setting:By display interfaces, the parameters that camera matrix is taken pictures can be set.
C. information collection:After parameter setting, starts matrix camera and starts to carry out information collection to human body head face, The information collection time completes in 0.8 second, and the signal of acquisition finally reaches central processing mould with the format of digital picture (.jpg) Block is handled, and the time data for acquiring biological information also reaches central processing module, central processing module core It is made of following components:
C.1 CPU (Central Processing Unit, central processing unit):It is responsible for the transmission of entire digital signal Scheduling, task distribution, the single calculation processing of memory management and part;
C.2 GPU (Graphics Processing Unit, image processing unit):The GPU for selecting special type, has Outstanding image-capable and efficient computing capability;
C.3 DRAM (Dynamic Random Access Memory, i.e. dynamic random access memory):As entire The temporary storage center of Digital Signal Processing needs the operational capability for matching CPU and GPU, obtains best processing and calculates effect Energy.
D. information processing:The signal that matrix camera has acquired is transmitted to central processing module and carries out signal processing.
D.1 the process of information processing is as follows
D.1.1 the filtering of image is acquired
Using the characteristic of GPU, in conjunction with the characteristic of matrix operation of image filtering, image filtering can be in certain algorithm Under support, it is rapidly completed.
D.1.2 the feature point extraction of image is acquired
The GPU to match using CPU and with overall performance, because the format of the various information of this equipment is all image pane The various information contents of jpg can be evenly distributed to GPU's by formula in conjunction with the GPU with outstanding image-capable In block, since this equipment has 56 block using double GPU, every GPU itself, so 18 that acquisition information scratching arrives The image of jpg can be evenly distributed to carry out operation above 112 block, and combine centralized dispatching and the distribution function of CPU, The characteristic point that every photo has can be rapidly calculated, is arranged in pairs or groups other common models relative to independent CPU or CPU The operation of GPU, whole arithmetic speed time are the 1/10 or shorter of the latter.
D.1.3 the calculating of the matching and spatial depth information of acquisition image
The extraction of image characteristic point uses pyramidal hierarchical structure and the particular algorithm of space scale invariance, this Two kinds of special algorithms are all the special tectonics of the GPU in conjunction with this equipment choosing, play the calculated performance of system to the greatest extent, Realize the characteristic point in rapid extraction image information.
The Feature Descriptor of this process has 128 feature descriptions using SIFT feature description, SIFT feature description Vector can describe the feature of 128 aspects of any characteristic point on direction and scale, significantly improve the essence to feature description Degree, while Feature Descriptor has independence spatially.
The particular image that this equipment uses handles GPU, the calculating with excellent independent vector and processing capacity, for adopting For SIFT feature vector with 128 special description, it is to be most suitable for only to be handled under conditions of special GPU in this way , the specific calculations ability of the GPU can be given full play to, compares and is arranged in pairs or groups other common specifications using common CP U or CPU The match time of GPU, characteristic point can reduce by 70%.
Feature Points Matching finishes, and system can use the algorithm of light-stream adjustment to calculate camera relative to head face in sky Between on relative position, according to the space coordinate of this relative position, GPU can rapidly calculate the depth of head face feature point Spend information.
D.1.4 the generation of feature point cloud data
According to depth information of the head face feature point in space is D.1.3 calculated, since the GPU vectors having calculate energy Power can rapidly match spatial position and the colouring information of head face feature point cloud, and the model for forming a standard is built The vertical point cloud information needed.
E. characteristic size is demarcated:By the standard of characteristic point cloud size, initial reference is set for the size of entire model Size.
By the special calibration in information collection, which there is space to determine size, since head face is special Sign point cloud has spatially consistency of scale, is sized really by the special calibration, between any characteristic point of head face Size can be calculated from the spatial position coordinate of cloud.
F. the subsequent processing of data:It can by the way that point cloud data is further processed based on the size demarcated in E To obtain the three-dimensional data of face head face.
The format of three-dimensional data has following several files:
.obj --- the spatial form feature of description 3D models
.jpg --- the surface texture feature of description 3D models
.mtl --- the Facing material and light feature of description 3D models
G. the 3D models of the head face with time dimension may be displayed on by visualization method on display.
Specific embodiment two
(2-1) human hands Visible Light Camera 4 D data collecting device mentality of designing is as follows.
A. human hands Visible Light Camera 4 D data collecting device is as shown in fig. 6, the equipment may include:
Cabinet 61, the main main body supporting structure as whole equipment;
Camera matrix 62 acquires human hands feature, can refer to specifically portion's feature and/or metacarpus feature;
Transparent glass cover board 63, the apparatus for placing of human hands;
Central control module 64, the information processing of system, analysis, display module;
Hand virtual location 65, the placement location explanation of human hands;
Astral lamp light system 66 provides light environment for hand 3D modeling.
B. the connection relation explanation of equipment
Cabinet 61 is connected by way of being mechanically fixed with camera matrix 62;
Cabinet 61 is connected by the fixed mode of mechanical structure with transparent glass cover board 63;
Central control module 64 is connected by way of being mechanically fixed with cabinet 61;
Astral lamp light system 66 is connected by way of being mechanically fixed with cabinet 61;
Hand virtual location 65 ensures that human hands are integrally fallen in the range of camera 62 information collection of matrix.
(2-2) central control module 64 and external connection are as shown in Figure 7.
A. entire central control module is made of following several parts:
Power management module provides the power supply of whole equipment;
Serial ports integration module, the order and data for being responsible for camera matrix and central processing module are transmitted;
Light management module is responsible for external Astral lamp light system;
Driver module is responsible for the management of display module;
Central processing module, analysis, calculating and the processing of the gathered data of whole system;
Display module, system operatio interface.
B. the connection relation of entire central control module is as follows:
B.1 power management module provides power to camera matrix, serial ports integration module, central processing module, light management Module, driver module, display module;
B.2 serial ports integration module realizes the both-way communication between camera matrix and central processing module;
B.3 light management module provides power to Astral lamp light system, and is responsible for the parameter of adjustment lighting system;
B.4 central processing module connection serial ports integration module, light management module, driver module and power management mould Block;
B.5 driver module connection central processing module and display module.
(2-3) equipment application method is as follows
A. starting device:After turning on the power switch, startup power supply management module provides power supply to system modules, and same Shi Qidong cameras matrix, central control module, Astral lamp light system and display module.
B. human hands are placed:By the hand placement of human body on transparent glass cover board, by adjusting the position of hand, make The information of hand is fully fallen in the orientation of information collection, each since the lighting system of this equipment uses Astral lamp light system The hand information of angle acquisition does not have shade, can significantly improve efficiency and the accuracy of characteristic point acquisition.
C. parameter setting:By display interfaces, the parameters that camera matrix is taken pictures can be set.
D. information collection:Parameter setting finishes, and starts camera matrix and starts to be acquired the information of hand, the letter of acquisition Breath can pass to central control module with the format of picture and be analyzed and be handled.
E. information processing:The complete signal of camera matrix acquisition is transmitted to central control module and carries out signal processing, at information The process of reason is as follows.
D.1 the filtering of image is acquired
Refer to portion and metacarpus since the main feature collection point of human hands concentrates on hand, by taking finger portion feature as an example, such as Fig. 8 Shown, the fingerprint characteristic of finger tip is also the feature for having unique bio-identification, so after collecting hand and referring to the characteristic point in portion, It is filtered using the method for algorithm firstly the need of by the information of non-finger tip, the Integral Thought of entire algorithm is as follows:
D.1.1 it establishes the library file of finger tip and the joint line in the second finger portion and refers to the feature database of portion joint line;
D.1.2 it imports feature database and carries out feature recognition for the collected information in finger portion;
D.1.3 it after feature recognition, is calculated for the region of characteristic area, calculates the model of the characteristic area of finger portion finger tip It encloses;
D.1.4 the image segmentation of characteristic area and non-finger portion characteristic area;
D.1.5 the information of non-finger portion characteristic area is rejected from original image;
D.1.6 the information in new feature region is further filtered;
D.1.7 similar approach can also be used in metacarpus acquisition.
D.2 the feature point extraction of image is acquired
D.3 the calculating of the matching and spatial depth information of acquisition image
D.4 the generation of feature point cloud data
F. data subsequent processing:By the way that point cloud data is further processed, the texture structure of hand can be obtained.
G. hand 4 D data is shown:The 3D models of hand with time dimension are shown in aobvious by visualization method Show on device.
Here, it D.2, D.3 and D.4 may refer to introduce above, details are not described herein again.
It should be noted that in practical application, combination may be used in above-mentioned all optional embodiments arbitrary group of mode It closes, forms the alternative embodiment of the present invention, this is no longer going to repeat them.
Based on the biological characteristic 4 D data acquisition method based on Visible Light Camera that each embodiment provides above, it is based on Same inventive concept, the embodiment of the present invention additionally provide a kind of biological characteristic 4 D data acquisition dress based on Visible Light Camera It sets.
Fig. 9 shows the biological characteristic 4 D data harvester according to an embodiment of the invention based on Visible Light Camera Structural schematic diagram.As shown in figure 9, the device may include information acquisition unit 910, feature point extraction unit 920, point cloud life At unit 930 and construction unit 940.
Now introduce each composition of the biological characteristic 4 D data harvester based on Visible Light Camera of the embodiment of the present invention Or the connection relation between the function and each section of device:
Information acquisition unit 910, for using more Visible Light Cameras form camera matrix to biological information into Row acquisition, obtains several biometric images, and records the time data of acquisition biological information;
Feature point extraction unit 920 is coupled with information acquisition unit 910, is used for from each of several biometric images Characteristic point is extracted in width biometric image;
Point cloud generation unit 930, is coupled with feature point extraction unit 920, is used for several biological characteristics based on extraction Respective characteristic point in image generates the feature point cloud data of biological characteristic;
Construction unit 940 is coupled with a cloud generation unit 930, for according to feature point cloud data and time data, structure The 3D models for building the biological characteristic with time dimension, to realize the acquisition of biological characteristic 4 D data.
In the alternative embodiment of the present invention, above-mentioned cloud generation unit 930 is additionally operable to:
According to the feature of respective characteristic point in several biometric images of extraction, the matching of characteristic point is carried out, is established Matched characteristic point data collection;
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic spatially opposite Position, and calculate according to relative position the spatial depth information of the characteristic point in several biometric images;
According to the spatial depth information of matched characteristic point data collection and characteristic point, the characteristic point cloud number of biological characteristic is generated According to.
In the alternative embodiment of the present invention, the feature of respective characteristic point uses scale not in several biometric images Become Feature Conversion SIFT feature and describes son to describe.
In the alternative embodiment of the present invention, above-mentioned cloud generation unit 930 is additionally operable to:
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic using light-stream adjustment Relative position spatially.
In the alternative embodiment of the present invention, the spatial depth information of the characteristic point in several biometric images includes: Spatial positional information and colouring information.
In the alternative embodiment of the present invention, above-mentioned construction unit 940 is additionally operable to:
Set the reference dimension of 3D models to be built;
According to the spatial positional information of reference dimension and feature point cloud data, each characteristic point in feature point cloud data is determined Bulk, to build the 3D models of biological characteristic;
According to the 3D models of the biological characteristic of structure and the time data, the biological characteristic with time dimension is generated 3D models.
In the alternative embodiment of the present invention, the 3D models of biological characteristic include at least one following three-dimensional data:
The spatial form characteristic of 3D models is described;
The surface texture feature data of 3D models are described;
The Facing material and light characteristic of 3D models are described.
In the alternative embodiment of the present invention, as shown in Figure 10, the device of figure 9 above displaying can also include:
Camera matrix layout unit 1010, is coupled with information acquisition unit 910, for making in information acquisition unit 910 Before the camera matrix formed with more Visible Light Cameras is acquired biological information, it is laid out more in the following manner Visible Light Camera:
Support construction is built, arc bearing structure is set on the support structure;
More Visible Light Cameras are arranged in arc bearing structure.
In this embodiment, more cameras are arranged in formation camera matrix in arc bearing structure.
In the alternative embodiment of the present invention, if biological information is head facial information, above- mentioned information collecting unit 910 are additionally operable to:
The pedestal being connect with support construction is built, seat of the setting for fixed biological picture-taking position on pedestal;
When biology is located on seat, the camera for the more Visible Light Cameras composition being arranged in arc bearing structure is utilized Matrix is acquired head facial information.
In the alternative embodiment of the present invention, as shown in Figure 10, the device of figure 9 above displaying can also include:
First display unit 1020, is coupled with construction unit 940, for display to be arranged in arc bearing structure; After structure obtains having the 3D models of head face of time dimension, head surface is shown by visual means over the display Portion's 4 D data.
In the alternative embodiment of the present invention, above- mentioned information collecting unit 910 is additionally operable to:
Before the camera matrix formed using more Visible Light Cameras is acquired head facial information, pass through display Device interface sets the parameter of taking pictures of each camera.
In the alternative embodiment of the present invention, if biological information is hand information, support construction is cabinet, arc Bearing structure is arranged in cabinet, and above- mentioned information collecting unit 910 is additionally operable to:
Transparent glass cover board is arranged in the one side of camera lens on the cabinet towards more Visible Light Cameras;
It is visible using more be arranged in arc bearing structure when the hand placement of biology is on transparent glass cover board The camera matrix of light camera composition is acquired hand information.
In the alternative embodiment of the present invention, as shown in Figure 10, the device of figure 9 above displaying can also include:
Second display unit 1030, is coupled with construction unit 940, for display to be arranged on the cabinet;It is building To after the 3D models of the hand with time dimension, hand 3D data are shown by visual means over the display.
In the alternative embodiment of the present invention, above- mentioned information collecting unit 910 is additionally operable to:
Before the camera matrix formed using more Visible Light Cameras is acquired hand information, by display circle Face sets the parameter of taking pictures of each camera.
According to the combination of any one above-mentioned alternative embodiment or multiple alternative embodiments, the embodiment of the present invention can reach Following advantageous effect:
An embodiment of the present invention provides a kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera, It is specifically that the camera matrix formed using more Visible Light Cameras is acquired biological information in method, obtains several Biometric image, and record the time data of acquisition biological information;And then it is given birth to from each width of several biometric images Characteristic point is extracted in object characteristic image;Subsequently, based on respective characteristic point in several biometric images of extraction, biology is generated The feature point cloud data of feature;Later, according to feature point cloud data and time data, the biological characteristic with time dimension is built 3D models, to realize the acquisition of biological characteristic 4 D data.It can be seen that the embodiment of the present invention uses more Visible Light Cameras Control technology carries out the acquisition of biological information, can significantly improve the collecting efficiency of biological information;Also, the present invention It is special completely to restore the items of biological characteristic spatially using the characteristic information of biological characteristic spatially is collected for embodiment Sign, unlimited possibility is provided for the application of subsequent biological attribute data.
Further, parallel computation of the embodiment of the present invention based on central processing unit and graphics processor, can be rapidly and efficiently It realizes the processing of characteristic information and puts the generation of cloud in ground.Also, using scale invariant feature conversion SIFT feature description son knot The computation capability for closing special graph processor, can fast implement the generation of the matching and space characteristics point cloud of characteristic point. In addition, using unique sizing calibration method, the bulk of any characteristic point of biological characteristic can be quickly and accurately extracted, it is raw At the 3D models of the biological characteristic with time dimension, to realize the acquisition of 4 D data.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention Example can be put into practice without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this description.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of each inventive aspect, Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention:It is i.e. required to protect Shield the present invention claims the more features of feature than being expressly recited in each claim.More precisely, as following Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore, Thus the claims for following specific implementation mode are expressly incorporated in the specific implementation mode, wherein each claim itself All as a separate embodiment of the present invention.
Those skilled in the art, which are appreciated that, to carry out adaptively the module in the equipment in embodiment Change and they are arranged in the one or more equipment different from the embodiment.It can be the module or list in embodiment Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it may be used any Combination is disclosed to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so to appoint Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power Profit requires, abstract and attached drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments means in of the invention Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of arbitrary It mode can use in any combination.
The all parts embodiment of the present invention can be with hardware realization, or to run on one or more processors Software module realize, or realized with combination thereof.It will be understood by those of skill in the art that can use in practice Microprocessor or digital signal processor (DSP) are according to the ... of the embodiment of the present invention biological special based on Visible Light Camera to realize Levy some or all functions of some or all components in 4 D data harvester.The present invention is also implemented as using In executing some or all equipment or program of device of method as described herein (for example, computer program and meter Calculation machine program product).It is such to realize that the program of the present invention may be stored on the computer-readable medium, or can have one The form of a or multiple signals.Such signal can be downloaded from internet website and be obtained, or above be carried in carrier signal For, or provide in any other forms.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference mark between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be by the same hardware branch To embody.The use of word first, second, and third does not indicate that any sequence.These words can be explained and be run after fame Claim.
So far, although those skilled in the art will appreciate that present invention has been shown and described in detail herein multiple shows Example property embodiment still without departing from the spirit and scope of the present invention, still can according to the present disclosure directly Determine or derive many other variations or modifications consistent with the principles of the invention.Therefore, the scope of the present invention is understood that and recognizes It is set to and covers other all these variations or modifications.

Claims (10)

1. a kind of biological characteristic 4 D data acquisition method based on Visible Light Camera, which is characterized in that including:
The camera matrix formed using more Visible Light Cameras is acquired biological information, obtains several biological characteristic figures Picture, and record the time data of acquisition biological information;
Characteristic point is extracted from each width biometric image of several biometric images;
Based on respective characteristic point in several biometric images described in extraction, the feature point cloud data of biological characteristic is generated;
According to the feature point cloud data and the time data, the 3D models of the biological characteristic with time dimension are built, with Realize the acquisition of biological characteristic 4 D data.
2. according to the method described in claim 1, it is characterized in that, described based in several biometric images described in extraction The step of respective characteristic point, the feature point cloud data for generating biological characteristic, further comprises:
According to the feature of respective characteristic point in several biometric images described in extraction, the matching of characteristic point is carried out, is established Matched characteristic point data collection;
According to the optical information of more Visible Light Cameras, opposite position of each camera relative to biological characteristic spatially is calculated It sets, and calculates the spatial depth information of the characteristic point in several described biometric images according to the relative position;
According to the spatial depth information of matched characteristic point data collection and characteristic point, the feature point cloud data of biological characteristic is generated.
3. according to the method described in claim 2, it is characterized in that, respective characteristic point in several described biometric images Feature describes son to describe using scale invariant feature conversion SIFT feature.
4. according to the method described in claim 2, it is characterized in that, the optical information according to more Visible Light Cameras, meter Each camera is calculated relative to the step of biological characteristic relative position spatially to further comprise:
According to the optical information of more Visible Light Cameras, each camera is calculated relative to biological characteristic in sky using light-stream adjustment Between on relative position.
5. according to the method described in any one of claim 2-4, which is characterized in that the spy in several described biometric images Levying the spatial depth information put includes:Spatial positional information and colouring information.
6. according to the method described in claim 5, it is characterized in that, described according to the feature point cloud data and the time number According to, build with time dimension biological characteristic 3D models the step of further comprise:
Set the reference dimension of 3D models to be built;
According to the spatial positional information of the reference dimension and the feature point cloud data, determine each in the feature point cloud data The bulk of a characteristic point, to build the 3D models of biological characteristic;
According to the 3D models of the biological characteristic of structure and the time data, the 3D moulds of the biological characteristic with time dimension are generated Type.
7. according to the method described in claim 5, it is characterized in that, the 3D models of the biological characteristic include it is following at least it One three-dimensional data:
The spatial form characteristic of 3D models is described;
The surface texture feature data of 3D models are described;
The Facing material and light characteristic of 3D models are described.
8. according to the method described in claim 1, it is characterized in that, in the camera matrix pair formed using more Visible Light Cameras Before biological information is acquired, the method further includes being laid out more Visible Light Cameras in the following manner:
Support construction is built, arc bearing structure is set in the support construction;
More Visible Light Cameras are arranged in the arc bearing structure.
If 9. according to the method described in claim 8, it is characterized in that, the biological information be head facial information, The method further includes:
The pedestal being connect with the support construction is built, on the base seat of the setting for fixed biological picture-taking position;
When biology is located on the seat, the more Visible Light Cameras composition being arranged in the arc bearing structure is utilized Camera matrix is acquired head facial information;
Display is set in the arc bearing structure;
After structure obtains having the 3D models of head face of time dimension, head is shown by visual means over the display Portion's face 4 D data;
Before the camera matrix formed using more Visible Light Cameras is acquired head facial information, by display circle Face sets the parameter of each camera;If the biological information is hand information, the support construction is cabinet, described Arc bearing structure is arranged in the cabinet, and the method further includes:
Transparent glass cover board is arranged in the one side of camera lens towards more Visible Light Cameras on the cabinet;
When the hand placement of biology is on the transparent glass cover board, more be arranged in the arc bearing structure are utilized The camera matrix of Visible Light Camera composition is acquired hand information;
Display is set on the cabinet;
After structure obtains having the 3D models of hand of time dimension, show that hand is more by visual means over the display Open 3D data;Further include:
Before the camera matrix formed using more Visible Light Cameras is acquired hand information, by display interfaces, Set the parameter of taking pictures of each camera.
10. a kind of biological characteristic 4 D data harvester based on Visible Light Camera, which is characterized in that including:
Information acquisition unit, the camera matrix for being formed using more Visible Light Cameras are acquired biological information, Several biometric images are obtained, and record the time data of acquisition biological information;
Feature point extraction unit, for extracting characteristic point from each width biometric image of several biometric images;
Point cloud generation unit, for based on respective characteristic point in several biometric images described in extraction, it is special to generate biology The feature point cloud data of sign;
Construction unit, for according to the feature point cloud data and the time data, it is special to build the biology with time dimension The 3D models of sign, to realize the acquisition of biological characteristic 4 D data.
CN201810152225.7A 2018-02-14 2018-02-14 A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera Withdrawn CN108470150A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810152225.7A CN108470150A (en) 2018-02-14 2018-02-14 A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810152225.7A CN108470150A (en) 2018-02-14 2018-02-14 A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera

Publications (1)

Publication Number Publication Date
CN108470150A true CN108470150A (en) 2018-08-31

Family

ID=63266409

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810152225.7A Withdrawn CN108470150A (en) 2018-02-14 2018-02-14 A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera

Country Status (1)

Country Link
CN (1) CN108470150A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111028341A (en) * 2019-12-12 2020-04-17 天目爱视(北京)科技有限公司 Three-dimensional model generation method
CN112652056A (en) * 2020-12-25 2021-04-13 北京奇艺世纪科技有限公司 3D information display method and device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010133007A1 (en) * 2009-05-21 2010-11-25 Intel Corporation Techniques for rapid stereo reconstruction from images
CN103247045A (en) * 2013-04-18 2013-08-14 上海交通大学 Method of obtaining artificial scene main directions and image edges from multiple views
CN103765479A (en) * 2011-08-09 2014-04-30 英特尔公司 Image-based multi-view 3D face generation
CN104794728A (en) * 2015-05-05 2015-07-22 成都元天益三维科技有限公司 Method for reconstructing real-time three-dimensional face data with multiple images
CN105893965A (en) * 2016-03-31 2016-08-24 中国科学院自动化研究所 Binocular visual image synthesis device and method used for unspecified person
CN106910241A (en) * 2017-01-20 2017-06-30 徐迪 The reconstructing system and method for the three-dimensional human head based on cell-phone camera and Cloud Server
CN107292921A (en) * 2017-06-19 2017-10-24 电子科技大学 A kind of quick three-dimensional reconstructing method based on kinect cameras

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010133007A1 (en) * 2009-05-21 2010-11-25 Intel Corporation Techniques for rapid stereo reconstruction from images
CN103765479A (en) * 2011-08-09 2014-04-30 英特尔公司 Image-based multi-view 3D face generation
CN103247045A (en) * 2013-04-18 2013-08-14 上海交通大学 Method of obtaining artificial scene main directions and image edges from multiple views
CN104794728A (en) * 2015-05-05 2015-07-22 成都元天益三维科技有限公司 Method for reconstructing real-time three-dimensional face data with multiple images
CN105893965A (en) * 2016-03-31 2016-08-24 中国科学院自动化研究所 Binocular visual image synthesis device and method used for unspecified person
CN106910241A (en) * 2017-01-20 2017-06-30 徐迪 The reconstructing system and method for the three-dimensional human head based on cell-phone camera and Cloud Server
CN107292921A (en) * 2017-06-19 2017-10-24 电子科技大学 A kind of quick three-dimensional reconstructing method based on kinect cameras

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111028341A (en) * 2019-12-12 2020-04-17 天目爱视(北京)科技有限公司 Three-dimensional model generation method
CN112652056A (en) * 2020-12-25 2021-04-13 北京奇艺世纪科技有限公司 3D information display method and device
CN112652056B (en) * 2020-12-25 2023-09-05 北京奇艺世纪科技有限公司 3D information display method and device

Similar Documents

Publication Publication Date Title
CN108446597B (en) A kind of biological characteristic 3D collecting method and device based on Visible Light Camera
CN108549873A (en) Three-dimensional face identification method and three-dimensional face recognition system
CN108416312B (en) A kind of biological characteristic 3D data identification method taken pictures based on visible light
CN104182765B (en) Internet image driven automatic selection method of optimal view of three-dimensional model
CN105354248B (en) The recognition methods of distributed image low-level image feature and system based on gray scale
CA2394698C (en) Method of searching 3-dimensional images
KR20200087757A (en) Full convolutional point of interest detection and description through homographic adaptation
CN109035388A (en) Three-dimensional face model method for reconstructing and device
CN108446596A (en) Iris 3D 4 D datas acquisition system based on Visible Light Camera matrix and method
CN105809146B (en) A kind of image scene recognition methods and device
CN109074369A (en) Image characteristic combination for the Object identifying based on image
JP6207210B2 (en) Information processing apparatus and method
CN108470373A (en) It is a kind of based on infrared 3D 4 D datas acquisition method and device
CN111652974A (en) Method, device and equipment for constructing three-dimensional face model and storage medium
CN109766876A (en) Contactless fingerprint acquisition device and method
CN111062260B (en) Automatic generation method of face-beautifying recommendation scheme
CN108259751A (en) A kind of polyphaser data acquisition control system
CN108470149A (en) A kind of 3D 4 D datas acquisition method and device based on light-field camera
CN108520230A (en) A kind of 3D four-dimension hand images data identification method and equipment
CN108470150A (en) A kind of biological characteristic 4 D data acquisition method and device based on Visible Light Camera
CN108550184A (en) A kind of biological characteristic 3D 4 D datas recognition methods and system based on light-field camera
CN106886754B (en) Object identification method and system under a kind of three-dimensional scenic based on tri patch
CN117693772A (en) System and method for dynamically identifying surgical trays and items contained thereon
CN108470186A (en) A kind of matching process and device of image characteristic point
CN108460368A (en) 3-D view synthetic method, device and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20180831

WW01 Invention patent application withdrawn after publication