CN111147811B - Three-dimensional imaging system, imaging method and imaging device for automatic face tracking - Google Patents

Three-dimensional imaging system, imaging method and imaging device for automatic face tracking Download PDF

Info

Publication number
CN111147811B
CN111147811B CN201911144351.9A CN201911144351A CN111147811B CN 111147811 B CN111147811 B CN 111147811B CN 201911144351 A CN201911144351 A CN 201911144351A CN 111147811 B CN111147811 B CN 111147811B
Authority
CN
China
Prior art keywords
target person
unit
dimensional imaging
video stream
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911144351.9A
Other languages
Chinese (zh)
Other versions
CN111147811A (en
Inventor
鲍敏
朱艳华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Terminus Technology Co Ltd
Original Assignee
Chongqing Terminus Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Terminus Technology Co Ltd filed Critical Chongqing Terminus Technology Co Ltd
Priority to CN201911144351.9A priority Critical patent/CN111147811B/en
Publication of CN111147811A publication Critical patent/CN111147811A/en
Application granted granted Critical
Publication of CN111147811B publication Critical patent/CN111147811B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/243Image signal generators using stereoscopic image cameras using three or more 2D image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a three-dimensional imaging system, an imaging method and imaging equipment for automatic face tracking, wherein the system comprises a video acquisition unit, a data exchange unit, a central control server and a three-dimensional imaging unit, wherein the central control server comprises a target figure locking unit, a target figure positioning unit and a face recognition unit; the data exchange unit is used for combining the video streams acquired by the video acquisition units into a live video stream; the live video stream processing device comprises a target person locking unit, a target person positioning unit and a face recognition unit, wherein the target person locking unit is used for locking a target person meeting preset requirements from a live video stream, the target person positioning unit is used for determining position information of the target person, and the face recognition unit is used for extracting feature information of the target person; the three-dimensional imaging unit is used for displaying the position information, the characteristic information and the pursuit path information of the target person. The invention can lock and position the target person in the crowd in time, plan the effective path for pursuing the target person, and has the advantages of identifying and displaying the position of the positioned target person in time, quickly tracking the target person and the like.

Description

Three-dimensional imaging system, imaging method and imaging device for automatic face tracking
Technical Field
The invention relates to the technical field of security monitoring, in particular to a three-dimensional imaging system, an imaging method and imaging equipment for automatic face tracking.
Background
In large public places such as airport terminal buildings, railway station halls, gymnasiums, shopping centers and the like, the intelligent monitoring system has the characteristics of dense personnel, high mobility, complex space environment and the like, and is generally provided with an electronic monitoring system so as to timely discover various personnel needing important attention, such as people with illegal behaviors like wanted people, terrorists, fighting, order disorder and the like, and people needing help, such as vulnerable groups, lost people, important guests and the like.
The conventional electronic monitoring system mainly comprises a camera, a transmission cable and a display screen, wherein a large number of cameras are installed in public places, then the cameras are connected to a television wall of a central control room through the transmission cable, and videos shot by the cameras are displayed on the television wall in real time, so that the monitoring without dead angle coverage basically is realized. At present, more field personnel on duty are generally arranged in public places, workers are arranged on television walls for monitoring, if the monitoring personnel find that important attention is needed, the monitoring personnel contact the field personnel on duty through an interphone, and the field personnel on duty carry out security maintenance, suspect control or help seeking persons.
Although the supervision system has a certain effect, a lot of defects exist, for example, field personnel on duty can only rely on the interphone to talk with the monitoring personnel, and the personnel on duty can hardly effectively master the specific position and the appearance characteristic of the target character through short conversation, so that the target character needing to be locked can be hardly found in time among people in a lot of public places, the time for the field personnel on duty to react is delayed, and the difficulty of field treatment is increased. Further, even if the target person is locked by the on-site duty person, if the target person moves rapidly among the crowd, the on-site duty person is difficult to follow up accurately, and thus the target person is easily lost.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention aims to: the method and the system can lock and position the target person in the crowd in time by the staff on duty, and plan an effective path for following the target person. The method has the advantages of timely identifying the target person, positioning and displaying the position of the target person, quickly tracking the target person and the like.
A three-dimensional imaging system for automatic face tracking comprises a video acquisition unit, a data exchange unit, a live video stream display unit, a central control server and a three-dimensional imaging unit which are sequentially in communication connection, wherein the central control server comprises a first processor, a target person locking unit, a target person positioning unit, a face recognition unit and a first wireless communication unit;
the data exchange unit comprises a plurality of data exchangers and is used for combining the video streams acquired by the video acquisition unit into a live video stream and transmitting the live video stream to the live video stream display unit and the first processor in real time;
the target person locking unit is used for locking a target person meeting preset requirements from a live video stream, the target person positioning unit is used for determining position information of the target person, and the face recognition unit is used for extracting feature information of the target person;
the three-dimensional imaging unit comprises a plurality of three-dimensional imaging devices, position information, characteristic information and pursuit path information of a target person are displayed through three-dimensional imaging, and each three-dimensional imaging device is respectively in communication connection with the central control server.
Further, the video acquisition unit comprises a plurality of camera clusters in different spatial ranges, and the camera clusters comprise a plurality of cameras which are arranged at different angles in the spatial ranges.
And the data switch combines the video streams into a storage video stream, and stores the storage video stream to the monitoring video storage unit for backup in real time.
Furthermore, the video acquisition unit comprises a second processor, a judgment unit and a second wireless communication unit, and the judgment unit, the second wireless communication unit, the monitoring video storage unit and the plurality of cameras are electrically connected with the second processor respectively.
Further, the target person feature information includes face feature value array information and body feature value array information.
A three-dimensional imaging method for automatic face tracking comprises a video acquisition unit, a data exchange unit and a live video stream display unit which are sequentially in communication connection, and is characterized by comprising the following steps:
s1: the method comprises the steps that video streams are obtained through a video acquisition unit, a data switch combines the video streams into a live video stream, and the live video stream is transmitted to a live video stream display unit and a first processor in real time;
s2: the method comprises the following steps that a target person locking unit locks a target person meeting preset requirements from a live video stream, a target person positioning unit determines position information of the target person, and a face recognition unit extracts feature information of the target person;
s3: transmitting the position information and the characteristic information of the target person to the three-dimensional imaging device and the video acquisition unit through the first wireless communication unit;
s4: the position information, the feature information, and the pursuit path information of the target person are displayed by the three-dimensional imaging apparatus.
Further, the method comprises the following positioning updating steps:
s301: the video acquisition unit receives the characteristic information of the target person, and the judgment unit compares and analyzes the characteristic information of the target person with the video stream in the monitoring video storage unit to judge whether the target person is in the shooting range of the camera;
s302: if yes, transmitting the video stream containing the target person to the first processor in real time according to the shooting time, and executing the step S303; if not, executing step S301;
s303: the target person positioning unit updates the position information of the target person according to the latest video stream containing the target person, and sends the position information of the target person to each three-dimensional imaging device in real time through the first wireless communication unit.
Further, one of the video streams provided by the cameras in the same spatial range is selected and stored in the monitoring video storage unit.
A three-dimensional imaging device for automatic face tracking comprises a third processor, a GPS module, a wireless communication module, an analysis module, a camera and a display screen, wherein the GPS module, the wireless communication module, the analysis module, the camera and the display screen are respectively and electrically connected with the third processor; and the analysis module analyzes the pursuit path according to the positioning information of the GPS module and the position information of the target person and displays the pursuit path through a display screen.
Further, the three-dimensional imaging device is AR glasses, and the camera is installed on the AR glasses shell and just faces the front.
Compared with the prior art, the invention has the following advantages:
according to the three-dimensional imaging system, the imaging method and the imaging equipment for automatic face tracking, provided by the invention, on-duty personnel in public places carry the three-dimensional imaging equipment, a plurality of cameras acquire video information in a space range in real time, the central control server analyzes and processes the video information, locks a target person, determines the position information and the characteristic information of the target person, and then transmits the position information and the characteristic information to the three-dimensional imaging equipment for displaying. Therefore, the duty personnel can lock and position the target person in the crowd in time, plan the effective path for pursuing the target person, and have the advantages of identifying the target person in time, positioning and displaying the position of the target person, quickly tracking the target person and the like.
Drawings
Fig. 1 is a system block diagram of a three-dimensional imaging system for automatic face tracking according to an embodiment of the present invention;
FIG. 2 is a flowchart of a three-dimensional imaging method for automatic face tracking according to a second embodiment of the present invention;
fig. 3 is a positioning update flowchart of step S3 in fig. 2;
fig. 4 is a control block diagram of a three-dimensional imaging device for automatic face tracking according to a third embodiment of the present invention;
FIG. 5 is a schematic navigation display diagram of a target person according to a third embodiment of the present invention;
fig. 6 is a schematic view illustrating a target person identification display according to a third embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and therefore are only examples, and the protection scope of the present invention is not limited thereby.
The first embodiment is as follows:
referring to fig. 1, a three-dimensional imaging system for automatic face tracking includes a video acquisition unit, a data exchange unit, a live video stream display unit, a central control server and a three-dimensional imaging unit, which are sequentially connected in a communication manner, wherein the central control server includes a first processor, a target person locking unit, a target person positioning unit, a face recognition unit and a first wireless communication unit, and the target person locking unit, the target person positioning unit, the face recognition unit, the first wireless communication unit and the data exchange unit are respectively connected with the first processor in a communication manner;
the data exchange unit comprises a plurality of data exchangers and is used for combining the video streams acquired by the video acquisition unit into a live video stream and transmitting the live video stream to the live video stream display unit and the first processor in real time;
the target person locking unit is used for locking a target person meeting preset requirements from a live video stream, the target person positioning unit is used for determining position information of the target person, and the face recognition unit is used for extracting feature information of the target person;
the three-dimensional imaging unit comprises a plurality of three-dimensional imaging devices, position information, characteristic information and pursuit path information of a target person are displayed through three-dimensional imaging, and each three-dimensional imaging device is respectively in communication connection with the central control server.
In the three-dimensional imaging system, the video acquisition unit includes a plurality of camera clusters in different spatial ranges, and the camera clusters include a plurality of cameras installed at different angles in the spatial ranges. The data switch combines the video streams into a storage video stream, and the storage video stream is stored in the monitoring video storage unit in real time for backup. The video acquisition unit comprises a second processor, a judgment unit and a second wireless communication unit, wherein the judgment unit, the second wireless communication unit, the monitoring video storage unit and the plurality of cameras are respectively and electrically connected with the second processor. The target person feature information includes face feature value array information and body feature value array information.
In the three-dimensional imaging system, the whole public space in the building is divided into one space subarea, a plurality of cameras are arranged in the range of each space subarea, the cameras form a camera cluster, and can shoot from a plurality of different angles, so that the purpose of comprehensive coverage monitoring is achieved, the shot video is output in the form of video streams after being coded, the coding is convenient for recording and one-to-one correspondence, and the video streams are prevented from being confused and mistaken due to multiple occurrences. The data switch combines the video streams collected by one camera cluster into a path of stored video stream, and then the stored video stream is stored in a monitoring video storage unit for backup; the data switch also combines a plurality of video streams provided by a plurality of cameras in the same space plot into a live video stream, and transmits the live video stream to the live video stream display unit and the first processor in real time. The live video stream display unit is arranged in a central control room in charge of security monitoring, and can display the live video stream of each space film area in a traditional television wall mode, for example, a plurality of display areas are arranged on the television wall, and each display area displays a real-time live video stream corresponding to one space film area.
In the three-dimensional imaging system, the locking mode of the target person can be checked by a monitoring person in charge of security through a television wall, the target person with key attention can be found from the checking mode, and a locking condition can be preset in the target person locking unit, for example, the locking condition can be that the old, the child, the optical head, the height, the color of clothes, scars are formed on the face, and the like; and a face identification technology is added, and the target person with key attention is determined from the live video stream through face matching. In specific implementation, two modes can be combined, so that the locking efficiency of the target person can be further improved, and the error leakage rate is reduced. After the target person is determined, the target person positioning unit determines the position information of the target person, wherein the position information refers to the position of the target person in the video frame image, and assists some fixed reference points, such as a flower stand, a garbage can, a sign and the like, so that the accuracy of the target person positioning can be increased. After the position information of the target person is determined, the feature information of the target person is extracted through the face recognition unit, wherein the feature information comprises a face feature value array and a body feature value array, the face feature value array can reflect the face feature of the target person, and the body feature value array can reflect the hair style, the height, the dressing and the like of the target person. And then, the position information and the characteristic information of the target person are delivered to the three-dimensional imaging equipment and the video acquisition unit through the first wireless communication unit. Each person on duty in a public place carries with him a three-dimensional imaging device which can display the position information, the characteristic information and the pursuit path information of a target person. Therefore, the duty personnel can lock and position the target person in the crowd in time and plan an effective path for pursuing the target person.
In the three-dimensional imaging system, the central control server sends the position information and the characteristic information of the target person to two or more three-dimensional imaging devices closest to the target person, and generally sends the position information and the characteristic information of the target person to more than two three-dimensional imaging devices in order to ensure the shooting integrity of the target person, and meanwhile, in order to reduce the operation cost, the number of the three-dimensional imaging devices is generally less than five.
The three-dimensional imaging system also comprises the updating of the position information of the target person, the video acquisition unit receives the characteristic information of the target person, and the judgment unit compares and analyzes the characteristic information of the target person and the video stream in the monitoring video storage unit and judges whether the target person is in the shooting range of the camera; if so, the video stream containing the target person is transmitted to the first processor in real time by the shooting time, the target person positioning unit updates the target person position information based on the last video stream containing the target person, and then the target person position information is transmitted to each three-dimensional imaging device in real time through the first wireless communication unit.
In specific implementation, one of a plurality of video streams provided by a plurality of cameras in the same space segment can be selected and stored in the monitoring video storage unit, and the selected video stream is clear and complete, so that the storage space of the monitoring video storage unit can be saved. For the arrangement mode of the data switch, one camera cluster of one space parcel can correspond to one data switch, and one data switch can be shared by the clusters of a plurality of space parcels. The monitoring person at the video wall may also add a remark label to the target person describing why the person target is the object of major interest, which is also sent to the three-dimensional imaging device and displayed.
Referring to fig. 2, a three-dimensional imaging method for automatic face tracking includes a video acquisition unit, a data exchange unit and a live video stream display unit which are sequentially connected in communication, and includes the following steps:
s1: the method comprises the steps that video streams are obtained through a video acquisition unit, a data switch combines the video streams into a live video stream, and the live video stream is transmitted to a live video stream display unit and a first processor in real time;
s2: the method comprises the following steps that a target person locking unit locks a target person meeting preset requirements from a live video stream, a target person positioning unit determines position information of the target person, and a face recognition unit extracts feature information of the target person;
s3: transmitting the position information and the characteristic information of the target person to the three-dimensional imaging device and the video acquisition unit through the first wireless communication unit;
s4: the position information, the feature information, and the pursuit path information of the target person are displayed by the three-dimensional imaging apparatus.
In the three-dimensional imaging method, referring to fig. 3, the method includes a positioning update step:
s301: the video acquisition unit receives the characteristic information of the target person, and the judgment unit compares and analyzes the characteristic information of the target person with the video stream in the monitoring video storage unit to judge whether the target person is in the shooting range of the camera;
s302: if yes, transmitting the video stream containing the target person to the first processor in real time according to the shooting time, and executing the step S303; if not, executing step S301;
s303: the target person positioning unit updates the position information of the target person according to the latest video stream containing the target person, and sends the position information of the target person to each three-dimensional imaging device in real time through the first wireless communication unit.
According to the three-dimensional imaging method, the whole public space in the building is divided into one space subarea, a plurality of cameras are installed in the range of each space subarea, the cameras form a camera cluster, shooting can be performed from a plurality of different angles, the purpose of comprehensive coverage monitoring is achieved, the shot videos are output in the form of video streams after being coded, the coding is convenient for recording and one-to-one correspondence, and errors caused by disorder of the video streams are prevented. The data switch combines the video streams collected by one camera cluster into a path of stored video stream, and then the stored video stream is stored in a monitoring video storage unit for backup; the data switch also combines a plurality of video streams provided by a plurality of cameras in the same space plot into a live video stream, and transmits the live video stream to the live video stream display unit and the first processor in real time. The live video stream display unit is arranged in a central control room in charge of security monitoring, and can display the live video stream of each space film area in a traditional television wall mode, for example, a plurality of display areas are arranged on the television wall, and each display area displays a real-time live video stream corresponding to one space film area.
In the three-dimensional imaging method, the locking mode of the target person can be checked by a monitoring person in charge of security through a television wall, the target person with key attention can be found from the locking mode, and a locking condition can be preset in a target person locking unit, for example, the locking condition can be that the old, the child, the head, the height, the color of clothes, scars are formed on the face, and the like; and a face identification technology is added, and the target person with key attention is determined from the live video stream through face matching. In specific implementation, two modes can be combined, so that the locking efficiency of the target person can be further improved, and the error leakage rate is reduced. After the target person is determined, the target person positioning unit determines the position information of the target person, wherein the position information refers to the position of the target person in the video frame image, and assists some fixed reference points, such as a flower stand, a garbage can, a sign and the like, so that the accuracy of the target person positioning can be increased. After the position information of the target person is determined, the feature information of the target person is extracted through the face recognition unit, wherein the feature information comprises a face feature value array and a body feature value array, the face feature value array can reflect the face feature of the target person, and the body feature value array can reflect the hair style, the height, the dressing and the like of the target person. And then, the position information and the characteristic information of the target person are delivered to the three-dimensional imaging equipment and the video acquisition unit through the first wireless communication unit. Each person on duty in a public place carries with him a three-dimensional imaging device which can display the position information, the characteristic information and the pursuit path information of a target person. Therefore, the duty personnel can lock and position the target person in the crowd in time and plan an effective path for pursuing the target person.
In the three-dimensional imaging method, the central control server sends the position information and the characteristic information of the target person to two or more three-dimensional imaging devices closest to the target person, the position information and the characteristic information are generally sent to more than two three-dimensional imaging devices in order to ensure the shooting integrity of the shooting target person, and meanwhile, the number of the three-dimensional imaging devices is generally less than five in order to reduce the operation cost.
In specific implementation, one of a plurality of video streams provided by a plurality of cameras in the same space segment can be selected and stored in the monitoring video storage unit, and the selected video stream is clear and complete, so that the storage space of the monitoring video storage unit can be saved. For the arrangement mode of the data switch, one camera cluster of one space parcel can correspond to one data switch, and one data switch can be shared by the clusters of a plurality of space parcels. The monitoring person at the video wall may also add a remark label to the target person describing why the person target is the object of major interest, which is also sent to the three-dimensional imaging device and displayed.
Referring to fig. 4 to 6, the three-dimensional imaging device for automatic face tracking includes a third processor, a GPS module, a wireless communication module, an analysis module, a camera, and a display screen, where the GPS module, the wireless communication module, the analysis module, the camera, and the display screen are electrically connected to the third processor respectively; and the analysis module analyzes the pursuit path according to the positioning information of the GPS module and the position information of the target person and displays the pursuit path through a display screen.
The three-dimensional imaging equipment can be AR glasses, the camera is installed on an AR glasses shell and is right opposite to the front, and visual scenes in a certain range in front of the AR glasses can be shot. The three-dimensional imaging equipment has two functions of target person navigation display and target person identification display, specifically, the GPS module can be used for positioning the position of an equipment carrier, and according to the positioning position and the real-time position information of a target person, a display screen of the three-dimensional imaging equipment can display a navigation map and/or navigation arrows pointing to the real-time positioning position of the target person from the current position of the display screen; when the target person appears in the visual range of the three-dimensional imaging equipment, matching the character characteristics in the visual range through the characteristic value array of the target person; if the matching is successful, the prompt information and the corresponding remark label are displayed, and if the matching is failed, no information is displayed and is not prompted.
Finally, the above embodiments are only used for illustrating the technical solutions of the present invention and not for limiting, although the present invention is described in detail with reference to the embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions can be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all of them should be covered in the protection scope of the present invention.

Claims (7)

1. The utility model provides an automatic three-dimensional imaging system that face tracked, includes communication connection's video acquisition unit, data exchange unit and live broadcast video stream display element in proper order, its characterized in that:
the system comprises a central control server and a three-dimensional imaging unit, wherein the central control server comprises a first processor, a target person locking unit, a target person positioning unit, a face recognition unit and a first wireless communication unit, and the target person locking unit, the target person positioning unit, the face recognition unit, the first wireless communication unit and the data exchange unit are respectively in communication connection with the first processor;
the data exchange unit comprises a plurality of data exchangers and is used for combining the video streams acquired by the video acquisition unit into a live video stream and transmitting the live video stream to the live video stream display unit and the first processor in real time;
the target person locking unit is used for locking a target person meeting preset requirements from a live video stream, the target person positioning unit is used for determining position information of the target person, and the face recognition unit is used for extracting feature information of the target person; the target person characteristic information comprises face characteristic value array information and body characteristic value array information; the human face characteristic value array reflects the facial characteristics of a target person, and the body characteristic value array reflects the hairstyle, the height and the dressing of the target person;
the three-dimensional imaging unit comprises a plurality of three-dimensional imaging devices, position information, characteristic information and pursuit path information of a target person are displayed through three-dimensional imaging, and each three-dimensional imaging device is respectively in communication connection with the central control server;
the video acquisition unit comprises a plurality of camera clusters in different spatial ranges, and the camera clusters comprise a plurality of cameras which are arranged in different angles in the spatial ranges; the data switch combines the video streams into a storage video stream, and stores the storage video stream to the monitoring video storage unit for backup in real time; selecting one of a plurality of video streams provided by a plurality of cameras in the same space area and storing the selected video stream in a monitoring video storage unit;
each person on duty in the public places carries with him a three-dimensional imaging device, the three-dimensional imaging device can display the position information, the characteristic information and the pursuit path information of the target person, and the pursuit path is dynamically analyzed in real time according to the positioning information of the GPS module and the position information of the target person and is displayed through a display screen.
2. The three-dimensional imaging system of claim 1, wherein the video capture unit comprises a second processor, a determination unit, and a second wireless communication unit, and the determination unit, the second wireless communication unit, the surveillance video storage unit, and the plurality of cameras are electrically connected to the second processor, respectively.
3. A three-dimensional imaging method applied to the three-dimensional imaging system of any one of claims 1 to 2, comprising a video acquisition unit, a data exchange unit and a live video stream display unit which are sequentially connected in a communication manner, and is characterized by comprising the following steps:
s1: the method comprises the steps that video streams are obtained through a video acquisition unit, a data switch combines the video streams into a live video stream, and the live video stream is transmitted to a live video stream display unit and a first processor in real time;
s2: the method comprises the following steps that a target person locking unit locks a target person meeting preset requirements from a live video stream, a target person positioning unit determines position information of the target person, and a face recognition unit extracts feature information of the target person;
s3: transmitting the position information and the characteristic information of the target person to the three-dimensional imaging device and the video acquisition unit through the first wireless communication unit;
s4: and displaying the position information, the characteristic information and the pursuit path information of the target person by the three-dimensional imaging equipment, dynamically analyzing the pursuit path in real time according to the positioning information of the GPS module and the position information of the target person, and displaying the pursuit path through a display screen.
4. A three-dimensional imaging method according to claim 3, comprising a positioning update step of:
s301: the video acquisition unit receives the characteristic information of the target person, and the judgment unit compares and analyzes the characteristic information of the target person with the video stream in the monitoring video storage unit to judge whether the target person is in the shooting range of the camera;
s302: if yes, transmitting the video stream containing the target person to the first processor in real time according to the shooting time, and executing the step S303; if not, executing step S301;
s303: the target person positioning unit updates the position information of the target person according to the latest video stream containing the target person, and sends the position information of the target person to each three-dimensional imaging device in real time through the first wireless communication unit, wherein the three-dimensional imaging device is carried by each on-duty person in a public place.
5. The three-dimensional imaging method according to claim 4, wherein one of the video streams provided by the plurality of cameras in the same spatial range is selected and stored in the surveillance video storage unit.
6. A three-dimensional imaging apparatus for use in claim 1 or claim 3, characterized by: the system comprises a third processor, a GPS module, a wireless communication module, an analysis module, a camera and a display screen, wherein the GPS module, the wireless communication module, the analysis module, the camera and the display screen are respectively and electrically connected with the third processor; and the analysis module dynamically analyzes the pursuit path in real time according to the positioning information of the GPS module and the position information of the target person and displays the pursuit path through a display screen.
7. The three-dimensional imaging device according to claim 6, wherein the three-dimensional imaging device is AR glasses, and the camera is mounted on the AR glasses housing and faces forward.
CN201911144351.9A 2019-11-20 2019-11-20 Three-dimensional imaging system, imaging method and imaging device for automatic face tracking Active CN111147811B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911144351.9A CN111147811B (en) 2019-11-20 2019-11-20 Three-dimensional imaging system, imaging method and imaging device for automatic face tracking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911144351.9A CN111147811B (en) 2019-11-20 2019-11-20 Three-dimensional imaging system, imaging method and imaging device for automatic face tracking

Publications (2)

Publication Number Publication Date
CN111147811A CN111147811A (en) 2020-05-12
CN111147811B true CN111147811B (en) 2021-04-13

Family

ID=70517169

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911144351.9A Active CN111147811B (en) 2019-11-20 2019-11-20 Three-dimensional imaging system, imaging method and imaging device for automatic face tracking

Country Status (1)

Country Link
CN (1) CN111147811B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111526341B (en) * 2020-07-03 2020-09-29 支付宝(杭州)信息技术有限公司 Monitoring camera
CN112966149B (en) * 2020-10-20 2022-02-18 圣凯诺服饰有限公司 Mass data real-time searching system
CN112309271B (en) * 2020-11-09 2021-08-31 深圳市皇家显示技术有限公司 Suspended plank road LED display screen array driving system and corresponding terminal
CN112598704A (en) * 2020-12-15 2021-04-02 中标慧安信息技术股份有限公司 Target positioning and tracking method and system for public place

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106294724A (en) * 2016-08-09 2017-01-04 浙江宇视科技有限公司 A kind of night watching track acquisition methods and device
JPWO2015087730A1 (en) * 2013-12-10 2017-03-16 株式会社日立国際電気 Monitoring system
CN108616718A (en) * 2016-12-13 2018-10-02 杭州海康威视系统技术有限公司 Monitor display methods, apparatus and system
CN108712644A (en) * 2018-05-18 2018-10-26 镇江启迪数字天下科技有限公司 A kind of TW_AR intelligence guide system and guide method
CN109886196A (en) * 2019-02-21 2019-06-14 中水北方勘测设计研究有限责任公司 Personnel track traceability system and method based on BIM plus GIS video monitoring
CN110264570A (en) * 2019-06-13 2019-09-20 咏峰(大连)科技有限公司 A kind of autonomous cruising inspection system in forest land based on unmanned plane
CN110411455A (en) * 2019-08-22 2019-11-05 广东鉴面智能科技有限公司 A kind of location navigation and trace playback system and method based on recognition of face

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7567844B2 (en) * 2006-03-17 2009-07-28 Honeywell International Inc. Building management system
CN102724482B (en) * 2012-06-18 2015-08-26 西安电子科技大学 Based on the intelligent vision sensing network moving target relay tracking system of GPS and GIS
CN103824045A (en) * 2012-11-16 2014-05-28 中兴通讯股份有限公司 Face recognition and tracking method and face recognition and tracking system
CN109076191B (en) * 2016-05-09 2021-04-13 索尼移动通讯有限公司 Monitoring system, method, non-transitory computer-readable medium, and control unit
CN106027969B (en) * 2016-06-16 2019-05-21 北京数智源科技有限公司 Mobile video monitor platform
CN106060465A (en) * 2016-06-20 2016-10-26 陈�胜 Dynamic target tracking system and dynamic target tracking method based on electronic map and video surveillance
CN109743541B (en) * 2018-12-15 2023-04-18 深圳壹账通智能科技有限公司 Intelligent monitoring method and device, computer equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2015087730A1 (en) * 2013-12-10 2017-03-16 株式会社日立国際電気 Monitoring system
CN106294724A (en) * 2016-08-09 2017-01-04 浙江宇视科技有限公司 A kind of night watching track acquisition methods and device
CN108616718A (en) * 2016-12-13 2018-10-02 杭州海康威视系统技术有限公司 Monitor display methods, apparatus and system
CN108712644A (en) * 2018-05-18 2018-10-26 镇江启迪数字天下科技有限公司 A kind of TW_AR intelligence guide system and guide method
CN109886196A (en) * 2019-02-21 2019-06-14 中水北方勘测设计研究有限责任公司 Personnel track traceability system and method based on BIM plus GIS video monitoring
CN110264570A (en) * 2019-06-13 2019-09-20 咏峰(大连)科技有限公司 A kind of autonomous cruising inspection system in forest land based on unmanned plane
CN110411455A (en) * 2019-08-22 2019-11-05 广东鉴面智能科技有限公司 A kind of location navigation and trace playback system and method based on recognition of face

Also Published As

Publication number Publication date
CN111147811A (en) 2020-05-12

Similar Documents

Publication Publication Date Title
CN111147811B (en) Three-dimensional imaging system, imaging method and imaging device for automatic face tracking
WO2022121059A1 (en) Intelligent integrated access control management system based on 5g internet of things and ai
CN101325694B (en) System and method for monitoring intelligent video combining wireless radio frequency recognition technique
CN102724773B (en) Based on the wireless intelligent monitoring device and method of M2M communication
CN110175587B (en) Video tracking method based on face recognition and gait recognition algorithm
CN112449093A (en) Three-dimensional panoramic video fusion monitoring platform
CN107483889A (en) The tunnel monitoring system of wisdom building site control platform
CN106781165A (en) A kind of indoor multi-cam intelligent linkage supervising device based on depth sensing
US20110001828A1 (en) Method for controlling an alaram management system
CN108810462A (en) A kind of camera video interlock method and system based on location information
CN108710827B (en) A kind of micro- police service inspection in community and information automatic analysis system and method
CN102646309A (en) Intelligent video perimeter rail system and control method thereof
CN108259827B (en) Method, device, AR equipment and system for realizing security
CN111586351A (en) Visual monitoring system and method for fusion of three-dimensional videos of venue
CN111787189A (en) Gridding automatic monitoring system for integration of augmented reality and geographic information
CN112216398A (en) Urban and rural body temperature monitoring, alarming and epidemic preventing system and method based on face recognition
CN115248880A (en) Smart city security monitoring system
CN109145796A (en) A kind of identification of electric power piping lane fire source and fire point distance measuring method based on video image convergence analysis algorithm
KR101005568B1 (en) Intelligent security system
KR20100119920A (en) System for pursuit moving object using security crime prevention network and method thereof
CN107547867A (en) A kind of outside transformer substation video monitoring system and monitoring method
CN114325573A (en) Method for rapidly detecting identity and position information of operation and maintenance personnel of transformer substation
CN114067396A (en) Vision learning-based digital management system and method for live-in project field test
CN114120597A (en) Public place epidemic situation normalized prevention and control system based on machine vision
CN117041496A (en) Electric power production operation video monitoring system suitable for capital construction site

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant