CN108875567A - Recognition of face terminal and system - Google Patents

Recognition of face terminal and system Download PDF

Info

Publication number
CN108875567A
CN108875567A CN201810420103.1A CN201810420103A CN108875567A CN 108875567 A CN108875567 A CN 108875567A CN 201810420103 A CN201810420103 A CN 201810420103A CN 108875567 A CN108875567 A CN 108875567A
Authority
CN
China
Prior art keywords
face
recognition
terminal
software
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810420103.1A
Other languages
Chinese (zh)
Inventor
魏儒潜
曾维蒸
郑晓熙
武庚晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Megvii Technology Co Ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Priority to CN201810420103.1A priority Critical patent/CN108875567A/en
Publication of CN108875567A publication Critical patent/CN108875567A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • H04L67/5651Reducing the amount or size of exchanged application data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Abstract

The present invention provides a kind of recognition of face terminal and systems.The face identification terminal includes processor and software portion, and the software portion includes:System layer, realization are abstracted different platform system;Hardware abstraction layer is realized to the abstract of audio-video correlation function and is abstracted to the driving interface of different hardware platforms;Component software layer realizes the encapsulation to the basic software function of internal system;Software operation layer, realize the terminal towards scene service, the interactive function with external equipment is provided.It can be seen that the recognition of face terminal in the embodiment of the present invention can form an independent arithmetic element, small volume and less weight can reduce the data volume being transferred in remote server, mitigate network transmission, server calculates and the cost and pressure of system maintenance.

Description

Recognition of face terminal and system
Technical field
The present invention relates to field of image processing, relate more specifically to a kind of recognition of face terminal and system.
Background technique
With the promotion of face recognition algorithms accuracy rate and the maturation of terminal hardware, system, face recognition technology is It is widely used in every field.Such as in safety-security area, face identification system analyzes a large amount of video image, handles, It compares, a large amount of cameras for smart city construction bring new application value.
However, current face identification system uses the mode of back-end server PC cluster, need to dispose big rule in this way The server of mould handles all collected video monitoring datas.Since the data volume of passback is excessively huge, service will lead to The operational efficiency of device substantially reduces, and operation maintenance cost also sharply increases.
Summary of the invention
The present invention provides a kind of recognition of face terminal and system, wherein recognition of face terminal can be formed one it is independent Arithmetic element cuts operating costs so as to reduce the volume of transmitted data of network.
According to an aspect of the present invention, a kind of recognition of face terminal, including processor and software portion are provided, it is described soft Part portion includes:
System layer, realization are abstracted different platform system;
Hardware abstraction layer is realized to the abstract of audio-video correlation function and is abstracted to the driving interface of different hardware platforms;
Component software layer realizes the encapsulation to the basic software function of internal system;
Software operation layer, realize the terminal towards scene service, the interactive function with external equipment is provided.
In a kind of implementation of the invention, the software operation layer includes video stream module, interaction protocol module, is Management module of uniting and alarming and managing module, wherein:
The video stream module handles the local video recording and network transmission of audio-video code stream;
The interaction protocol module receives the control information of periphery, handles related command, and United Dispatching is distributed;
The system management module, following at least one function in management system:Network function, upgrade function and user Privilege feature;
The alarming and managing module is received the event that bottom reports and is correspondingly processed based on parameter of deploying to ensure effective monitoring and control of illegal activities.
In a kind of implementation of the invention, the basic software function of the internal system is comprised at least one of the following:
Internal system communication, software timer, configuration management.
In a kind of implementation of the invention, the hardware abstraction layer includes Media abstractions sublayer and the abstract son of driving Layer, wherein:
The Media abstractions sublayer, the application programming interfaces based on chip realize audio/video encoding/decoding;
It is described to drive abstract sublayer, it realizes abstract to the driving interface of different hardware platforms.
In a kind of implementation of the invention, the driving of the different hardware platforms comprises at least one of the following general drive It is dynamic:
House dog, status lamp, bidirectional linked list line I2C and serial peripheral equipment interface SPI.
According to another aspect of the present invention, a kind of system for recognition of face, including above-mentioned aspect or any are provided Recognition of face terminal described in implementation, further includes image collecting device and remote server:
Described image acquisition device is responsible for the acquisition of head end video data/image data;
The recognition of face terminal is responsible for carrying out recognition of face based on the video data/image data;
The remote server is responsible for receiving the result of the recognition of face from the recognition of face terminal.
In a kind of implementation of the invention, wherein
The recognition of face terminal, result based on the recognition of face generate warning message, and by the warning message It is sent to the remote server;
The remote server receives the warning message from the recognition of face terminal, and is based on the warning message Execute subsequent processing.
In a kind of implementation of the invention, the subsequent processing includes:Secondary face recognition process.
In a kind of implementation of the invention, further include:Local computer is responsible for showing and the face identification device Relevant information.
In a kind of implementation of the invention, the recognition of face terminal and the remote server by internet into Row communication.
It can be seen that the recognition of face terminal in the embodiment of the present invention can form an independent arithmetic element, it is small It is skilful light, the data volume being transferred in remote server can be reduced, network transmission, server calculating and system maintenance are mitigated Cost and pressure.
Detailed description of the invention
The embodiment of the present invention is described in more detail in conjunction with the accompanying drawings, the above and other purposes of the present invention, Feature and advantage will be apparent.Attached drawing is used to provide to further understand the embodiment of the present invention, and constitutes explanation A part of book, is used to explain the present invention together with the embodiment of the present invention, is not construed as limiting the invention.In the accompanying drawings, Identical reference label typically represents same parts or step.
Fig. 1 is a schematic block diagram of the electronic equipment of the embodiment of the present invention;
Fig. 2 is a schematic block diagram in the software portion of the recognition of face terminal of the embodiment of the present invention;
Fig. 3 is the knot of a more detailed modularized design in the software portion of the recognition of face terminal of the embodiment of the present invention Structure block diagram;
Fig. 4 is a schematic block diagram of the face identification system of the embodiment of the present invention;
Fig. 5 is a schematic diagram of the face identification system of the embodiment of the present invention.
Specific embodiment
In order to enable the object, technical solutions and advantages of the present invention become apparent, root is described in detail below with reference to accompanying drawings According to example embodiments of the present invention.Obviously, described embodiment is only a part of the embodiments of the present invention, rather than this hair Bright whole embodiments, it should be appreciated that the present invention is not limited by example embodiment described herein.Based on described in the present invention The embodiment of the present invention, those skilled in the art's obtained all other embodiment in the case where not making the creative labor It should all fall under the scope of the present invention.
The embodiment of the present invention can be applied to electronic equipment, and Fig. 1 show one of the electronic equipment of the embodiment of the present invention Schematic block diagram.Electronic equipment 10 shown in FIG. 1 include one or more processors 102, one or more storage device 104, Input unit 106, output device 108, imaging sensor 110 and one or more non-image sensors 114, these components are logical Cross bus system 112 and/or other forms interconnection.It should be noted that the component and structure of electronic equipment 10 shown in FIG. 1 only show Example property, and not restrictive, as needed, the electronic equipment also can have other assemblies and structure.
The processor 102 may include central processing unit (Central Processing Unit, CPU) 1021 Hes There is graphics processing unit (Graphics Processing Unit, GPU) 1022 data-handling capacity and/or instruction to hold The processing unit of the other forms of row ability, such as field programmable gate array (Field-Programmable Gate Array, FPGA) or advanced reduced instruction set machine (Advanced RISC (Reduced Instruction Set Computer) Machine, ARM) etc., and processor 102 can control other components in the electronic equipment 10 to execute Desired function.
The storage device 104 may include one or more computer program products, and the computer program product can To include various forms of computer readable storage mediums, such as volatile memory 1041 and/or nonvolatile memory 1042.The volatile memory 1041 for example may include random access memory (Random Access Memory, RAM) And/or cache memory (cache) etc..The nonvolatile memory 1042 for example may include read-only memory (Read-Only Memory, ROM), hard disk, flash memory etc..It can store one or more on the computer readable storage medium A computer program instructions, processor 102 can run described program instruction, to realize various desired functions.In the meter Can also store various application programs and various data in calculation machine readable storage medium storing program for executing, for example, the application program use and/or The various data etc. generated.
The input unit 106 can be the device that user is used to input instruction, and may include keyboard, mouse, wheat One or more of gram wind and touch screen etc..
The output device 108 can export various information (such as image or sound) to external (such as user), and It may include one or more of display, loudspeaker etc..
Described image sensor 110 can be shot the desired image of user (such as photo, video etc.), and will be captured Image be stored in the storage device 104 for other components use.
When note that the component and structure of electronic equipment shown in FIG. 1 10 are only exemplary, although electronics shown in fig. 1 Equipment 10 includes multiple and different devices, but as needed, some of which device can not be necessary, some of which The quantity of device can be more etc., and the present invention does not limit this.
In order to reduce the data volume for being transmitted to server, the embodiment of the invention provides a kind of recognition of face terminal, The functions such as recognition of face can be carried out in front end, stability height, strong real-time can satisfy the application scenarios of various complexity.
Fig. 2 is a schematic block diagram in the software portion of the recognition of face terminal of the embodiment of the present invention.Recognition of face terminal May include processor and software portion, wherein software portion 200 shown in Fig. 2 include system layer 210, it is hardware abstraction layer 220, soft Part component layer 230 and software operation layer 240.
System layer 210, realization are abstracted different platform system;
Hardware abstraction layer 220 is realized to the abstract of audio-video correlation function and is taken out to the driving interface of different hardware platforms As;
Component software layer 230 realizes the encapsulation to the basic software function of internal system;
Software operation layer 240, realize the terminal towards scene service, the interactive function with external equipment is provided.
It is understood that this modular design is the requirement based on stability, real-time.Specifically, this modular sets Counting structure can be as shown in Figure 3.
System layer may be implemented for the abstract of different system platform, and solving can not after current some scheme systems switch The problem of smooth adaptation, poor compatibility.As an example, Linux as shown in Figure 3.
Abstract and to different hardware platforms the driving to bottom audio-video correlation function may be implemented in hardware abstraction layer Interface abstraction, the main purpose of hardware abstraction are to realize platform unrelatedization of interface, whole preferable portable to ensure.
Illustratively, hardware abstraction layer may include Media abstractions sublayer and the abstract sublayer of driving.Wherein, Media abstractions The application programming interfaces that layer is mainly based upon chip realize audio/video encoding/decoding, mainly include:Video coding, video decoding, figure As coding, image decoding etc..Coding/decoding is the process that compression/de-compression is carried out to video or image.Wherein, chip is answered Can be related with the production firm of the chip with routine interface, the application programming interfaces of different vendor can be identical or different.
Abstract sublayer is driven to realize abstract to the driving interface of different hardware platforms.That is, the abstract sublayer of driving ( Be properly termed as driving interface sublayer) be mainly some general drivings (being referred to as basic driving) realization, mainly include:It sees Door dog, status lamp, bidirectional linked list line (Inter-Integrated Circuit, I2C), Serial Peripheral Interface (SPI) (Serial Peripheral Interface, SPI) etc..It is understood that general driving also may include other unlisted herein drivings, All resets as shown in Figure 3, the present invention do not limit this.
Further optionally, hardware abstraction layer can also include manufacturer's information, and as shown in Figure 3 tall and handsome reaches.
Component software layer realizes the encapsulation to basic softwares functions such as internal system communication, software timer, configuration managements, Main purpose is the method that intermodule communication is provided for software operation layer and unified calling interface.In addition, as shown in figure 3, Component software layer also realizes the functions such as recognizer.It is communicated by internal system, recognition of face is carried out to video/image.Specifically Ground can be called the recognizer in the software services layer in the software portion 200, to software industry by the processor of recognition of face terminal The human face data being engaged in video/image acquired in layer carries out recognition of face.Specific mistake of the embodiment of the present invention to recognition of face Journey without limitation, for example, can by calculate video/image in face and bottom library face between similarity to determine whether Belong to same people.
Software operation layer includes video stream module, interaction protocol module, system management module and alarming and managing module.Its In:
Video stream module is responsible for handling the local video recording of audio-video code stream and network transmission, and lower layer is by encapsulation or place The audio, video data acquisition interface of reason.It realizes and requires to accomplish unrelated with control interface, general data transmission interface is provided.
Interaction protocol module is responsible for receiving the control information of periphery, handles related command, and United Dispatching is distributed.Realization is wanted The scalability for accomplishing agreement is sought, general command process interface is provided.
System management module is responsible for following at least one function in management system:Network function, upgrade function and user Privilege feature.It realizes and requires to accomplish that interface is clearly easy-to-use.
Alarming and managing module is responsible for the event that reception bottom reports and is correspondingly processed based on parameter of deploying to ensure effective monitoring and control of illegal activities.It realizes and requires It supports multimode communication, and supports the linkage of a variety of alarms and movement.
It can be seen that the recognition of face terminal in the embodiment of the present invention can form an independent arithmetic element, it is small It is skilful light, data loss problem caused by the factors such as unstable networks, network bandwidth be limited can be avoided.
Illustratively, as shown in figure 3, the software portion 200 can make recognition of face terminal and other by various agreements Equipment carries out data transmission.For example, used agreement can be real time streaming transport protocol (Real Time Streaming Protocol, RTSP), hypertext transfer protocol (HyperText Transfer Protocol, HTTP) etc..Other equipment are all Such as video camera, browser, client.
RTSP, RFC2326 are an application layer protocols in ICP/IP protocol system.The agreement is used for C/S model, is One text based agreement, for establishing and negotiating real-time streaming session at client and server end.That is, RTSP is Application level protocol controls the transmission of real time data.RTSP provides an extensible framework, makes real time data, such as audio and view The controlled program request of frequency is possibly realized.Data source includes field data and is stored in data in editing.The agreement purpose is to control Multiple data send connection, to select sendaisle, such as UDP, multicast UDP and TCP, provide approach, and be selection based on RTP Transmission mechanism providing method.RTSP is established and is controlled the continuous Streaming Media of one or several time synchronizations.Although continuous media It is possible for exchanging with control stream, and usual itself does not send continuous flow.In other words, RTSP serves as the net of multimedia server Network remotely controls.RTSP connection is not tied to transport layer connection, such as TCP.During RTSP connection, RTSP user it is openable or That closes multiple pairs of servers transmits connection to issue RTSP request.In addition, Connectionless Transport Protocal, such as UDP can be used. The stream of RTSP flow control may use RTP, but RTSP operation is not relying on the transmission mechanism for carrying continuous media.
HTTP is the standard (TCP) of client and server end a request and response.Client is terminal user, service Device end is website.By using Web browser, web crawlers or other tools, client initiates one to server The HTTP request of designated port.
Referring to Fig. 3, recognition of face terminal can obtain video flowing or image from image collecting device using RTSP, such as can To be the data acquired in real time by image collecting device.Then, coding/decoding can be carried out to video flowing or image, using face Recognizer carries out recognition of face.Specifically, the face in video flowing or image can be compared with bottom library face.It can be with Result based on recognition of face generates warning message, and the warning message is sent to such as browser or client by HTTP End.
Fig. 4 is the schematic block diagram of the system for recognition of face of the embodiment of the present invention.System shown in Fig. 4 includes: Recognition of face terminal 20, image collecting device 30 and remote server 40.
Image collecting device 30 is responsible for the acquisition of head end video data/image data;
Recognition of face terminal 20 is responsible for carrying out recognition of face based on the video data/image data;
Remote server 40 is responsible for receiving the result of the recognition of face from the recognition of face terminal.
Image collecting device 30 can be capture machine or video camera.Capture machine can capture facial image or video, for example, It can be captured based on trigger condition, which can be the period or detect face.Capture machine can be every certain Duration (period) captures the video of an image or certain time length (such as 1s or 2s);Alternatively, capture machine can be in real-time detection To there are the videos for capturing an image or certain time length (such as 1s or 2s) when face;The present invention does not limit this.Video camera It may be at normally open, and shoot the video flowing within the scope of its.In the embodiment of the present invention, image collecting device 30 can will be adopted The image/video collected is sent to recognition of face terminal 20, wherein video can be the video of H.264 format.
Recognition of face terminal 20 can obtain human face data (image or video) from image collecting device 30.In hardware design On, the processor of recognition of face terminal 20 can be the high-performance artificial intelligent algorithm processor based on Tegra X1 exploitation, tool There is Teraflops grades of Floating-point Computation ability, smooth can run face recognition algorithms, it can real time parsing multiplex image acquisition dress 30 human face datas collected are set, for example, as shown in figure 5, a recognition of face terminal 20 can commonly be taken the photograph with the road real time parsing 1-2 The image data of camera or the road 4-6 capture machine.
Recognition of face terminal 20 can analyze human face data, such as be decoded, recognition of face, the comparison of bottom library, report A series of functions such as alert, storage.For example, recognition of face terminal 20 can store human face data and optionally after this may be used The human face data stored is sent to remote server 40.Recognition of face terminal 20 can be judged using human face recognition model Whether the face in human face data is one of bottom library face.For example, bottom library face can be the people of wanted criminal in safety-security area Face, however, it is determined that the face in human face data is one of bottom library face, warning message can be generated, and the warning message is sent out in time It send to remote server 40.In turn, security personnel can be arrested based on warning message implementation.
In addition, recognition of face terminal 20 can also carry out headend equipment management, bottom depositary management reason, equipment management and rights management Deng.It, can be right since recognition of face terminal 20 can parse the human face data collected of multiplex image acquisition device 30 Multiplex image acquisition device 30 carries out headend equipment management, that is to say, that headend equipment here refers to image collecting device 30. Bottom library face in the library of bottom, which can according to need, the operation such as is updated, such as increases, deletes, to realize that bottom depositary management is managed.It is right The equipment management of recognition of face terminal 20 itself may include the update etc. to its software.Which user rights management includes to people Face executes the operation etc. of which kind of rank like other terminal 20.
Illustratively, headend equipment pipe can be realized via local personal computer (Personal Computer, PC) Reason, bottom depositary management reason, equipment management and rights management etc..Specifically, user can carry out input/output operations by local PC, To realize above-mentioned every management function.In addition, local PC has display screen, recognition of face terminal can also be presented in real time 20 face recognition process, such as the facial image collected of image collecting device 30 and bottom library facial image are presented on simultaneously It shows on screen, so as to user's real time inspection of local PC.Warning message can also be presented in the display screen in real time, so as to local User's real time inspection of PC.
In the embodiment of the present invention, local PC can connect one or more recognition of face terminal 20 simultaneously, as shown in figure 5, Local PC connects three recognition of face terminals 20 simultaneously.Connection between recognition of face terminal 20 and local PC can be wired company It connects or is wirelessly connected.For example, the storage mediums such as SD, USB can be supported.For example, wireless network transmissions such as wifi etc. can be supported. Based on this, local PC can be obtained at any time and be exported the information stored in recognition of face terminal 20.
Intelligent Identification of Images terminal can carry out face inspection to the target occurred in real time monitoring video on Functional Design Survey, face snap, face Modelling feature value are extracted, and it is real-time to combine practical business application to realize that the black of face, white list compare The business functions such as alarm.
For example, by taking vehicle-mounted scene as an example, such as the vehicle-mounted case of squad car, public transport, the vehicle-mounted case of operation bus, outdoor monitoring Upright bar equipment box etc., adopt with can arranging a playscript with stage directions by the recognition of face terminal of PC, at least one and at least one image for a vehicle Acquisition means.And generally, the quantity of image collecting device can be greater than or equal to the quantity of recognition of face terminal.
Remote server 40 can be from the reception recognition of face of recognition of face terminal 20 as a result, for example, improving result instruction: Which of which image collecting device which section video/image collected which of face and bottom library face belong to In same people probability (or similarity) be it is much.For example, recognition of face terminal and remote server can by internet into Row communication.The result of recognition of face can be sent to remote server 40 by mobile network by recognition of face terminal 20.Separately Outside, warning message can also be sent to remote server 40 by recognition of face terminal 20, wherein can be as about the warning message Shown in above-mentioned, which is not described herein again.
Illustratively, remote server 40 can carry out subsequent processing based on the warning message.For example, in safety-security area, If it is determined that image collecting device face collected is wanted circular personnel, can implement to arrest accordingly by security personnel.For example, if needing It further confirms that, then remote server 40 can carry out secondary face recognition process.In view of the algorithm in remote server 40 Recognition of face be able to can be carried out again in remote server 40 with more complicated more acurrate, to recalculate image collecting device institute Similarity between the face and bottom library face of acquisition, determines whether to belong to same people.Thus, it is possible to improve processing essence Degree, prevents from judging by accident.
It can be seen that the recognition of face terminal in the embodiment of the present invention belongs to small and exquisite computing unit, it can be with flexible Application In various mobile investigation equipment, the human face data of image acquisition device can be obtained whenever and wherever possible, carries out recognition of face And send warning message in real time, be based on this, can reduce the data volume being transferred in remote server, mitigate network transmission, Server calculates and the cost and pressure of system maintenance.Occasion increasingly intensive emphasis scene increasingly increased the present in city It, this front end, which is temporarily deployed to ensure effective monitoring and control of illegal activities, is being increasingly becoming the significant capability of police work, and has and adapt to various complex environments Ability.
Although describing example embodiment by reference to attached drawing here, it should be understood that above example embodiment are only exemplary , and be not intended to limit the scope of the invention to this.Those of ordinary skill in the art can carry out various changes wherein And modification, it is made without departing from the scope of the present invention and spiritual.All such changes and modifications are intended to be included in appended claims Within required the scope of the present invention.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed The scope of the present invention.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it Its mode is realized.For example, apparatus embodiments described above are merely indicative, for example, the division of the unit, only Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple units or components can be tied Another equipment is closed or is desirably integrated into, or some features can be ignored or not executed.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the present invention and help to understand one or more of the various inventive aspects, To in the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure, Or in descriptions thereof.However, the method for the invention should not be construed to reflect following intention:It is i.e. claimed The present invention claims features more more than feature expressly recited in each claim.More precisely, such as corresponding power As sharp claim reflects, inventive point is that the spy of all features less than some disclosed single embodiment can be used Sign is to solve corresponding technical problem.Therefore, it then follows thus claims of specific embodiment are expressly incorporated in this specific Embodiment, wherein each, the claims themselves are regarded as separate embodiments of the invention.
It will be understood to those skilled in the art that any combination pair can be used other than mutually exclusive between feature All features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed any method Or all process or units of equipment are combined.Unless expressly stated otherwise, this specification (is wanted including adjoint right Ask, make a summary and attached drawing) disclosed in each feature can be replaced with an alternative feature that provides the same, equivalent, or similar purpose.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of any Can in any combination mode come using.
Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice Microprocessor or digital signal processor (Digital Signal Processing, DSP) are implemented according to the present invention to realize The some or all functions of some modules in the article analytical equipment of example.The present invention is also implemented as executing here Some or all program of device (for example, computer program and computer program product) of described method.In this way Realization program of the invention can store on a computer-readable medium, or can have the shape of one or more signal Formula.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or with any other shape Formula provides.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame Claim.
The above description is merely a specific embodiment or to the explanation of specific embodiment, protection of the invention Range is not limited thereto, and anyone skilled in the art in the technical scope disclosed by the present invention, can be easily Expect change or replacement, should be covered by the protection scope of the present invention.Protection scope of the present invention should be with claim Subject to protection scope.

Claims (10)

1. a kind of recognition of face terminal, which is characterized in that including processor and software portion, the software portion includes:
System layer, realization are abstracted different platform system;
Hardware abstraction layer is realized to the abstract of audio-video correlation function and is abstracted to the driving interface of different hardware platforms;
Component software layer realizes the encapsulation to the basic software function of internal system;
Software operation layer, realize the terminal towards scene service, the interactive function with external equipment is provided.
2. terminal according to claim 1, which is characterized in that the software operation layer includes video stream module, interaction association Module, system management module and alarming and managing module are discussed, wherein:
The video stream module handles the local video recording and network transmission of audio-video code stream;
The interaction protocol module receives the control information of periphery, handles related command, and United Dispatching is distributed;
The system management module, following at least one function in management system:Network function, upgrade function and user right Function;
The alarming and managing module is received the event that bottom reports and is correspondingly processed based on parameter of deploying to ensure effective monitoring and control of illegal activities.
3. terminal according to claim 1, which is characterized in that the basic software function of the internal system include with down toward Few one kind:
Internal system communication, software timer, configuration management.
4. terminal according to any one of claim 1 to 3, which is characterized in that the hardware abstraction layer includes that media are taken out As sublayer and abstract sublayer is driven, wherein:
The Media abstractions sublayer, the application programming interfaces based on chip realize audio/video encoding/decoding;
It is described to drive abstract sublayer, it realizes abstract to the driving interface of different hardware platforms.
5. terminal according to claim 4, which is characterized in that the driving of the different hardware platforms includes following at least one Kind general driving:
House dog, status lamp, bidirectional linked list line I2C and serial peripheral equipment interface SPI.
6. a kind of system for recognition of face, which is characterized in that including face according to any one of claims 1 to 4 Identification terminal further includes image collecting device and remote server:
Described image acquisition device is responsible for the acquisition of head end video data/image data;
The recognition of face terminal is responsible for carrying out recognition of face based on the video data/image data;
The remote server is responsible for receiving the result of the recognition of face from the recognition of face terminal.
7. system according to claim 6, which is characterized in that wherein,
The recognition of face terminal, the result based on the recognition of face generates warning message, and the warning message is sent To the remote server;
The remote server is received the warning message from the recognition of face terminal, and is executed based on the warning message Subsequent processing.
8. system according to claim 7, which is characterized in that the subsequent processing includes:Secondary face recognition process.
9. system according to claim 6, which is characterized in that further include:
Local computer is responsible for showing information relevant to the face identification device.
10. system according to any one of claims 6 to 9, which is characterized in that
The recognition of face terminal is communicated with the remote server by internet.
CN201810420103.1A 2018-05-04 2018-05-04 Recognition of face terminal and system Pending CN108875567A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810420103.1A CN108875567A (en) 2018-05-04 2018-05-04 Recognition of face terminal and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810420103.1A CN108875567A (en) 2018-05-04 2018-05-04 Recognition of face terminal and system

Publications (1)

Publication Number Publication Date
CN108875567A true CN108875567A (en) 2018-11-23

Family

ID=64326944

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810420103.1A Pending CN108875567A (en) 2018-05-04 2018-05-04 Recognition of face terminal and system

Country Status (1)

Country Link
CN (1) CN108875567A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109788170A (en) * 2018-12-25 2019-05-21 合肥芯福传感器技术有限公司 It is a kind of based on infrared with video image processing system and method for visible light
CN110532033A (en) * 2019-08-30 2019-12-03 北京猎户星空科技有限公司 A kind of data processing system and data processing method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101873340A (en) * 2010-05-07 2010-10-27 上海洪剑智能科技有限公司 Face recognition network system based on wireless and wired communication technologies and recognition method thereof
CN103106117A (en) * 2012-12-25 2013-05-15 青岛海信电器股份有限公司 Resource allocation method and electronic equipment
CN103632488A (en) * 2012-08-23 2014-03-12 潘良满 Human face capturing alarm device and method thereof
CN104427388A (en) * 2013-09-10 2015-03-18 国家广播电影电视总局广播科学研究院 Operating system of intelligent television
US20180025242A1 (en) * 2016-07-22 2018-01-25 Nec Laboratories America, Inc. Security system for facility access control
CN107845174A (en) * 2017-11-23 2018-03-27 郑州云海信息技术有限公司 A kind of kindergarten's gate control system and method based on cloud computing

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101873340A (en) * 2010-05-07 2010-10-27 上海洪剑智能科技有限公司 Face recognition network system based on wireless and wired communication technologies and recognition method thereof
CN103632488A (en) * 2012-08-23 2014-03-12 潘良满 Human face capturing alarm device and method thereof
CN103106117A (en) * 2012-12-25 2013-05-15 青岛海信电器股份有限公司 Resource allocation method and electronic equipment
CN104427388A (en) * 2013-09-10 2015-03-18 国家广播电影电视总局广播科学研究院 Operating system of intelligent television
US20180025242A1 (en) * 2016-07-22 2018-01-25 Nec Laboratories America, Inc. Security system for facility access control
CN107845174A (en) * 2017-11-23 2018-03-27 郑州云海信息技术有限公司 A kind of kindergarten's gate control system and method based on cloud computing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王超: "《智慧校园系统的考勤管理子系统的设计与实现》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109788170A (en) * 2018-12-25 2019-05-21 合肥芯福传感器技术有限公司 It is a kind of based on infrared with video image processing system and method for visible light
CN110532033A (en) * 2019-08-30 2019-12-03 北京猎户星空科技有限公司 A kind of data processing system and data processing method
WO2021036887A1 (en) * 2019-08-30 2021-03-04 北京猎户星空科技有限公司 Data processing system and method

Similar Documents

Publication Publication Date Title
CN102196248B (en) Mobile video monitoring system and method
CN1254972C (en) Intelligent video content monitoring system based on IP network
CN108200190A (en) Internet of Things data service system and method based on cloud computing
CN106027664A (en) Medical device running management system and method
CN102411832B (en) Intelligent tracking and detecting method and system for network monitoring equipment
US10621440B2 (en) Network switching appliance, process and system for performing visual analytics for a streaming video
CN106707777A (en) Intelligent home remote control system based on cloud system
CN110147723B (en) Method and system for processing abnormal behaviors of customers in unmanned store
CN111047824B (en) Indoor child nursing linkage control early warning method and system
CN102917207A (en) Motion sequence based abnormal motion vision monitoring system
CN109544870B (en) Alarm judgment method for intelligent monitoring system and intelligent monitoring system
CN108875567A (en) Recognition of face terminal and system
CN107578024A (en) A kind of face identification system
CN111191507A (en) Safety early warning analysis method and system for smart community
CN106454263A (en) Field patrol inspection system based on image intellisense IOT (Internet of Things) technology
CN111090773A (en) Digital retina architecture and software architecture method and system
CN115103157A (en) Video analysis method and device based on edge cloud cooperation, electronic equipment and medium
CN102355575A (en) Distributed video monitoring device with pre-warning function
CN112804188B (en) Scalable vision computing system
CN201830395U (en) Oil well monitoring system
CN111028453A (en) Monitoring and identifying method and system based on Internet of things technology
CN115019462A (en) Video processing method, device, storage medium and equipment
CN212572702U (en) Edge calculation-based acquisition, processing, display and safety control device
CN201608830U (en) Intelligent monitoring system based on mobile video signals
CN207771833U (en) A kind of intelligent security robot that three-dimensional prevention and control can be realized based on dynamic human face identification technology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181123

RJ01 Rejection of invention patent application after publication