CN111179569A - Face detection control system and application thereof - Google Patents

Face detection control system and application thereof Download PDF

Info

Publication number
CN111179569A
CN111179569A CN202010195305.8A CN202010195305A CN111179569A CN 111179569 A CN111179569 A CN 111179569A CN 202010195305 A CN202010195305 A CN 202010195305A CN 111179569 A CN111179569 A CN 111179569A
Authority
CN
China
Prior art keywords
face
authorized
wireless control
current
circuit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010195305.8A
Other languages
Chinese (zh)
Inventor
许朔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202010195305.8A priority Critical patent/CN111179569A/en
Publication of CN111179569A publication Critical patent/CN111179569A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00Transmission systems of control signals via wireless link
    • G08C2201/30User interface

Abstract

The invention provides a face detection control system and application thereof, belonging to the technology of combining face detection and smart home, wherein the hardware part of the face detection control system comprises a processor, an image acquisition circuit, a communication circuit, a wireless control circuit, a power supply circuit, an indication circuit, a storage circuit and the like which are respectively connected with the processor, in order to improve the control precision and the user experience, the system is configured with a plurality of optimized detection algorithms, has strong expansibility and good application prospect, can be widely applied to the field of Internet of things such as a smart television box, a smart air conditioner and the like, can greatly reduce the interaction cost on one hand, and is suitable for special people such as the old, children, disabled people and the like; on the other hand, the control efficiency can be greatly improved, corresponding control parameters are quickly locked based on the facial features of the user, personalized service matching is completed, and practical application of different occasions is met.

Description

Face detection control system and application thereof
Technical Field
The invention relates to a face detection control system and application thereof, belonging to the technology of combining face detection and intelligent home furnishing.
Background
With the development of computer application technology, the concepts of internet of things and smart home have become increasingly popular. Various smart home products have also emerged on the market, for example: the smart sound box, the smart television, the smart air conditioner and the like, common smart home products generally adopt key interaction or touch screen interaction, and some products try voice interaction or video interaction modes and the like.
However, the key interaction or touch screen interaction mode is more complex for special people such as the elderly, children, and handicapped, and generally, the control requirements of the people are more fixed, for example: children can continuously like watching a certain television channel within a certain period of time, and the old can continuously like listening to a certain music program within a certain period of time, so that the efficiency of using keys or touching a screen is not high.
Meanwhile, the existing voice interaction or video interaction mode is only a preliminary improvement, and the detailed operation steps still need to be expressed by the user with the body or language, for example: in voice interaction, the user needs to speak the mandarin language to open a return main menu, open an X program, select an A channel, enter and the like, and certain operation skill and threshold are also needed.
In view of the above technical background, there is an urgent need to design a new interaction mode, which can reduce the interaction cost and is suitable for the special people such as the elderly, children, handicapped people, etc.; on the other hand, the control efficiency needs to be greatly improved, corresponding control parameters are quickly locked based on user characteristics, personalized service matching is completed, and practical application of different occasions is met.
Disclosure of Invention
In view of the above technical background and technical problems, the present invention provides a face detection control system and an application thereof, which can greatly reduce the interaction cost and is suitable for special people such as the elderly, children, handicapped people, etc.; on the other hand, the control efficiency can be greatly improved, corresponding control parameters are quickly locked based on the facial features of the user, personalized service matching is completed, and practical application of different occasions is met.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
the utility model provides a face detection control system includes the treater and with image acquisition circuit, communication circuit, wireless control circuit, power supply circuit, indicating circuit and the memory circuit that the treater is connected respectively, wherein: the image acquisition circuit is used for acquiring a face photo of a user and comprises a CCD (charge coupled device) or a CMOS (complementary metal oxide semiconductor) camera; the communication circuit is used for connecting an upper computer and finishing data setting of the processor, the communication circuit adopts a wireless mode or a wired mode, the wireless mode comprises WIFI, wireless HDMI, 4G mobile communication network, 5G mobile communication network or RF radio frequency communication, and the wired mode comprises USB, CSI, RJ45, MIPI or DVP interfaces; the wireless control circuit is used for transmitting a wireless control signal to the actuator, and the wireless control signal comprises a WIFI signal, a ZigBee signal, an infrared signal or a Sub-1GHz signal; the power supply circuit is used for supplying power to the system; the indicating circuit is used for feeding back the working state of the processor to a user and comprises an LED, a buzzer or a display; the storage circuit is used for storing face data, a wireless control signal set and control data of authorized users, and each face of the authorized users has a corresponding wireless control signal set; the processor processes and judges the face picture acquired by the image acquisition circuit and sends a corresponding wireless control signal set to the actuator through the wireless control circuit based on the face of the authorized user.
Preferably, the system further comprises a housing, a connector, and a seat, wherein: the shell is used as an installation main body and is arranged on a seat body through a connecting piece, the connecting piece comprises a ball joint, a universal pipe or a universal pipe, and the seat body comprises a base or a clamping seat; the front side of the shell is provided with a camera, the back side of the shell is provided with a bent pipe, the tail end of the bent pipe is provided with a wireless transceiving head, the camera is connected with the processor through an internal circuit of the shell, and the wireless transceiving head is connected with the processor through an internal circuit of the shell; the shell is also provided with an indicating device and an interface, and the indicating device comprises an LED and/or a sound box. Specifically, still including setting up the adhesion body in the pedestal bottom, the adhesion body includes magnet, nylon buckle or double faced adhesive tape.
Preferably, the system comprises the following control flow:
A1) judging whether the equipment is authorized;
A2) when the device has been authorized, determining whether wireless control is set; when the device is not authorized, the device is authorized, and the step A1 is returned after the device is authorized;
A3) when the wireless control has been set, go to step a 4; when the wireless control is not set, setting the wireless control, and returning to the step A1 after setting;
A4) acquiring a face photo of a current user through an image acquisition circuit;
A5) judging whether the picture or the face detection is normal or not based on the collected face picture;
A6) when the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
A7) if the currently identified face is authorized, judging whether the face positioning is in an authorized area and is in a normal state; if the current recognized face is not authorized, returning to the step A4;
A8) when the human face is positioned in the authorization area and is in a normal state, entering the step A9; when the face location is not in the authorized area or in an abnormal state, returning to the step A4;
A9) based on the current authorized face, determining a corresponding wireless control signal by adopting an automatic matching processing algorithm, and transmitting the corresponding wireless control signal to an actuator through a wireless control circuit;
A10) return to step a 4.
Preferably, the step 6 is further provided with an SRCNNs processing step, wherein:
a6.1) when the picture detection is normal and/or the face detection is normal, judging whether the resolution of the picture is normal or not; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
a6.2) when the resolution of the picture is normal, judging whether the currently recognized face is the face of an authorized user; and when the resolution of the picture is abnormal, processing by adopting SRCNNs and then judging whether the currently recognized face is the face of the authorized user.
Preferably, the step 2 comprises the following operations:
a2.1) setting an authorization area based on a shooting area of the image acquisition circuit;
a2.2) obtaining the face information of the user through an image acquisition circuit by using a face recognition algorithm, and determining the face of the authorized user through a face training algorithm.
Preferably, the step 3 comprises the following operations:
a3.1) matching the signal sent by the wireless control circuit into a wireless control signal which can be identified by the actuator;
a3.2) establishing a signal control table based on the matched wireless control signal and the face information of the authorized user, wherein the signal control table comprises a plurality of groups of recording positions, a matched wireless control signal set and the face of the authorized user.
Preferably, the steps 7 and 8 comprise the following operations: :
a7.1) if the current recognized face is the face of the authorized user, acquiring the contour of the current authorized face; if the current recognized face is not authorized, returning to the step A4;
a7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
a7.3) if the current authorized face is located in the authorized area, judging whether the current authorized face is in a normal state; if the current authorized face is not located in the authorized area, returning to the step A4;
A8) if the current authorized face is in a normal state, the method proceeds to step A9; if the current authorized face is in an abnormal state, returning to the step A4;
preferably, step a7.3 and step A8 include the following operations:
a7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
a7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step A4;
a7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step A4;
A8) if the current authorized face is a real face, then go to step A9; if the current authorized face is a false face, return to step A4.
Preferably, the automatic matching processing algorithm includes the following steps:
a9.1) inquiring in a signal control table based on the current authorized face, and determining a corresponding ith recording position and an ith matched wireless control signal set;
a9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
and A9.3) in a signal control table, updating the original ith authorized face and the original ith matched wireless control signal set corresponding to the original ith recording position to the 1 st authorized face and the 1 st matched wireless control signal set corresponding to the 1 st recording position, and sequentially updating the original 1 st to (i-1) authorized faces and the original 1 st to (i-1) matched wireless control signal sets corresponding to the original 1 st to (i-1) recording positions to the 2 nd to i authorized faces and the 2 nd to i matched wireless control signal sets corresponding to the 2 nd to i recording positions.
Based on the face detection control system, the face detection control system can be widely applied to televisions, air conditioners, remote control sound boxes, remote control LEDs and remote control gates, and specifically comprises the following operation steps:
B1) judging whether the equipment is authorized;
B2) when the equipment is not authorized, setting an authorization area based on the shooting area of the image acquisition circuit, acquiring user face information through the image acquisition circuit by using a face recognition algorithm, determining an authorized user face through a face training algorithm, and returning to the step B1 after authorization; when the device has been authorized, determining whether wireless control is set;
B3) when the wireless control is not set, matching a signal sent by a wireless control circuit into a wireless control signal which can be identified by an actuator, wherein the actuator comprises one or more of a television, an air conditioner, a remote control sound box, a remote control LED or a remote control gate, the wireless control signal comprises an infrared signal, a WiFi signal, a BT signal, a Z-WAVE signal, a radio frequency (433M) signal or a ZigBee signal, establishing a signal control table based on the matched wireless control signal and face information of an authorized user, the signal control table comprises a plurality of groups of recording positions, matched wireless control signal sets and faces of the authorized user, and returning to the step B2 after setting; when the wireless control has been set, go to step B4;
B4) acquiring a face photo of a current user through an image acquisition circuit;
B5) judging whether the picture or the face detection is normal or not based on the collected face picture;
B6) when the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step B4;
b7.1) if the currently recognized face is the face of the authorized user, acquiring the contour of the currently authorized face; if the current recognized face is not authorized, returning to the step B4;
b7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
b7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
b7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step B4;
b7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step B4;
B8) if the current authorized face is a real face, then go to step B9; if the current authorized face is a false face, return is made to step B4.
B9.1) inquiring in a signal control table based on the current authorized face, and determining a corresponding ith recording position and an ith matched wireless control signal set;
b9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
b9.3) in a signal control table, updating an original ith authorized face and an original ith matched wireless control signal set corresponding to an original ith recording position to a1 st authorized face and a1 st matched wireless control signal set corresponding to a1 st recording position, and sequentially updating original 1 st to (i-1) authorized faces and original 1 st to (i-1) matched wireless control signal sets corresponding to original 1 st to (i-1) recording positions to 2 nd to i th authorized faces and 2 nd to i th matched wireless control signal sets corresponding to 2 nd to i th recording positions;
B10) return to step B4.
The face detection control system provided by the invention has the following beneficial effects:
(1) compare with current interactive mode, directly control based on the face profile, reduction interactive cost that can be very big through the face characteristic, provides corresponding service, is applicable to special crowds' such as old person, children, physical disabilities simple demand, possesses higher security moreover, for example: the face information of the child user is collected and directly matched with the corresponding television program, the air conditioner temperature and the like, and a gate, an LED and the like can be directly opened.
(2) Compared with the existing face recognition system, the system has the advantages that the algorithm considers factors such as the direction, the distance and the like of the detected face, misoperation can be effectively avoided, and the accuracy of operation is improved, for example: the situation that the user turns on the television when passing by the television, and the situation that the user turns off the television actively after leaving the television is avoided.
(3) The system is configured with an SRCNNs processing technology, a face state judgment algorithm, an automatic matching processing algorithm and the like, can greatly improve the control efficiency, quickly locks corresponding control parameters based on the facial features of the user, completes personalized service matching, and meets the practical application of different occasions.
Drawings
FIG. 1 is a first structural diagram of an internal circuit according to the present invention;
FIG. 2 is a second schematic diagram of an internal circuit according to the present invention;
FIG. 3 is a schematic front view of a first external structure according to the present invention;
FIG. 4 is a schematic rear view of a first external structure according to the present invention;
FIG. 5 is a schematic view of the backside of a first partial structure according to the present invention;
FIG. 6 is a schematic backside view of a second structure according to the present invention;
FIG. 7 is a schematic front view of a third structure according to the present invention;
FIG. 8 is a front view of a fourth embodiment of the present invention;
FIG. 9 is a schematic front view of a fifth embodiment of the present invention;
FIG. 10 is a first system control flow diagram of the present invention;
FIG. 11 is a control flow chart of a second system according to the present invention;
FIG. 12 is a schematic diagram illustrating an authorization process of the device according to the present invention;
FIG. 13 is a schematic diagram illustrating a wireless control signal setting process according to the present invention;
FIG. 14 is a schematic view of a process for determining a face state according to the present invention;
FIG. 15 is a diagram illustrating a specific operation of the face state determination according to the present invention;
FIG. 16 is a schematic diagram of an automatic matching algorithm according to the present invention;
FIG. 17 is a schematic diagram of a signal control table according to the present invention;
FIG. 18 is a diagram illustrating the updating of a signal control table according to the present invention.
In the figure, 1-shell, 101-camera, 102-elbow, 103-wireless transceiver, 104-indicating device, 105-interface, 2-connector, 3-seat and 4-adhesive body.
Detailed Description
In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present invention. The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless otherwise specified.
The invention will be further explained with reference to the accompanying drawings in which:
example one
As shown in fig. 1, the face detection control system includes a processor, and an image acquisition circuit, a communication circuit, a wireless control circuit, a power circuit, an indication circuit and a storage circuit, which are respectively connected to the processor, wherein the image acquisition circuit is used for acquiring a face picture of a user and includes a CCD or CMOS camera; the communication circuit is used for connecting an upper computer and finishing data setting of the processor, and adopts a wireless mode or a wired mode, wherein the wireless mode comprises WIFI, wireless HDMI, a 4G mobile communication network and a 5G mobile communication network, or the wired mode comprises a USB, CSI, RJ45, MIPI or DVP interface; the wireless control circuit is used for transmitting wireless control signals to the actuator, and the wireless control signals comprise WIFI signals, ZigBee signals, infrared signals or Sub-1GHz signals; the power supply circuit is used for supplying power to a system and generally adopts a +5V power adapter; the indicating circuit is used for feeding back the working state of the processor to a user and comprises an LED, a buzzer or a display; the storage circuit is used for storing face data of authorized users, a wireless control signal set and control data, the control data comprises algorithm parameters, initialization parameters and the like, and each face of the authorized user has a corresponding wireless control signal set; the processor processes and judges the face picture acquired by the image acquisition circuit and sends a corresponding wireless control signal set to the actuator through the wireless control circuit based on the face of an authorized user.
When the remote control device works specifically, the storage circuit prestores a signal control table which comprises a plurality of groups of corresponding authorized user faces and wireless control signals, and when the faces collected by the image collection circuit are the authorized user faces, the processor determines the corresponding wireless control signals through table lookup and sends the wireless control signals to the actuator through the wireless control signals to complete remote control. It should be noted that, the processor is internally configured with a face training module and a face recognition module, and the modules may adopt the prior art or open source programs. It should be noted that the corresponding wireless control signal may also be acquired by using a field learning method.
Example two
In fig. 2, the face detection control system can directly use a raspberry pi 4 integrated board, a BCM2711 type processor and a WIFI module are configured on the integrated board, the BCM2711 type processor is connected with a acrobatic C920 camera through a USB, is connected with a color LED through a GPIO, and is connected with a YIRX02 type infrared control circuit through a UART, in the embodiment, an infrared mode is adopted to complete remote control of an actuator, and the circuit has infrared learning ability.
During specific work, the color LED emits red light to represent collected data, the color LED emits yellow light to represent training data, and the green light represents normal operation of the system. The red flick of 3 times/second represents the acquisition data, and the red flick of 1 time/second represents the completion of the acquisition data. The yellow light flickers 3 times/time to represent the training data, and the flickers 1 time/second to represent the training data is completed.
It should be noted that the circuit structure shown in the first to second embodiments is only a schematic structure, and the system can also be integrated with an existing circuit, for example, in combination with an existing remote controller to design a related circuit.
EXAMPLE III
As shown in fig. 3 and 4, the external structure of the system includes a housing 1, a connecting member 2 and a base 3, in the figure, the housing 1 is arranged on the base 3 as a mounting main body through the connecting member 2, in this embodiment, the connecting member 2 is a ball joint, and the base 3 includes a base. The front surface of the shell 1 is provided with a camera 101, the back surface of the shell 1 is provided with a bent pipe 102, the tail end of the bent pipe 102 is provided with a wireless transceiving head 103, the camera 101 is connected with a processor through an internal circuit of the shell 1, and the wireless transceiving head 103 is connected with the processor through an internal circuit of the shell 1; the front surface of the housing 1 is further provided with an indicating device 104, and the back surface of the housing 1 is further provided with an interface 105, in this embodiment, the indicating device 104 is a color LED.
It should be noted that, the whole body of the housing 1 is shaped like a water drop, which is simple and beautiful, the housing 1 can flexibly rotate to adjust the shooting angle of the camera 101 through a ball joint, meanwhile, the angle of the wireless transceiving head 103 is adjusted through the bent pipe 102 on the back, the bent pipe 102 can be a metal multi-joint pipe, which has a certain supporting force, and the two ends are connected through threads, as shown in fig. 5.
Example four
As shown in fig. 6, on the basis of the third embodiment, a sound box 104 is further disposed on the back surface of the housing 1, and the sound box 104 may work in cooperation with the color LEDs, or may replace the color LEDs.
EXAMPLE five
As shown in fig. 7, on the basis of the third embodiment, an adhesive body 4 is arranged at the bottom of the seat body 3, and the adhesive body 4 includes a magnet, a nylon button or a double-sided tape. The design can be reliably fixed on a tea table or a television cabinet.
EXAMPLE six
As shown in fig. 8, the seat body 3 is a clamping seat, and can be conveniently clamped in the existing cabinet body, bedside and the like by adopting the clamping seat for fixation.
EXAMPLE seven
As shown in fig. 9, the connecting member 2 is a universal pipe or a universal joint pipe, and the universal pipe or the universal joint pipe is used to replace a ball joint, so that the angle can be adjusted more conveniently in individual scenes.
It should be noted that the structure shown in the third to seventh embodiments is only one schematic structure, and the system may also have other structures, for example, the camera 101 and the wireless transceiver 103 are directly mounted on the existing remote controller in combination with the existing remote controller.
Example eight
As shown in fig. 10, the face detection control system includes the following control flows:
A1) judging whether the equipment is authorized;
A2) when the device has been authorized, determining whether wireless control is set; when the device is not authorized, the device is authorized, and the step A1 is returned after the device is authorized;
specifically, the face information of the user, the authorization area and other information are collected and stored through an equipment authorization link.
A3) When the wireless control has been set, go to step a 4; when the wireless control is not set, setting the wireless control, and returning to the step A1 after setting;
specifically, a wireless signal library matched with the actuator is stored through a wireless control link, or signals which can be approved by the matched actuator can be learned on site.
A4) Acquiring a face photo of a current user through an image acquisition circuit;
specifically, the system can set up an acquisition cycle, regularly gathers the people's face photo that gets into the shooting region, and the face detection or the human shape detection algorithm all adopt current algorithm in this embodiment, for example: the face recognition algorithm can use openface framework or openCV own facerecognizers for face training and recognition.
A5) Judging whether the picture or the face detection is normal or not based on the collected face picture;
specifically, whether the light, the angle and the like are normal or not is judged, and if not, the light, the angle and the like are fed back through the indicating circuit. The frame detection algorithm may adopt a background subtraction algorithm or other existing algorithms.
A6) When the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
A7) if the currently identified face is authorized, judging whether the face positioning is in an authorized area and is in a normal state; if the current recognized face is not authorized, returning to the step A4;
A8) when the human face is positioned in the authorization area and is in a normal state, entering the step A9; when the face location is not in the authorized area or in an abnormal state, returning to the step A4;
A9) based on the current authorized face, determining a corresponding wireless control signal by adopting an automatic matching processing algorithm, and transmitting the corresponding wireless control signal to an actuator through a wireless control circuit;
A10) return to step a 4.
Example nine
As shown in fig. 11, according to the eighth embodiment, an SRCNNs processing step is further provided in step 6, wherein:
a6.1) when the picture detection is normal and/or the face detection is normal, judging whether the resolution of the picture is normal or not; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
a6.2) when the resolution of the picture is normal, judging whether the currently recognized face is the face of an authorized user; and when the resolution of the picture is abnormal, processing by adopting SRCNNs and then judging whether the currently recognized face is the face of the authorized user.
The SRCNNs are Super Resolution technologies (Super Resolution connected neural Networks), and can reduce a low-Resolution picture to a high-Resolution picture or change the high-Resolution picture to an ultra-high Resolution picture. It should be further explained that the processing of SRCNNs is an optional function, and in the application of the actual algorithm, it needs to be determined whether the processing of SRCNNs is needed.
Example ten
As shown in fig. 12, the device authorization includes the following operational details:
a2.1) setting an authorization area based on a shooting area of the image acquisition circuit;
specifically, the authorization area may be performed by an upper computer, for example: the method comprises the steps that a browser inputs ip or a domain name of a remote control base body or scans a two-dimensional code on a shell, an authorization area is selected to be set, the browser sees a picture collected by an image collecting circuit, a rectangular frame appearing in the picture is clicked to represent the authorization area, the rectangular frame is dragged to adjust the size and the position, and the middle area of the shot picture is selected as the authorization area under the general condition, so that a user can be ensured to enter the middle area of the picture.
A2.2) obtaining the face information of the user through an image acquisition circuit by using a face recognition algorithm, and determining the face of the authorized user through a face training algorithm.
Specifically, the storage of the user information is completed in the system by this step.
EXAMPLE eleven
As shown in fig. 13, the wireless control signal setting includes the following specific operations:
a3.1) matching the signal sent by the wireless control circuit into a wireless control signal which can be identified by the actuator;
specifically, the common remote signals can be prestored in a database, and if the common remote signals are abnormal signals, the wireless control signals can be stored in a field learning mode.
A3.2) based on the matched wireless control signal and the face information of the authorized user, a signal control table is established, and the signal control table comprises a plurality of groups of recording positions, a matched wireless control signal set and the face of the authorized user.
The radio control signal set refers to a set of a plurality of basic radio control signals, for example: the 1 st record position corresponds 1 st authorized face and the 1 st matched wireless control signal set, and the 1 st authorized face is user A, and user A's recent interest of watching lies in the english channel, and at this moment, the 1 st matched wireless control signal set is a plurality of basic wireless control signals that open the english channel, if: power on-channel 13-sound 15, etc. The wireless control signal set can be pre-stored in advance through the upper computer, and machine learning can be carried out based on user habits.
Example twelve
As shown in fig. 14, when determining whether the face location is in the authorized area and is in a normal state, the following operations are adopted: :
a7.1) if the current recognized face is the face of the authorized user, acquiring the contour of the current authorized face; if the current recognized face is not authorized, returning to the step A4;
a7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
a7.3) if the current authorized face is located in the authorized area, judging whether the current authorized face is in a normal state; if the current authorized face is not located in the authorized area, returning to the step A4;
specifically, the normal state is mainly determined based on the face width contour, so that the face contour is prevented from being too large or too small.
A8) If the current authorized face is in a normal state, the method proceeds to step A9; if the current authorized face is in an abnormal state, the method returns to the step A4.
EXAMPLE thirteen
As shown in fig. 15, when determining whether the face is in a normal state, the following operations are included:
a7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
specifically, the size of the face is determined according to the width or length of the face, the minimum value and the maximum value of the face width are stored in the face training data set, and the face training data set is in a normal state when the detected face size is between the minimum value and the maximum value. In practical application, the change coefficient r can be multiplied on the most value data, and the position change of the camera and the like can be flexibly adapted by adjusting the numerical value of the change coefficient r.
A7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step A4;
specifically, the distance or approach judgment is based on the size change of the detected face in the front and rear states, and when the size of the detected face is continuously increased, the judgment is that the detected face is close to the authorization area, and when the size of the detected face is continuously decreased, the judgment is that the detected face is far from the authorization area.
A7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step A4;
A8) if the current authorized face is a real face, then go to step A9; if the current authorized face is a false face, return to step A4.
Specifically, the real face detection may adopt an existing algorithm. It should be noted that, the existing algorithms include texturaanalysis, Frequency analysis, Variable focusing analysis, Heuristic-basedalgorithms, Optical Flow algorithms, 3D face shape, etc., and one or more combinations of the above algorithms can solve general false face technologies, such as false faces like pictures or photos. Some products may also use binarylasisition deep learning techniques to solve the problem of blending with real video.
EXAMPLE thirteen
As shown in fig. 16, the automatic matching processing algorithm includes the following steps:
a9.1) based on the current authorized face, inquiring in the signal control table, and determining the corresponding ith record position and the ith matched wireless control signal set, as shown in FIG. 17.
A9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
and A9.3) updating the original ith authorized face and the original ith matched wireless control signal set corresponding to the original ith recording position to a1 st authorized face and a1 st matched wireless control signal set corresponding to the 1 st recording position, and sequentially updating the original 1 st to (i-1) authorized faces and the original 1 st to (i-1) matched wireless control signal sets corresponding to the original 1 st to (i-1) recording positions to a2 nd to i th authorized faces and a2 nd to i th matched wireless control signal sets corresponding to the 2 nd to i recording positions, as shown in FIG. 18.
It should be noted that the above-mentioned update algorithm is to ensure that the data in the system is synchronized with the data in the executor, for example: when the television is remotely controlled, historical data in the television can be automatically updated after channel switching, the selected channel information is updated to the first position, and other position information is adaptively moved down.
Example fourteen
The face detection control system can be widely applied to intelligent remote control televisions, remote control air conditioners, remote control sound boxes, remote control LEDs or remote control gates, and specifically comprises the following operation steps:
B1) judging whether the equipment is authorized;
B2) when the equipment is not authorized, setting an authorization area based on the shooting area of the image acquisition circuit, acquiring user face information through the image acquisition circuit by using a face recognition algorithm, determining an authorized user face through a face training algorithm, and returning to the step B1 after authorization; when the device has been authorized, determining whether wireless control is set;
B3) when the wireless control is not set, matching a signal sent by a wireless control circuit into a wireless control signal which can be identified by an actuator, wherein the actuator comprises one or more of a television, an air conditioner, a remote control sound box, a remote control LED or a remote control gate, the wireless control signal comprises an infrared signal, a WiFi signal, a BT signal, a Z-WAVE signal, a radio frequency (433M) signal or a ZigBee signal, establishing a signal control table based on the matched wireless control signal and face information of an authorized user, the signal control table comprises a plurality of groups of recording positions, matched wireless control signal sets and the face of the authorized user, and returning to the step B2 after setting; when the wireless control has been set, go to step B4;
B4) acquiring a face photo of a current user through an image acquisition circuit;
B5) judging whether the picture or the face detection is normal or not based on the collected face picture;
B6) when the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step B4;
b7.1) if the currently recognized face is the face of the authorized user, acquiring the contour of the currently authorized face; if the current recognized face is not authorized, returning to the step B4;
b7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
b7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
b7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step B4;
b7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step B4;
B8) if the current authorized face is a real face, then go to step B9; if the current authorized face is a false face, return is made to step B4.
B9.1) inquiring in a signal control table based on the current authorized face, and determining a corresponding ith recording position and an ith matched wireless control signal set;
b9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
b9.3) in a signal control table, updating an original ith authorized face and an original ith matched wireless control signal set corresponding to an original ith recording position to a1 st authorized face and a1 st matched wireless control signal set corresponding to a1 st recording position, and sequentially updating original 1 st to (i-1) authorized faces and original 1 st to (i-1) matched wireless control signal sets corresponding to original 1 st to (i-1) recording positions to 2 nd to i th authorized faces and 2 nd to i th matched wireless control signal sets corresponding to 2 nd to i th recording positions;
B10) return to step B4.
It should be noted that the actuator includes, but is not limited to, one or more of a television, an air conditioner, a remote speaker, a remote LED, or a remote gate, and can be extended to other devices that can use remote control.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. The utility model provides a face detection control system which characterized in that, including the treater and with image acquisition circuit, communication circuit, wireless control circuit, power supply circuit, indicating circuit and the memory circuit that the treater is connected respectively, wherein:
the image acquisition circuit is used for acquiring a face photo of a user; the communication circuit is used for connecting an upper computer and finishing data setting of the processor; the wireless control circuit is used for transmitting a wireless control signal to the actuator; the power supply circuit is used for supplying power to the system; the indicating circuit is used for feeding back the working state of the processor to a user; the storage circuit is used for storing face data, a wireless control signal set and control data of authorized users, and each face of the authorized users has a corresponding wireless control signal set; the processor processes and judges the face picture acquired by the image acquisition circuit and sends a corresponding wireless control signal set to the actuator through the wireless control circuit based on the face of the authorized user.
2. The face detection control system according to claim 1, further comprising a housing (1), a connector (2), and a base (3), wherein:
the shell (1) is used as an installation main body and is arranged on a seat body (3) through a connecting piece (2), the connecting piece (2) comprises a ball joint, a universal pipe or a universal pipe, and the seat body (3) comprises a base or a clamping seat;
the front surface of the shell (1) is provided with a camera (101), the back surface of the shell (1) is provided with a bent pipe (102), the tail end of the bent pipe (102) is provided with a wireless transceiving head (103), the camera (101) is connected with a processor through an internal circuit of the shell (1), and the wireless transceiving head (103) is connected with the processor through an internal circuit of the shell (1);
the shell (1) is further provided with an indicating device (104) and an interface (105), wherein the indicating device (104) comprises an LED and/or a sound box.
3. The face detection control system according to claim 2, further comprising an adhesive body (4) disposed at the bottom of the seat body (3), wherein the adhesive body (4) comprises a magnet, a nylon button or a double-sided tape.
4. The face detection control system according to claim 1, comprising the following control flow:
A1) judging whether the equipment is authorized;
A2) when the device has been authorized, determining whether wireless control is set; when the device is not authorized, the device is authorized, and the step A1 is returned after the device is authorized;
A3) when the wireless control has been set, go to step a 4; when the wireless control is not set, setting the wireless control, and returning to the step A1 after setting;
A4) acquiring a face photo of a current user through an image acquisition circuit;
A5) judging whether the picture or the face detection is normal or not based on the collected face picture;
A6) when the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
A7) if the currently identified face is authorized, judging whether the face positioning is in an authorized area and is in a normal state; if the current recognized face is not authorized, returning to the step A4;
A8) when the human face is positioned in the authorization area and is in a normal state, entering the step A9; when the face location is not in the authorized area or in an abnormal state, returning to the step A4;
A9) based on the current authorized face, determining a corresponding wireless control signal by adopting an automatic matching processing algorithm, and transmitting the corresponding wireless control signal to an actuator through a wireless control circuit;
A10) return to step a 4.
5. The face detection control system according to claim 4, wherein the step 6 is further provided with an SRCNNs processing step, wherein:
a6.1) when the picture detection is normal and/or the face detection is normal, judging whether the resolution of the picture is normal or not; when the picture detection is abnormal and the face detection is abnormal, returning to the step A4;
a6.2) when the resolution of the picture is normal, judging whether the currently recognized face is the face of an authorized user; and when the resolution of the picture is abnormal, processing by adopting SRCNNs and then judging whether the currently recognized face is the face of the authorized user.
6. The face detection control system according to claim 4,
the step 2 comprises the following operations:
a2.1) setting an authorization area based on a shooting area of the image acquisition circuit;
a2.2) obtaining user face information through an image acquisition circuit by using a face recognition algorithm, and determining an authorized user face through a face training algorithm;
the step 3 comprises the following operations:
a3.1) matching the signal sent by the wireless control circuit into a wireless control signal which can be identified by the actuator;
a3.2) establishing a signal control table based on the matched wireless control signal and the face information of the authorized user, wherein the signal control table comprises a plurality of groups of recording positions, a matched wireless control signal set and the face of the authorized user.
7. The face detection control system according to claim 4, wherein the steps 7 and 8 comprise the following operations: :
a7.1) if the current recognized face is the face of the authorized user, acquiring the contour of the current authorized face; if the current recognized face is not authorized, returning to the step A4;
a7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
a7.3) if the current authorized face is located in the authorized area, judging whether the current authorized face is in a normal state; if the current authorized face is not located in the authorized area, returning to the step A4;
A8) if the current authorized face is in a normal state, the method proceeds to step A9; if the current authorized face is in an abnormal state, the method returns to the step A4.
8. The face detection control system of claim 7, wherein the steps A7.3 and A8 comprise the following operations:
a7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
a7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step A4;
a7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step A4;
A8) if the current authorized face is a real face, then go to step A9; if the current authorized face is a false face, return to step A4.
9. The face detection control system of claim 4, wherein the automatic matching processing algorithm comprises the steps of:
a9.1) inquiring in a signal control table based on the current authorized face, and determining a corresponding ith recording position and an ith matched wireless control signal set;
a9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
and A9.3) in a signal control table, updating the original ith authorized face and the original ith matched wireless control signal set corresponding to the original ith recording position to the 1 st authorized face and the 1 st matched wireless control signal set corresponding to the 1 st recording position, and sequentially updating the original 1 st to (i-1) authorized faces and the original 1 st to (i-1) matched wireless control signal sets corresponding to the original 1 st to (i-1) recording positions to the 2 nd to i authorized faces and the 2 nd to i matched wireless control signal sets corresponding to the 2 nd to i recording positions.
10. Use of the face detection control system according to any of claims 1 to 9, characterized in that it comprises the following operative steps:
B1) judging whether the equipment is authorized;
B2) when the equipment is not authorized, setting an authorization area based on the shooting area of the image acquisition circuit, acquiring user face information through the image acquisition circuit by using a face recognition algorithm, determining an authorized user face through a face training algorithm, and returning to the step B1 after authorization; when the device has been authorized, determining whether wireless control is set;
B3) when the wireless control is not set, matching a signal sent by a wireless control circuit into a wireless control signal which can be identified by an actuator, wherein the actuator comprises one or more of a television, an air conditioner, a remote control sound box, a remote control LED or a remote control gate, the wireless control signal comprises an infrared signal, a WiFi signal, a BT signal, a Z-WAVE signal, a radio frequency (433M) signal or a ZigBee signal, establishing a signal control table based on the matched wireless control signal and face information of an authorized user, the signal control table comprises a plurality of groups of recording positions, matched wireless control signal sets and faces of the authorized user, and returning to the step B2 after setting; when the wireless control has been set, go to step B4;
B4) acquiring a face photo of a current user through an image acquisition circuit;
B5) judging whether the picture or the face detection is normal or not based on the collected face picture;
B6) when the picture detection is normal and/or the face detection is normal, judging whether the face currently identified is the face of an authorized user; when the picture detection is abnormal and the face detection is abnormal, returning to the step B4;
b7.1) if the currently recognized face is the face of the authorized user, acquiring the contour of the currently authorized face; if the current recognized face is not authorized, returning to the step B4;
b7.2) obtaining the contour of the authorization area and judging whether the current authorization face is positioned in the authorization area;
b7.3.1) if the current authorized face is located in the authorized area, judging whether the size of the current authorized face is normal data;
b7.3.2) if the size of the current authorized face is normal data, judging whether the current authorized face is far away from the authorization area or close to the authorization area; if the size of the current authorized face is not normal data, returning to the step B4;
b7.3.3) if the current authorized face is close to the authorized area, judging whether the current authorized face is a real face; if the current authorized face is far away from the authorized area, returning to the step B4;
B8) if the current authorized face is a real face, then go to step B9; if the current authorized face is a false face, returning to the step B4;
b9.1) inquiring in a signal control table based on the current authorized face, and determining a corresponding ith recording position and an ith matched wireless control signal set;
b9.2) transmitting the ith matched wireless control signal set to the actuator through a wireless control circuit;
b9.3) in a signal control table, updating an original ith authorized face and an original ith matched wireless control signal set corresponding to an original ith recording position to a1 st authorized face and a1 st matched wireless control signal set corresponding to a1 st recording position, and sequentially updating original 1 st to (i-1) authorized faces and original 1 st to (i-1) matched wireless control signal sets corresponding to original 1 st to (i-1) recording positions to 2 nd to i th authorized faces and 2 nd to i th matched wireless control signal sets corresponding to 2 nd to i th recording positions;
B10) return to step B4.
CN202010195305.8A 2020-03-19 2020-03-19 Face detection control system and application thereof Pending CN111179569A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010195305.8A CN111179569A (en) 2020-03-19 2020-03-19 Face detection control system and application thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010195305.8A CN111179569A (en) 2020-03-19 2020-03-19 Face detection control system and application thereof

Publications (1)

Publication Number Publication Date
CN111179569A true CN111179569A (en) 2020-05-19

Family

ID=70653360

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010195305.8A Pending CN111179569A (en) 2020-03-19 2020-03-19 Face detection control system and application thereof

Country Status (1)

Country Link
CN (1) CN111179569A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090138805A1 (en) * 2007-11-21 2009-05-28 Gesturetek, Inc. Media preferences
CN102595075A (en) * 2011-01-17 2012-07-18 康佳集团股份有限公司 Television device and channel control method thereof
CN105867151A (en) * 2016-04-21 2016-08-17 湖南中迪科技有限公司 Intelligent face recognition household door system and working method
CN107371042A (en) * 2017-08-31 2017-11-21 深圳创维-Rgb电子有限公司 Advertisement placement method, device, equipment and storage medium
CN108875473A (en) * 2017-06-29 2018-11-23 北京旷视科技有限公司 Living body verification method, device and system and storage medium
CN211149655U (en) * 2020-03-19 2020-07-31 许扬杰 Face detection control system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090138805A1 (en) * 2007-11-21 2009-05-28 Gesturetek, Inc. Media preferences
CN102595075A (en) * 2011-01-17 2012-07-18 康佳集团股份有限公司 Television device and channel control method thereof
CN105867151A (en) * 2016-04-21 2016-08-17 湖南中迪科技有限公司 Intelligent face recognition household door system and working method
CN108875473A (en) * 2017-06-29 2018-11-23 北京旷视科技有限公司 Living body verification method, device and system and storage medium
CN107371042A (en) * 2017-08-31 2017-11-21 深圳创维-Rgb电子有限公司 Advertisement placement method, device, equipment and storage medium
CN211149655U (en) * 2020-03-19 2020-07-31 许扬杰 Face detection control system

Similar Documents

Publication Publication Date Title
CN105116859B (en) A kind of intelligent domestic system realized using unmanned vehicle and method
CN205310273U (en) Portable video nurse robot
WO2002015560A9 (en) A system and method for capturing an image
CN205490994U (en) Multi -functional intelligent sound box
CN110266941A (en) A kind of panorama shooting method and terminal device
CN108235128A (en) A kind of method and system of infrared induction control video screen dispaly state
CN105867151A (en) Intelligent face recognition household door system and working method
CN110811564A (en) Intelligent face image and tongue image acquisition terminal system and face image and tongue image acquisition method
CN102509369A (en) Embedded intelligent entrance guard system
CN105955051A (en) Intelligent household equipment control method and apparatus
CN211149655U (en) Face detection control system
CN107277344B (en) Image acquisition system and method and refrigerator
CN108986405A (en) A kind of multi parameters control method based on Zigbee gateway
CN106440200A (en) Control method and device of air conditioner and control method and device of terminal equipment
CN111314619B (en) Shooting angle control method, terminal and storage medium
CN111179569A (en) Face detection control system and application thereof
CN109610584A (en) A kind of intellectual water closet and its intelligent adjusting method with face identification functions
CN110177301A (en) A kind of TV and its method actively limiting viewing distance protection eyesight
CN208174858U (en) A kind of Intelligent doorbell device
CN104349112B (en) Video conference device and its method
CN106899796A (en) Camera system and method
CN100352400C (en) Portable iris image acquiring device
CN116129526A (en) Method and device for controlling photographing, electronic equipment and storage medium
CN110889913B (en) Intelligent door lock with face recognition function and face input method thereof
CN109727346A (en) Directly locking the networking door-locking system and testimony of a witness comparison method for realizing that the testimony of a witness compares

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination