CN104333686A - Intelligent monitoring camera based on face and voiceprint recognition and control method of intelligent monitoring camera - Google Patents

Intelligent monitoring camera based on face and voiceprint recognition and control method of intelligent monitoring camera Download PDF

Info

Publication number
CN104333686A
CN104333686A CN201410694949.6A CN201410694949A CN104333686A CN 104333686 A CN104333686 A CN 104333686A CN 201410694949 A CN201410694949 A CN 201410694949A CN 104333686 A CN104333686 A CN 104333686A
Authority
CN
China
Prior art keywords
monitoring camera
intelligent monitoring
face
cpu
cpu board
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410694949.6A
Other languages
Chinese (zh)
Other versions
CN104333686B (en
Inventor
戴林
陆翔云
付邦鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin Tiandy Digital Technology Co Ltd
Original Assignee
Tianjin Tiandy Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin Tiandy Digital Technology Co Ltd filed Critical Tianjin Tiandy Digital Technology Co Ltd
Priority to CN201410694949.6A priority Critical patent/CN104333686B/en
Publication of CN104333686A publication Critical patent/CN104333686A/en
Application granted granted Critical
Publication of CN104333686B publication Critical patent/CN104333686B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses an intelligent monitoring camera based on face and voiceprint recognition and a control method of the intelligent monitoring camera. The intelligent monitoring camera belongs to an audio-video monitoring module. After images and voices are collected by virtue of the front end of the intelligent monitoring camera, voiceprints in face and voice information in the images are recognized by virtue of an intelligent algorithm and are compared with pre-stored information, and the identity of people is judged; identity information of people and monitored audios and videos are superposed and stored in real time and can be sent to the rear end of the intelligent monitoring camera through a network; meanwhile, an alerting signal is emitted according to a preset logic. According to the intelligent monitoring camera and the control method, the identity of people in a monitored region can be accurately analyzed by virtue of the intelligent analysis and the recognition of the images and the voices, and the information is transmitted to the rear end of the intelligent monitoring camera; meanwhile, the dual recognition on the faces and the voiceprints are supplemented with each other, so that the recognition accuracy is greatly improved.

Description

Based on Intelligent monitoring camera and the control method thereof of face and Application on Voiceprint Recognition
Technical field
The present invention relates to audio-video monitoring field, particularly a kind of Intelligent monitoring camera based on face and Application on Voiceprint Recognition and control method thereof.
Background technology
Along with the development of information technology and intelligent algorithm, every profession and trade is more and more higher for the intelligent requirements of product, and various voice recognition and image recognition technology are arisen at the historic moment, and is widely used in each field.CCTV camera, as the front-end product of security protection industry, more needs progressively to promote intelligence degree.At present, video monitoring system is a face recognition technology main flow direction in actual applications, monitoring camera-shooting equipment common on market can only do some simple photography functions, and monitor before will accomplishing to be engraved in watch-dog when people is needed to the timely process of emergency case such as stealing in guarded region, only find emergency case by staff, such quality monitoring is low, and in some special occasions, such as in secret monitoring place, and the place not needing stranger to enter just is difficult to accomplish reminding alarm function, and face recognition technology due to error rate high, in use often there is the situation of false alarm.
Summary of the invention
The present invention provides a kind of Intelligent monitoring camera based on face and Application on Voiceprint Recognition and control method thereof in order to solve the problem.
The present invention for addressing this problem taked technical scheme is:
Based on an Intelligent monitoring camera for face and Application on Voiceprint Recognition, comprise the SENSOR(transducer be connected with CPU board) plate, light sensor, sound transducer and control board; And SENSOR plate gathers image and transfers to CPU board, light sensor Real-time Collection environmental light brightness reads for CPU board, sound transducer gathers ambient sound for CPU board Treatment Analysis, control board is controlled by CPU board and controls to drive lamp plate to realize the adjustment of light filling brightness, CPU board by accept and the CPU of process information, the power supply chip of power supply is provided for CPU, storage accepts the memory chip of data, the Ethernet unit of transmission information forms.
Based on an Intelligent monitoring camera control method for face and Application on Voiceprint Recognition, comprise the following steps:
I, start;
II, image and sound is gathered;
III, image ISP(Image Signal Processor, image procossing) process and Noise reduction process;
IV, image intelligent analysis and phonetic analysis;
V, characteristics of image and vocal print aspect ratio pair;
VI, Logic judgment;
VII, meet setting, meet when presetting and enter step VIII, do not meet when presetting and enter step I;
VIII, output alarm signal.
The advantage that the present invention has and good effect are:
The present invention can by the intellectual analysis of image and sound and identification, analyze accurately the piece identity in monitoring field, and by information transmission to rear end.Meanwhile, face and the dual identification of vocal print, the two complements each other, and recognition accuracy is greatly improved.
Accompanying drawing explanation
Fig. 1 is the internal structure block diagram of the Intelligent monitoring camera that the present invention is based on face and Application on Voiceprint Recognition;
Fig. 2 is the control flow chart of the Intelligent monitoring camera control method that the present invention is based on face and Application on Voiceprint Recognition.
Embodiment
Referring to drawings and Examples, the Intelligent monitoring camera based on face and Application on Voiceprint Recognition of the present invention and control method thereof are described in detail.
Fig. 1 is the internal structure block diagram of the Intelligent monitoring camera that the present invention is based on face and Application on Voiceprint Recognition.As shown in Figure 1, a kind of Intelligent monitoring camera based on face and Application on Voiceprint Recognition of the present invention, comprises the SENSOR plate, light sensor, sound transducer and the control board that are connected with CPU board; And SENSOR plate gathers image and transfers to CPU board, light sensor Real-time Collection environmental light brightness reads for CPU board, sound transducer gathers ambient sound for CPU board Treatment Analysis, control board is controlled by CPU board and controls to drive lamp plate to realize the adjustment of light filling brightness, CPU board by accept and the CPU of process information, the power supply chip of power supply is provided for CPU, storage accepts the memory chip of data, the Ethernet unit of transmission information forms.
Described SENSOR plate is 2,000,000 1080P CMOS(Complementary Metal Oxide Semiconductor, complementary metal oxide semiconductors (CMOS)) imageing sensor, three-way power 1V2 needed for SENSOR plate, 1V8, 2V7 is by three groups of LDO(low dropout regulator, low pressure difference linear voltage regulator) provide, the master clock of SENSOR, reset signal and SPI(Image Signal Processor, image procossing) provide by rear end CPU board, CPU is configured SENSOR by SPI mouth, the image collected is by RAWDATA(initial data) mode transfers to rear end CPU board.
Described light sensor Real-time Collection environmental light brightness is also directly changed into digital quantity, and CPU board reads brightness value in real time by iic bus.
Described sound transducer gathers ambient sound, analyzes for rear end CPU board process.
Described control board is the independent constant-current drive circuit controlling infrared LED and white light LEDs, and CPU board can the change of environmentally illumination, is adjusted drive current by PWM mode.
Described CPU board uses the CPU of ARM11 framework, embedded DSP, the power supply of CPU and electrifying timing sequence control to be realized by power management chip, CPU board plate carries 4 2GB DDR3 memory chips altogether, 128MB nand FLASH is used for program and stores, there is TF video recording and data storage cell, there is 100M/1000M self adaptation Ethernet unit.
Fig. 2 is the control flow chart of the Intelligent monitoring camera control method that the present invention is based on face and Application on Voiceprint Recognition.As shown in Figure 2, a kind of Intelligent monitoring camera control method based on face and Application on Voiceprint Recognition, is characterized in that, comprise the following steps:
I, start;
II, image and sound is gathered;
III, image ISP process and Noise reduction process;
IV, image intelligent analysis and phonetic analysis;
V, characteristics of image and vocal print aspect ratio pair;
VI, Logic judgment;
VII, meet setting, meet when presetting and enter step VIII, do not meet when presetting and enter step I;
VIII, output alarm signal.
The audio-video signal that described step II exports is exported by network data and returns step I after audio/video coding.
Described SENSOR plate uses 2,000,000 1080P cmos image sensors.Three-way power 1V2 needed for SENSOR, 1V8,2V7 are provided by three groups of LDO, and the master clock of SENSOR, reset signal and SPI provide by rear end CPU board, CPU is configured SENSOR by SPI mouth, and the image collected transfers to rear end CPU board by RAWDATA mode.
Described CPU board uses the CPU of ARM11 framework, embedded DSP.The power supply of CPU and electrifying timing sequence control to be realized by special chip, guarantee the steady operation of CPU.CPU board plate carries 4 2GB DDR3 memory chips altogether, 128MB nand FLASH(flash memory) store for program, support that TF video recording and data store.Support 100M/1000M self adaptation Ethernet, ensure that HD video implements transmission.
Described control board is the constant-current drive circuit that infrared LED and white light LEDs independently control, CPU can the change of environmentally illumination, by PWM(Pulse Width Modulation, pulse width modulation) mode adjusts drive current, thus the accurate control realized light filling brightness, ensure IMAQ quality.
Described light sensor Real-time Collection environmental light brightness is also directly changed into digital quantity, and CPU can pass through IIC(Inter-Integrated Circuit, integrated circuit (IC) bus) bus reads brightness value in real time.
Described sound transducer gathers ambient sound, analyzes for rear end CPU process.
After front end cmos image sensor and sound transducer gather image and sound, by the intelligent algorithm of CPU, the face in image and the vocal print in acoustic information are identified, carry out contrasting and judging with the information being stored in nand FLASH in advance after identifying, and then judge the identity of personage.The identity information of personage and monitoring audio/video are carried out superposing rear real-time storage, and is sent to rear end by network.Simultaneously according to the logic pre-set, send alarm signal.
The present invention can by the intellectual analysis of image and sound and identification, analyze accurately the piece identity in monitoring field, and by information transmission to rear end.Meanwhile, face and the dual identification of vocal print, the two complements each other, and recognition accuracy is greatly improved.

Claims (8)

1., based on an Intelligent monitoring camera for face and Application on Voiceprint Recognition, comprise the SENSOR plate, light sensor, sound transducer and the control board that are connected with CPU board; It is characterized in that: SENSOR plate gathers image and transfers to CPU board, light sensor Real-time Collection environmental light brightness reads for CPU board, sound transducer gathers ambient sound for CPU board Treatment Analysis, control board is controlled by CPU board and controls to drive lamp plate to realize the adjustment of light filling brightness, CPU board by accept and the CPU of process information, the power supply chip of power supply is provided for CPU, storage accepts the memory chip of data, the Ethernet unit of transmission information forms.
2. the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 1, it is characterized in that: described SENSOR plate is 2,000,000 1080P cmos image sensors, three-way power 1V2 needed for SENSOR plate, 1V8,2V7 is provided by three groups of LDO, the master clock of SENSOR, reset signal and SPI provide by rear end CPU board, and CPU is configured SENSOR by SPI mouth, and the image collected transfers to rear end CPU board by RAWDATA mode.
3. the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 1, is characterized in that: described light sensor Real-time Collection environmental light brightness is also directly changed into digital quantity, and CPU board reads brightness value in real time by iic bus.
4. the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 1, is characterized in that: described sound transducer gathers ambient sound, analyzes for rear end CPU board process.
5. the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 1, it is characterized in that: described control board is the independent constant-current drive circuit controlling infrared LED and white light LEDs, CPU board can the change of environmentally illumination, is adjusted drive current by PWM mode.
6. the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 1, it is characterized in that: described CPU board uses the CPU of ARM11 framework, embedded DSP, the power supply of CPU and electrifying timing sequence control to be realized by power management chip, CPU board plate carries 4 2GB DDR3 memory chips altogether, 128MB nand FLASH is used for program and stores, and has TF video recording and data storage cell, has 100M/1000M self adaptation Ethernet unit.
7., based on an Intelligent monitoring camera control method for face and Application on Voiceprint Recognition, it is characterized in that, comprise the following steps:
I, start;
II, image and sound is gathered;
III, image ISP process and Noise reduction process;
IV, image intelligent analysis and phonetic analysis;
V, characteristics of image and vocal print aspect ratio pair;
VI, Logic judgment;
VII, meet setting, meet when presetting and enter step VIII, do not meet when presetting and enter step I;
VIII, output alarm signal.
8. the Intelligent monitoring camera control method of the Intelligent monitoring camera based on face and Application on Voiceprint Recognition according to claim 7, is characterized in that: the audio-video signal that described step II exports is exported by network data and returns step I after audio/video coding.
CN201410694949.6A 2014-11-27 2014-11-27 Intelligent monitoring camera and its control method based on face and Application on Voiceprint Recognition Active CN104333686B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410694949.6A CN104333686B (en) 2014-11-27 2014-11-27 Intelligent monitoring camera and its control method based on face and Application on Voiceprint Recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410694949.6A CN104333686B (en) 2014-11-27 2014-11-27 Intelligent monitoring camera and its control method based on face and Application on Voiceprint Recognition

Publications (2)

Publication Number Publication Date
CN104333686A true CN104333686A (en) 2015-02-04
CN104333686B CN104333686B (en) 2018-03-27

Family

ID=52408329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410694949.6A Active CN104333686B (en) 2014-11-27 2014-11-27 Intelligent monitoring camera and its control method based on face and Application on Voiceprint Recognition

Country Status (1)

Country Link
CN (1) CN104333686B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127156A (en) * 2016-06-27 2016-11-16 上海元趣信息技术有限公司 Robot interactive method based on vocal print and recognition of face
CN108965716A (en) * 2018-08-01 2018-12-07 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN108986153A (en) * 2018-08-01 2018-12-11 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN109064503A (en) * 2018-08-01 2018-12-21 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN109346085A (en) * 2018-10-29 2019-02-15 合肥赛为智能有限公司 A kind of prison supervising platform based on Application on Voiceprint Recognition
CN109670451A (en) * 2018-12-20 2019-04-23 天津天地伟业信息系统集成有限公司 Automatic face recognition tracking
CN110191556A (en) * 2019-05-28 2019-08-30 佛山市田昌灯饰有限公司 It is a kind of can voice control Intelligent lightening device and control method
US10929988B2 (en) 2018-08-01 2021-02-23 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for processing image, and electronic device
CN112689125A (en) * 2020-12-18 2021-04-20 中标慧安信息技术股份有限公司 Multi-terminal safety monitoring method and system based on Internet of things

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175382B1 (en) * 1997-11-24 2001-01-16 Shell Oil Company Unmanned fueling facility
CN1428694A (en) * 2001-12-29 2003-07-09 成都银晨网讯科技有限公司 Embedded human face automatic detection equipment based on DSP and its method
CN101075868A (en) * 2006-05-19 2007-11-21 华为技术有限公司 Long-distance identity-certifying system, terminal, servo and method
CN101501564A (en) * 2006-08-03 2009-08-05 国际商业机器公司 Video surveillance system and method with combined video and audio recognition
CN102572372A (en) * 2011-12-28 2012-07-11 中兴通讯股份有限公司 Extraction method and device for conference summary
CN202720703U (en) * 2012-07-26 2013-02-06 南京工程学院 Face recognition lock of infrared sensing and automatic light supplement
CN102968991A (en) * 2012-11-29 2013-03-13 华为技术有限公司 Method, device and system for sorting voice conference minutes
CN103218763A (en) * 2013-03-26 2013-07-24 陈秀成 Remote on-line interviewing method and system with high reliability
CN103310339A (en) * 2012-03-15 2013-09-18 凹凸电子(武汉)有限公司 Identity recognition device and method as well as payment system and method
CN103473931A (en) * 2013-07-08 2013-12-25 姜廷顺 System and method for rapid identity confirmation of road-traffic-accident escape vehicle
CN203554767U (en) * 2013-11-18 2014-04-16 谢建波 Dual-light source fill light
CN104023208A (en) * 2014-06-05 2014-09-03 北京小鱼儿科技有限公司 Device and method of automatic monitoring and autonomic response

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175382B1 (en) * 1997-11-24 2001-01-16 Shell Oil Company Unmanned fueling facility
CN1428694A (en) * 2001-12-29 2003-07-09 成都银晨网讯科技有限公司 Embedded human face automatic detection equipment based on DSP and its method
CN101075868A (en) * 2006-05-19 2007-11-21 华为技术有限公司 Long-distance identity-certifying system, terminal, servo and method
CN101501564A (en) * 2006-08-03 2009-08-05 国际商业机器公司 Video surveillance system and method with combined video and audio recognition
CN102572372A (en) * 2011-12-28 2012-07-11 中兴通讯股份有限公司 Extraction method and device for conference summary
CN103310339A (en) * 2012-03-15 2013-09-18 凹凸电子(武汉)有限公司 Identity recognition device and method as well as payment system and method
CN202720703U (en) * 2012-07-26 2013-02-06 南京工程学院 Face recognition lock of infrared sensing and automatic light supplement
CN102968991A (en) * 2012-11-29 2013-03-13 华为技术有限公司 Method, device and system for sorting voice conference minutes
CN103218763A (en) * 2013-03-26 2013-07-24 陈秀成 Remote on-line interviewing method and system with high reliability
CN103473931A (en) * 2013-07-08 2013-12-25 姜廷顺 System and method for rapid identity confirmation of road-traffic-accident escape vehicle
CN203554767U (en) * 2013-11-18 2014-04-16 谢建波 Dual-light source fill light
CN104023208A (en) * 2014-06-05 2014-09-03 北京小鱼儿科技有限公司 Device and method of automatic monitoring and autonomic response

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106127156A (en) * 2016-06-27 2016-11-16 上海元趣信息技术有限公司 Robot interactive method based on vocal print and recognition of face
CN108965716A (en) * 2018-08-01 2018-12-07 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN108986153A (en) * 2018-08-01 2018-12-11 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
CN109064503A (en) * 2018-08-01 2018-12-21 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment, computer readable storage medium
US10929988B2 (en) 2018-08-01 2021-02-23 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method and device for processing image, and electronic device
CN108986153B (en) * 2018-08-01 2021-03-12 Oppo广东移动通信有限公司 Image processing method and device, electronic equipment and computer readable storage medium
CN109346085A (en) * 2018-10-29 2019-02-15 合肥赛为智能有限公司 A kind of prison supervising platform based on Application on Voiceprint Recognition
CN109670451A (en) * 2018-12-20 2019-04-23 天津天地伟业信息系统集成有限公司 Automatic face recognition tracking
CN110191556A (en) * 2019-05-28 2019-08-30 佛山市田昌灯饰有限公司 It is a kind of can voice control Intelligent lightening device and control method
CN112689125A (en) * 2020-12-18 2021-04-20 中标慧安信息技术股份有限公司 Multi-terminal safety monitoring method and system based on Internet of things
CN112689125B (en) * 2020-12-18 2021-10-08 中标慧安信息技术股份有限公司 Multi-terminal safety monitoring method and system based on Internet of things

Also Published As

Publication number Publication date
CN104333686B (en) 2018-03-27

Similar Documents

Publication Publication Date Title
CN104333686A (en) Intelligent monitoring camera based on face and voiceprint recognition and control method of intelligent monitoring camera
US7956839B2 (en) Apparatus and method for managing the power of illumination devices
CN103530912A (en) Attendance recording system having emotion identification function, and method thereof
US20190311201A1 (en) Battery-powered camera with reduced power consumption based on machine learning and object detection
CN110569737A (en) Face recognition deep learning method and face recognition acceleration camera
CN204335086U (en) A kind of intelligent desk lamp
CN108259848A (en) A kind of identification device and monitoring device
WO2022188558A1 (en) Image processing method and apparatus, and camera
CN113589217A (en) Intelligent ammeter defect detection device
CN109413810B (en) Illumination control method and device for illumination device of tent
US20170353642A1 (en) Driver state monitoring system
WO2021147835A1 (en) One-key master control system for intelligent lighting terminal, and control method therefor
CN208029012U (en) A kind of identification device and monitoring device
Kim et al. Deep learning based effective surveillance system for low-illumination environments
US20160240057A1 (en) System and method for providing alerts regarding occupancy conditions
CN103645977A (en) Automatic debugging system and method for electronic products
CN102999991A (en) Audible-visual alarm
CN115346123A (en) Intelligent lamp pole autonomous system based on intelligent gateway
CN206162587U (en) A face -identifying device
CN215642742U (en) Multi-modal biological recognition module and multi-modal biological recognition device
CN104504843A (en) Multimode security alarm lighting system and production method thereof
CN103561241A (en) Power adjustment method of laser night-vision device
CN105208710B (en) A kind of Lighting Control Assembly and control method
TWI502984B (en) Webcam driving circuit and method thereof
CN205611028U (en) Induction illuminating lamp system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 300384 in3xiqing District Huayuan Industrial Zone (outer ring road) No. 8 Haitai branch

Applicant after: Tiandi Weiye Technology Co., Ltd.

Address before: 300384 Tianjin city Xiqing District Huayuan new technology Industrial Park (outer ring road No. 8) two Haitai branch

Applicant before: Tianjin Tiandy Digital Technology Co., Ltd.

GR01 Patent grant
GR01 Patent grant