CN208969684U - Lip reading identifying system under complex environment - Google Patents
Lip reading identifying system under complex environment Download PDFInfo
- Publication number
- CN208969684U CN208969684U CN201821617282.XU CN201821617282U CN208969684U CN 208969684 U CN208969684 U CN 208969684U CN 201821617282 U CN201821617282 U CN 201821617282U CN 208969684 U CN208969684 U CN 208969684U
- Authority
- CN
- China
- Prior art keywords
- chip
- interface
- end connecting
- connecting interface
- capacitor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Image Processing (AREA)
Abstract
Lip reading identifying system under complex environment.The utility model relates to the lip reading identifying systems under a kind of complex environment.The camera passes through utilizing camera interface (5) link control module, the utilizing camera interface (5) is packed into the side of outer housing (1), USB interface (4) are arranged in the left side of the utilizing camera interface (5), video interface (6) are arranged in the right side of the utilizing camera interface (5), the utilizing camera interface (5), USB interface (4) and video interface (6) are all connected with power module (2), and the power module (2) is also connected with SD card (3) and network interface (7).The utility model is identified for lip reading.
Description
Technical field
The utility model relates to the lip reading identifying systems under a kind of complex environment.
Background technique
With the high speed development of information-intensive society, huge variation occurring for people's lives mode, personal identification it is hidden
Hidingization and digitlization are increasingly becoming the main feature of cybertimes.The deficiency of traditional identity authentication method becomes increasingly conspicuous, and has steady
The biological characteristic of qualitative, uniqueness and convenience is gradually applied and develops in field of identity authentication such as safety, certifications, such as people
Face identification, fingerprint recognition, hand vein recognition, iris recognition, Gait Recognition etc..Lip reading identification is similarly widely used, such as
It is exactly broken case with the help of lip reading identifies expert that police in paper money case is robbed in London in 2003.In future, lip reading identification technology can
With assistant voice interaction and image recognition, realizes and be widely applied in every field such as daily life, security protection, public goods.Such as in vehicle
It carries under scene, interference can be generated to phonetic order when ambient noise is excessive, in safety-security area, since most monitoring are only taken the photograph at present
As head does not have a microphone, and lip reading identification can then help public security officer to obtain important speech information, provide for public safety
Effectively support.In addition, lip reading identification also have an opportunity to help it is congenital listen barrier crowd or the elderly, help them preferably to hand over people
Stream.The research of labiomaney in recent years is concentrated mainly on the U.S., Switzerland, Japan and other countries.China's Institute of Automation, acoustics institute, Zhejiang are big
The units such as, Tsinghua University have also carried out corresponding research, and some key technologies achieved some breakthroughs in recent years, have
Small-sized labiomaney system occurs.
Summary of the invention
The purpose of the utility model is to provide the lip reading identifying systems under a kind of complex environment, to solve the above problems.
Above-mentioned purpose is realized by following technical scheme:
The utility model has the advantages that
1. the utility model can solve the speech recognition problem under complex environment and exclude noise jamming, it is correct to improve detection
Rate.
2. the utility model can obtain face by non-contacting mode, pass through Adaboost algorithm retention Hp position
It sets.
Detailed description of the invention:
Attached drawing 1 is the structural schematic diagram of the utility model.
Attached drawing 2 is the 0V7670 circuit diagram of the utility model.
Attached drawing 3 is the 0V7670 module of the utility model and the interface circuit figure of FPGA plate.
Attached drawing 4 is the RS-232 interface electrograph of the utility model.
Attached drawing 5 is the potential circuit figure of the utility model.
Attached drawing 6 is the flow chart of the utility model.
Specific embodiment:
Embodiment 1
A kind of lip reading identifying system under complex environment, composition includes: camera, and the camera passes through camera
5 link control module of interface, the utilizing camera interface 5 are packed into the side of outer housing 1, the left side of the utilizing camera interface 5
USB interface 4 is set, and video interface 6, the utilizing camera interface 5, USB interface 4 is arranged in the right side of the utilizing camera interface 5
It is all connected with power module 2 with video interface 6, the power module 2 is also connected with SD card 3 and network interface 7, the SD card 3
USB interface 4 is connected, the network interface 7 connects utilizing camera interface 5, USB interface 4, video interface 6, power module 2 and SD
Block 3, memory 8, ARM module 9 and FPGA module 10, the memory 8, ARM module 9 are also loaded into the outer housing 1
It is connected between FPGA module 10,
Display screen 11 is arranged in the upper surface of the outer housing 1.
Lip reading identifying system under the complex environment, the camera are driven by the camera of utilizing camera interface 5
Dynamic circuit connection FPGA module 10, the webcam driver circuit includes chip U1, and No. 5 ends of the chip U1 connect capacitor
One end of C10, one end of No. 10 end connection capacitor C9 of the chip U1, No. 11 ends of the chip U1 connect capacitor
One end of C12, the capacitor C10 the other end connection other end of capacitor C9, the other end of capacitor C11, chip U1 47
Number end and No. 9 of chip U1 ends,
No. 9 ends of No. 26 end connecting interface JP2 of the chip U1,
No. 10 ends of No. 25 end connecting interface JP2 of the chip U1,
No. 11 ends of No. 24 end connecting interface JP2 of the chip U1,
No. 12 ends of No. 23 end connecting interface JP2 of the chip U1,
No. 13 ends of No. 22 end connecting interface JP2 of the chip U1,
No. 14 ends of No. 21 end connecting interface JP2 of the chip U1,
No. 15 ends of No. 20 end connecting interface JP2 of the chip U1,
No. 16 ends of No. 19 end connecting interface JP2 of the chip U1,
No. 1 end of No. 41 end connecting interface JP2 of the chip U1,
No. 2 ends of No. 40 end connecting interface JP2 of the chip U1,
No. 3 ends of No. 39 end connecting interface JP2 of the chip U1,
No. 4 ends of No. 38 end connecting interface JP2 of the chip U1,
No. 5 ends of No. 37 end connecting interface JP2 of the chip U1,
No. 6 ends of No. 36 end connecting interface JP2 of the chip U1,
No. 7 ends of No. 35 end connecting interface JP2 of the chip U1,
No. 8 ends of No. 34 end connecting interface JP2 of the chip U1,
No. 17 ends of No. 4 end connecting interface JP2 of the chip U1,
No. 18 ends of No. 42 end connecting interface JP2 of the chip U1,
No. 19 ends of No. 16 end connecting interface JP2 of the chip U1,
No. 20 ends of No. 33 end connecting interface JP2 of the chip U1,
No. 21 ends of No. 18 end connecting interface JP2 of the chip U1,
No. 22 ends of No. 17 end connecting interface JP2 of the chip U1；
No. 8 ends of No. 3 end connection chip ICs 4 of interface J2,
No. 7 ends of No. 2 end connection chip ICs 4 of the interface J2；
Capacitor C17 is connected between No. 1 end of the chip IC 4 and No. 3 ends of chip IC 4,
Capacitor C20 is connected between No. 4 ends of the chip IC 4 and No. 5 ends of chip IC 4,
It is grounded after No. 2 ends connection capacitor C19 of the chip IC 4,
It is grounded after No. 6 ends connection capacitor C8 of the chip IC 4,
Capacitor C30 is connected between No. 15 ends of the chip IC 4 and No. 16 ends of chip IC 4.
Embodiment 2
1 operating procedure of embodiment:
Step 1: according to circuit connection, while operating system, system will start camera automatically, acquire image.
Step 2: Face datection processing is carried out to step 1 acquired image, if detecting facial image, for people
Face image carries out critical point detection, is split alignment frame by extracting for mouth after lip key point and selects lip figure
Piece.It, can be corresponding in the lip image detection result in the result of a preceding image procossing in order to improve detection efficiency
Critical point detection processing is carried out in image range can be improved the efficiency of image procossing, improves due to reducing detection range
Its real-time.If facial image can not be detected, or what is obtained is side face image, then is determined as invalid image.
Step 3: to the classification of lip image process, it, which is classified, needs to carry out lip state-detection, obtains lip
Portion's characteristics of image.Specific implementation are as follows: lip state-detection is carried out to the lip image, lip state is determined, to realize lip
The function that the detection in portion is identified with lip reading.
Basic principle: the present apparatus is mainly the lip reading identification under present complex environment.
Complex environment refers to that there are sound interference, the environment of image interference.The state of the utility model setting is no voice and sentiment
Condition.
It is exactly that camera gets image for entire framework, image is passed into nucleus module, nucleus module
ARM module runs entire algorithm, and for the part for needing largely to calculate in algorithm, ARM module will call FPGA module to count
Calculate, calculated result is passed to ARM module after calculating by FPGA, the lip image that ARM module will identify that be sent to display screen or
It on external computer monitor and shows, if do not identified successfully, prompt will be made on the screen, and remind input figure again
Picture.
Certainly, the above description is not intended to limit the present invention, and the utility model is also not limited to the example above,
The variations, modifications, additions or substitutions that those skilled in the art are made in the essential scope of the utility model, are also answered
Belong to the protection scope of the utility model.
Claims (2)
1. the lip reading identifying system under a kind of complex environment, composition includes: camera, it is characterized in that: the camera is logical
Utilizing camera interface (5) link control module is crossed, the utilizing camera interface (5) is packed into the side of outer housing (1), the camera shooting
USB interface (4) are arranged in the left side of head interface (5), and video interface (6) are arranged in the right side of the utilizing camera interface (5), described
Utilizing camera interface (5), USB interface (4) and video interface (6) are all connected with power module (2), and the power module (2) also connects
SD card (3) and network interface (7) are connect, the SD card (3) connects USB interface (4), the network interface (7) connection camera shooting
Head interface (5), USB interface (4), video interface (6), power module (2) and SD card (3) are also loaded into the outer housing (1)
Memory (8), ARM module (9) and FPGA module (10), the memory (8), ARM module (9) and FPGA module (10) it
Between be connected,
Display screen (11) are arranged in the upper surface of the outer housing (1).
2. the lip reading identifying system under complex environment according to claim 1, it is characterized in that: the camera is by taking the photograph
As the webcam driver circuit connection FPGA module (10) of head interface (5), the webcam driver circuit includes chip U1, described
No. 5 of chip U1 end connection capacitor C10 one end, one end of No. 10 end connection capacitor C9 of the chip U1 is described
One end of No. 11 end connection capacitor C12 of chip U1, the other end, the capacitor of the other end connection capacitor C9 of the capacitor C10
The other end of C11, No. 47 ends of chip U1 and No. 9 ends of chip U1,
No. 9 ends of No. 26 end connecting interface JP2 of the chip U1,
No. 10 ends of No. 25 end connecting interface JP2 of the chip U1,
No. 11 ends of No. 24 end connecting interface JP2 of the chip U1,
No. 12 ends of No. 23 end connecting interface JP2 of the chip U1,
No. 13 ends of No. 22 end connecting interface JP2 of the chip U1,
No. 14 ends of No. 21 end connecting interface JP2 of the chip U1,
No. 15 ends of No. 20 end connecting interface JP2 of the chip U1,
No. 16 ends of No. 19 end connecting interface JP2 of the chip U1,
No. 1 end of No. 41 end connecting interface JP2 of the chip U1,
No. 2 ends of No. 40 end connecting interface JP2 of the chip U1,
No. 3 ends of No. 39 end connecting interface JP2 of the chip U1,
No. 4 ends of No. 38 end connecting interface JP2 of the chip U1,
No. 5 ends of No. 37 end connecting interface JP2 of the chip U1,
No. 6 ends of No. 36 end connecting interface JP2 of the chip U1,
No. 7 ends of No. 35 end connecting interface JP2 of the chip U1,
No. 8 ends of No. 34 end connecting interface JP2 of the chip U1,
No. 17 ends of No. 4 end connecting interface JP2 of the chip U1,
No. 18 ends of No. 42 end connecting interface JP2 of the chip U1,
No. 19 ends of No. 16 end connecting interface JP2 of the chip U1,
No. 20 ends of No. 33 end connecting interface JP2 of the chip U1,
No. 21 ends of No. 18 end connecting interface JP2 of the chip U1,
No. 22 ends of No. 17 end connecting interface JP2 of the chip U1；
No. 8 ends of No. 3 end connection chip ICs 4 of interface J2,
No. 7 ends of No. 2 end connection chip ICs 4 of the interface J2；
Capacitor C17 is connected between No. 1 end of the chip IC 4 and No. 3 ends of chip IC 4,
Capacitor C20 is connected between No. 4 ends of the chip IC 4 and No. 5 ends of chip IC 4,
It is grounded after No. 2 ends connection capacitor C19 of the chip IC 4,
It is grounded after No. 6 ends connection capacitor C8 of the chip IC 4,
Capacitor C30 is connected between No. 15 ends of the chip IC 4 and No. 16 ends of chip IC 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821617282.XU CN208969684U (en) | 2018-09-30 | 2018-09-30 | Lip reading identifying system under complex environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821617282.XU CN208969684U (en) | 2018-09-30 | 2018-09-30 | Lip reading identifying system under complex environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208969684U true CN208969684U (en) | 2019-06-11 |
Family
ID=66757939
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201821617282.XU Expired - Fee Related CN208969684U (en) | 2018-09-30 | 2018-09-30 | Lip reading identifying system under complex environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208969684U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110443124A (en) * | 2019-06-26 | 2019-11-12 | 卓尔智联(武汉)研究院有限公司 | Recognition methods, device and storage medium |
-
2018
- 2018-09-30 CN CN201821617282.XU patent/CN208969684U/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110443124A (en) * | 2019-06-26 | 2019-11-12 | 卓尔智联(武汉)研究院有限公司 | Recognition methods, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100481112C (en) | Human face recognition system and recognition method | |
| US8866931B2 (en) | Apparatus and method for image recognition of facial areas in photographic images from a digital camera | |
| JP3337988B2 (en) | Individual identification device | |
| CN105427421A (en) | Entrance guard control method based on face recognition | |
| CN105975938A (en) | Smart community manager service system with dynamic face identification function | |
| TWI706270B (en) | Identity recognition method, device and computer readable storage medium | |
| CN103514438A (en) | Face judgment system and method | |
| WO2018192448A1 (en) | People-credentials comparison authentication method, system and camera | |
| CN102004906A (en) | Face identification system and method | |
| TW201405445A (en) | True face recognition system and method based on dual camera | |
| CN208969684U (en) | Lip reading identifying system under complex environment | |
| WO2019104551A1 (en) | Fingerprint identification method, and terminal device | |
| CN105938546A (en) | Real living identity verification terminal equipment based on infrared technology | |
| WO2018173947A1 (en) | Image search device | |
| Rohlicek et al. | Gisting conversational speech | |
| CN107403192B (en) | Multi-classifier-based rapid target detection method and system | |
| CN113343001B (en) | Data storage system of face recognition terminal | |
| EP3398108A1 (en) | A method and system for visual privacy protection for mobile and wearable devices | |
| US11600111B2 (en) | System and method for face recognition | |
| CN202694373U (en) | Identification system for bank | |
| CN201903889U (en) | Finger vein recognition terminal | |
| CN106557738B (en) | A kind of long-distance iris identification device | |
| CN101751557A (en) | Intelligent biological identification device and identification method thereof | |
| CN201111085Y (en) | Human face automatic recognition system | |
| CN111582001A (en) | Method and system for identifying suspicious people based on emotion perception |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190611 Termination date: 20210930 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |