CN109947268A - A kind of multi-functional expression mouse can be used for intelligent terminal - Google Patents

A kind of multi-functional expression mouse can be used for intelligent terminal Download PDF

Info

Publication number
CN109947268A
CN109947268A CN201810721863.6A CN201810721863A CN109947268A CN 109947268 A CN109947268 A CN 109947268A CN 201810721863 A CN201810721863 A CN 201810721863A CN 109947268 A CN109947268 A CN 109947268A
Authority
CN
China
Prior art keywords
intelligent terminal
mouse
facial
functional expression
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810721863.6A
Other languages
Chinese (zh)
Inventor
郑奇
鞠纪恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hubei University for Nationalities
Original Assignee
Hubei University for Nationalities
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hubei University for Nationalities filed Critical Hubei University for Nationalities
Priority to CN201810721863.6A priority Critical patent/CN109947268A/en
Publication of CN109947268A publication Critical patent/CN109947268A/en
Pending legal-status Critical Current

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a kind of multi-functional expression mouses that can be used for intelligent terminal, it extracts conversion, facial characteristics recognizer, verbal instructions recognizer, facial characteristics coding and order loading technique in the multi-functional expression mouse-technique of one based on face Pupil diameter, face human facial expression recognition, facial special characteristic, including sets gradually the preposition CCD of infrared LED lamp, intelligent terminal, intelligent terminal shell, preposition imaging lens, shaping lens, mouse-driven software and intelligent terminal microphone in the counterclockwise direction.The present invention can be achieved to reduce the number using manual mouse, achieve the purpose that liberate both hands and improves working efficiency, in addition, in terms of being also applied to aircrew helmet and automatic Pilot, it is equally applicable on disabled person's supplementary instrument simultaneously, help disabled person to improve self-care ability etc., have many advantages, such as it is small in size, without attachment device, simple and practical, easy to use.

Description

A kind of multi-functional expression mouse can be used for intelligent terminal
Technical field
The present invention relates to Computer Control Technology field, specially a kind of multi-functional expression mouse that can be used for intelligent terminal Mark.
Background technique
Mouse or contact action are used widely in modern computer as a kind of important human-computer interaction technology, are sent out Great function is waved.Mouse or contact action bring great convenience to computer operation, since mouse or contact action need to use Hand operation applies in certain fields in daily life and there is inconvenience, some people use mouse or contact action throughout the year, in turn Wrist poor blood circulation is caused, the symptom of the inferior healths such as disease of hand is in turn resulted in.
Summary of the invention
The purpose of the present invention is to provide a kind of multi-functional expression mouses that can be used for intelligent terminal, to solve above-mentioned background The problem of being proposed in technology.
In order to solve the above technical problem, the present invention provides following technical solutions: a kind of more function can be used for intelligent terminal Energy expression mouse extracts conversion, facial characteristics based on face Pupil diameter, face human facial expression recognition, facial special characteristic Recognizer, verbal instructions recognizer, facial characteristics coding and order loading technique are in the multi-functional expression mouse skill of one Art, including the preposition CCD of infrared LED lamp, intelligent terminal, intelligent terminal shell, preposition imaging lens are set gradually in the counterclockwise direction Head, shaping lens, mouse-driven software and intelligent terminal microphone.
Further, the infrared LED lamp is a light emitting diode for being in infrared band, and luminous point size is 0.1mm × 0.3mm, fast axis divergence angle are 40 °, and slow axis divergence is 20 °, for carrying out facial illumination, utilize the opal of human eye Effect carries out facial positions calibration, to extract the specific movement of different parts.
Further, the preposition CCD of the intelligent terminal is a mobile phone products commonly preposition CCD, for user's face The acquisition of expression.
Further, the intelligent terminal shell is common shell, is used for installation function module and circuit board.
Further, the preposition imaging lens are a common Zeiss high-definition camera camera lens, for by the face of user Portion is imaged on the preposition CCD of the intelligent terminal.
Further, the shaping lens are a shaping non-spherical lens, for carrying out shaping to LED diode beam, Realize Uniform Illumination.
Further, the intelligent terminal microphone is a microphone, for when using voice control, realizing voice to mouse Mark the conversion of order.
Further, the mouse-driven software be one be suitable for Android operation system multi-functional expression mouse-driven it is soft Part extracts conversion for realizing face Pupil diameter, face human facial expression recognition, facial special characteristic, facial characteristics identification is calculated Method, verbal instructions recognizer, facial characteristics coding and order loading technique, and then realize the basic function of mouse.
Compared with prior art, the beneficial effects obtained by the present invention are as follows being: the present invention utilizes face Pupil diameter, face face Portion's Expression Recognition, facial special characteristic extract conversion, facial characteristics recognizer, verbal instructions recognizer, facial characteristics are compiled Code and order loading technique realize the number reduced using manual mouse, can liberate both hands, improve working efficiency, in addition, It in terms of being also applied to aircrew helmet and automatic Pilot, while being equally applicable on disabled person's supplementary instrument, helps disabled People improves self-care ability etc., have many advantages, such as it is small in size, without attachment device, simple and practical, easy to use.
Detailed description of the invention
Attached drawing is used to provide further understanding of the present invention, and constitutes part of specification, with reality of the invention It applies example to be used to explain the present invention together, not be construed as limiting the invention.In the accompanying drawings:
Fig. 1 is the structural diagram of the present invention.
In figure: 1, infrared LED lamp, 2, the preposition CCD of intelligent terminal, 3, intelligent terminal shell, 4, preposition imaging lens, 5, whole Shape lens, 6, mouse-driven software, 7, intelligent terminal microphone.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, the present invention provides a kind of technical solution: a kind of multi-functional expression mouse can be used for intelligent terminal, It is based on face Pupil diameter, face human facial expression recognition, facial special characteristic and extracts conversion, facial characteristics recognizer, language Sound password identification algorithm, facial characteristics encode and order loading technique is in the multi-functional expression mouse-technique of one, including along inverse Clockwise sets gradually the preposition CCD2 of infrared LED lamp 1, intelligent terminal, intelligent terminal shell 3, preposition imaging lens 4, shaping Lens 5, mouse-driven software 6 and intelligent terminal microphone 7.
In the present embodiment, the infrared LED lamp 1 is a light emitting diode for being in infrared band, and luminous point size is 0.1mm × 0.3mm, fast axis divergence angle are 40 °, and slow axis divergence is 20 °, and launch wavelength and power are to eye-safe, master Act on is facial positions calibration to be carried out using the chatoyancy of human eye, for carrying out facial illumination to extract different parts Specific movement.
In the present embodiment, the preposition CCD2 of intelligent terminal is a mobile phone products commonly preposition CCD, is used for user face The acquisition of portion's expression.
In the present embodiment, the intelligent terminal shell 3 is common shell, is used for installation function module and circuit board.
In the present embodiment, the preposition imaging lens 4 are a common Zeiss high-definition camera camera lens, for will be in visual field Scenery Imaging is mainly used for for the face of user being imaged on CCD in the present invention on CCD.
In the present embodiment, the shaping lens are a shaping non-spherical lens, whole for carrying out to LED diode beam Shape realizes Uniform Illumination.
In the present embodiment, the mouse-driven software 6 is that a multi-functional expression mouse for being suitable for Android operation system drives Dynamic software, for realizing face Pupil diameter, face human facial expression recognition, facial special characteristic extract conversion, facial characteristics is known Other algorithm, verbal instructions recognizer, facial characteristics coding and order loading technique, and then realize the basic function of mouse.
In the present embodiment, the intelligent terminal microphone 7 is a microphone, for realizing voice when using voice control To the conversion of mouse command.
Multi-functional expression mouse of the invention as common mouse, have different interface modes, for smart phone, The smart electronics product such as notebook, ipad has been equipped with the preposition CCD of intelligent terminal, the intelligence that the present invention describes due to commonly using mouse Energy terminal shell, intelligent terminal Mike etc. component, therefore the multi-functional expression mouse and intelligent terminal electron product of these products Integrated design, it is only necessary in components such as intelligent terminal addition infrared LEDs, for the multifunctional meter of old-fashioned desktop computer Feelings mouse uses modular design, is connect with computer using USB or bluetooth connection, multi-functional expression mouse is fixed on platform Formula computer display suitable position, multi-functional expression mouse include camera, microphone, infrared LED lamp part at this time.
The present invention may be directly applied in the products such as smart phone, notebook, ipad, make these products that expression control can be used System can use with common mouse, touch action switching, liberate both hands, working efficiency is made to be greatly improved, man-machine efficacy obtain To improve.
Working principle: mouse-driven software controls are deposited in mobile phone memory, in the hardware setting of mobile phone operating system It is called in menu, when user selects multi-functional expression mouse mode or automatic mode, mouse driver starts on backstage, hand Machine front camera and infrared lamp LED operation;User needs to define the local expression of face, to determine the movement of mouse;As quickly Blink twice, represents the double-click of common mouse;Quickly nodding slightly indicates downward page turning;Head expression is quickly faced upward to page up; Due to being that mouse mode works, at this moment the image of front camera is not shown in screen, more when front camera is used for self-timer Function expression mouse voluntarily interrupts, and when using contact action, multi-functional expression mouse is waited for, when using intelligent language When sound identification control, specific simplified order need to be only given an oral account, the multi-functional expression mouse of speech recognition software automatic trigger is corresponding Movement.
As stated above, the present invention extracts and turns using face Pupil diameter, face human facial expression recognition, facial special characteristic It changes, facial characteristics recognizer, verbal instructions recognizer, facial characteristics coding and order loading technique use to realize to reduce The number of manual mouse can liberate both hands, working efficiency be improved, in addition, being also applied to aircrew helmet and driving automatically Aspect is sailed, while being equally applicable on disabled person's supplementary instrument, disabled person is helped to improve self-care ability etc., there is small in size, nothing Attachment device, it is simple and practical, easy to use the advantages that.
Finally, it should be noted that the foregoing is only a preferred embodiment of the present invention, it is not intended to restrict the invention, Although the present invention is described in detail referring to the foregoing embodiments, for those skilled in the art, still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features. All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention Within protection scope.

Claims (8)

1. a kind of multi-functional expression mouse that can be used for intelligent terminal, it is characterised in that: based on face Pupil diameter, face face Expression Recognition, facial special characteristic extract conversion, facial characteristics recognizer, verbal instructions recognizer, facial characteristics coding And order loading technique including sets gradually infrared LED lamp in the multi-functional expression mouse-technique of one in the counterclockwise direction (1), the preposition CCD of intelligent terminal (2), intelligent terminal shell (3), preposition imaging lens (4), shaping lens (5), mouse-driven are soft Part (6) and intelligent terminal microphone (7).
2. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: described red Outer LED light (1) is a light emitting diode for being in infrared band, and luminous point size is 0.1mm × 0.3mm, fast axis divergence angle It is 40 °, slow axis divergence is 20 °, for carrying out facial illumination, facial positions calibration is carried out using the chatoyancy of human eye, with Just the specific movement of different parts is extracted.
3. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: the intelligence The energy preposition CCD of terminal (2) is a mobile phone products commonly preposition CCD, the acquisition for user's facial expression.
4. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: the intelligence Energy terminal shell (3) is common shell, is used for installation function module and circuit board.
5. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: before described Setting imaging lens (4) is a common Zeiss high-definition camera camera lens, for the face of user to be imaged on the intelligent terminal On preposition CCD.
6. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: described whole Shape lens (5) are a shaping non-spherical lens, for carrying out shaping to LED diode beam, realize Uniform Illumination.
7. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1, it is characterised in that: the intelligence Energy terminal microphone (7) is a microphone, for when using voice control, realizing the conversion of voice to mouse command.
8. a kind of multi-functional expression mouse that can be used for intelligent terminal according to claim 1-7, feature exist In: the mouse-driven software (6) is the multi-functional expression mouse-driven software for being suitable for Android operation system, for realizing Face Pupil diameter, face human facial expression recognition, facial special characteristic extract conversion, facial characteristics recognizer, verbal instructions Recognizer, facial characteristics coding and order loading technique, and then realize the basic function of mouse.
CN201810721863.6A 2018-07-04 2018-07-04 A kind of multi-functional expression mouse can be used for intelligent terminal Pending CN109947268A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810721863.6A CN109947268A (en) 2018-07-04 2018-07-04 A kind of multi-functional expression mouse can be used for intelligent terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810721863.6A CN109947268A (en) 2018-07-04 2018-07-04 A kind of multi-functional expression mouse can be used for intelligent terminal

Publications (1)

Publication Number Publication Date
CN109947268A true CN109947268A (en) 2019-06-28

Family

ID=67005807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810721863.6A Pending CN109947268A (en) 2018-07-04 2018-07-04 A kind of multi-functional expression mouse can be used for intelligent terminal

Country Status (1)

Country Link
CN (1) CN109947268A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001013215A1 (en) * 1999-08-13 2001-02-22 Genologic Gmbh Device for converting spoken commands and/or spoken texts into keyboard and/or mouse movements and/or texts
CN101336089A (en) * 2006-01-26 2008-12-31 诺基亚公司 Eye tracker equipment
CN202584048U (en) * 2012-05-17 2012-12-05 大连民族学院 Smart mouse based on DSP image location and voice recognition
CN104337496A (en) * 2013-07-30 2015-02-11 财团法人交大思源基金会 Head-mounted eye tracking system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001013215A1 (en) * 1999-08-13 2001-02-22 Genologic Gmbh Device for converting spoken commands and/or spoken texts into keyboard and/or mouse movements and/or texts
CN101336089A (en) * 2006-01-26 2008-12-31 诺基亚公司 Eye tracker equipment
CN202584048U (en) * 2012-05-17 2012-12-05 大连民族学院 Smart mouse based on DSP image location and voice recognition
CN104337496A (en) * 2013-07-30 2015-02-11 财团法人交大思源基金会 Head-mounted eye tracking system

Similar Documents

Publication Publication Date Title
CN108205374B (en) Eyeball tracking module and method of video glasses and video glasses
CN105224069B (en) A kind of augmented reality dummy keyboard input method and the device using this method
WO2015124050A1 (en) Fountain control method and system based on natural human-machine interaction technology
CN102096467B (en) Light-reflecting type mobile sign language recognition system and finger-bending measurement method
CN102932212A (en) Intelligent household control system based on multichannel interaction manner
WO2022193989A1 (en) Operation method and apparatus for electronic device and electronic device
CN203261516U (en) Lighting system
KR102187837B1 (en) Inputting device of copmputer and method for using the device and system thereof
CN109241900B (en) Wearable device control method and device, storage medium and wearable device
Tresanchez et al. Optical mouse sensor for eye blink detection and pupil tracking: Application in a low-cost eye-controlled pointing device
JP7271909B2 (en) DISPLAY DEVICE AND CONTROL METHOD OF DISPLAY DEVICE
CN203164540U (en) Language translation glasses
CN109947268A (en) A kind of multi-functional expression mouse can be used for intelligent terminal
WO2020087919A1 (en) Augmented reality human-computer interaction device and a control method based on gaze tracking
CN203950270U (en) Body sense recognition device and by the man-machine interactive system of its mouse beacon keyboard operation
CN113160260A (en) Head-eye double-channel intelligent man-machine interaction system and operation method
CN101290706A (en) Wireless remote control system and its wireless remote controller
CN201936249U (en) Light reflection type mobile sign language identification system
CN111885777A (en) Control method and device for indoor LED lamp
CN204190981U (en) Energy be followed the trail of and adapt to the Light Control Unit of eye
CN109754677A (en) A kind of double mode deaf-mute alternating current equipment
CN203070206U (en) Mouse controlled by human eyes
CN207440731U (en) It is a kind of that there is the projecting apparatus of gesture control
Henzen et al. Adaptable virtual keyboard and mouse for people with special needs
KR20030030232A (en) Method and System for recognizing continuous sign language based on computer vision

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190628