CN110477927A - A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing - Google Patents
A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN110477927A CN110477927A CN201910882669.0A CN201910882669A CN110477927A CN 110477927 A CN110477927 A CN 110477927A CN 201910882669 A CN201910882669 A CN 201910882669A CN 110477927 A CN110477927 A CN 110477927A
- Authority
- CN
- China
- Prior art keywords
- blink
- value
- infrared
- infrared detection
- detection value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1103—Detecting eye twinkling
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Veterinary Medicine (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Ophthalmology & Optometry (AREA)
- Physiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a kind of active blink detection methods, method includes the following steps: utilizing the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and the corresponding second infrared detection value in eyeball designated position;The detection difference between the first infrared detection value and the second infrared detection value is calculated, and will test the absolute value of difference as blink parameter;Obtain the blink duration that blink parameter is greater than blink threshold value;It is greater than blink duration threshold value in blink duration, determines and occur actively blinking.This method can be improved the accuracy rate of active blink detection.The invention also discloses a kind of active blink detection device, equipment and readable storage medium storing program for executing, have corresponding technical effect.
Description
Technical field
The present invention relates to signal processing technology field, more particularly to a kind of active blink detection method, apparatus, equipment and
Readable storage medium storing program for executing.
Background technique
With the development of augmented reality (Augmented Reality, AR) technology and intelligent glasses, people can pass through calculating
The information that machine system provides increases perception of the user to real world, AR and intelligent glasses for virtual Information application to true generation
Boundary, and by dummy object, scene or the system prompt information superposition of computer generation into real scene, to realize to reality
Enhancing.
But since AR product and intelligent glasses carry are on the head of human body, touch and the mode of key can be to wearing shape
State has an impact, and influences comfort.Currently, taking eye motion to promote user experience to manipulate to equipment.
Current blink detection mostly uses greatly infrared detection mode to determine whether to blink, particularly in view of blinking in existing blink detection
At the moment eyelid position can change, thus determine whether actively to blink by detection eyelid position mostly, and different
Human eye it is of different sizes, pass through detection eyelid position, it is difficult to adapt to different people carry out blink detection, blink detection practicability
It reduces.
In conclusion the problems such as how efficiently solving blink detection, is that current those skilled in the art are urgently to be solved
Technical problem.
Summary of the invention
The object of the present invention is to provide a kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing, to improve
The accuracy rate of active blink detection.
In order to solve the above technical problems, the invention provides the following technical scheme:
A kind of active blink detection method, comprising:
It is corresponding using the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and eyeball designated position
Second infrared detection value;
Calculate the detection difference between the first infrared detection value and the second infrared detection value, and by the detection difference
Absolute value as blink parameter;
Obtain the blink duration that the blink parameter is greater than blink threshold value;
It is greater than blink duration threshold value in the blink duration, determines and occur actively blinking.
Preferably, described to be referred to using the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and eyeball
Corresponding second infrared detection value is set in positioning, comprising:
The first infrared detection value is acquired using the first infrared sensor that pickup area is the periocualr skin;
It is that corresponding second infrared sensor in eyeball designated position acquires the second infrared detection value using pickup area.
Preferably, described to acquire described second using pickup area for corresponding second infrared sensor in eyeball designated position
Infrared detection value, comprising:
Infrared detection is carried out using the white of the eye or pupil position of second infrared sensor to eyeball, obtains described second
Infrared detection value.
Preferably, the process of the blink threshold value is obtained, comprising:
Using the corresponding third infrared detection value of periocualr skin described under infrared sensor acquisition closed-eye state, and
The corresponding 4th infrared detection value in eyeball designated position;
The eye closing difference for calculating the third infrared detection value and the 4th infrared detection value, by the eye closing difference
Absolute value is as the blink threshold value.
Preferably, the process of the blink duration threshold value is obtained, comprising:
The duration data that the people of acquisition specified quantity blinks naturally;
The duration data is counted, nature blink maximum time is obtained;
Using the maximum time of blink naturally as the blink duration threshold value.
Preferably, further includes:
When determining that appearance is actively blinked, then control instruction corresponding with actively blinking is run, to control augmented reality
Equipment or intelligent glasses.
Preferably, the blink duration that the blink parameter is greater than blink threshold value is obtained, comprising:
The blink parameter is continued to monitor, the blink duration is obtained.
A kind of active blink detection device, comprising:
Infrared detection module, fingerprint identification module is used for using the corresponding first infrared detection value of infrared sensor acquisition periocualr skin, and
The corresponding second infrared detection value in eyeball designated position;
Blink parameter acquisition module, for calculating the detection between the first infrared detection value and the second infrared detection value
Difference, and using the absolute value of the detection difference as blink parameter;
Blink parameter monitoring module, the blink duration for being greater than blink threshold value for obtaining the blink parameter;
Determining module of actively blinking determines and occurs actively for being greater than blink duration threshold value in the blink duration
Blink.
A kind of active blink detection system, comprising:
Infrared sensor and the MCU being connected with the infrared sensor output end, the MCU are stored with computer journey
Sequence when the computer program is executed by MCU, is realized such as the step of above-mentioned active blink detection method.
A kind of readable storage medium storing program for executing is stored with computer program, the computer program quilt on the readable storage medium storing program for executing
The step of processor realizes above-mentioned active blink detection method when executing.
It is corresponding first infrared using infrared sensor acquisition periocualr skin using method provided by the embodiment of the present invention
The corresponding second infrared detection value of detected value and eyeball designated position;Calculate the first infrared detection value and the second infrared detection
Detection difference between value, and will test the absolute value of difference as blink parameter;It obtains blink parameter and is greater than blink threshold value
Blink duration;It is greater than blink duration threshold value in blink duration, determines and occur actively blinking.
In the method, while the corresponding first infrared detection value of periocualr skin and eyes designated position corresponding being detected
Two infrared detection values.Obviously, in blink, the second infrared detection value is the corresponding infrared detection of eyelid of eyes designated position
Value, and under eyes-open state, the second infrared detection value is the corresponding infrared detection value of eyeball of eyes designated position.Again because of difference
Color object it is different to the absorption of infrared light, and there is the color of eyeball usually can all differ larger with the color of eyelid, because
And the difference of the first infrared detection value Yu the second infrared detection value can be calculated, and join the absolute value of the difference as blink
Number.When the blink duration that parameter of blinking is greater than blink threshold value is greater than blink duration threshold value, it is determined that occur actively blinking.
Relative to the method for comparing eyelid position, this method can carry out more accurate detection to active blink.
Correspondingly, the embodiment of the invention also provides active blink detections corresponding with above-mentioned active blink detection method
Device, equipment and readable storage medium storing program for executing, have above-mentioned technique effect, and details are not described herein.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of implementation flow chart of active blink detection method in the embodiment of the present invention;
Fig. 2 is a kind of infrared sensor detection scheme schematic diagram in the embodiment of the present invention;
Fig. 3 is a kind of specific implementation schematic diagram of active blink detection method in the embodiment of the present invention;
Fig. 4 is a kind of structural schematic diagram of active blink detection system in the embodiment of the present invention;
Fig. 5 is a kind of schematic diagram that blink parameter value changes over time in the embodiment of the present invention;
Fig. 6 is a kind of structural schematic diagram of active blink detection device in the embodiment of the present invention;
Fig. 7 is a kind of circuit diagram of active blink detection system in the embodiment of the present invention.
Specific embodiment
In order to enable those skilled in the art to better understand the solution of the present invention, with reference to the accompanying drawings and detailed description
The present invention is described in further detail.Obviously, described embodiments are only a part of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Embodiment one:
Referring to FIG. 1, Fig. 1 is a kind of flow chart of active blink detection method in the embodiment of the present invention, including following step
It is rapid:
S101, the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and eyeball designated position are utilized
Corresponding second infrared detection value.
It is stronger to infrared ray absorbing in view of containing more liquid in eyeball, thus the infrared ray of some strength is direct
It can cause cataract when irradiating eyes.And the generation of cataract is related with the effect of short infrared, and wavelength is greater than 1.5 microns
Infrared ray do not cause cataract.In practical applications, it is proposed that be greater than 1.5 microns of infrared sensing using the infrared wavelength of transmitting
Device.
First and second in the first infrared detection value and the second infrared detection value are only used for table in embodiments of the present invention
The two bright detected values are limited not directed to the same detection zone without successive, primary and secondary etc..
In embodiments of the present invention, settable two infrared sensors carry out infrared detection, the acquisition of infrared detection value
Journey specifically includes:
Step 1: acquiring the first infrared detection value using the first infrared sensor that pickup area is periocualr skin;
Step 2: being that corresponding second infrared sensor in eyeball designated position acquires the second infrared detection using pickup area
Value.
It is illustrated for ease of description, below combining above-mentioned two step.
Wherein, the descriptor of the first infrared sensor and the second infrared sensor first and second is only used for showing that there are two
A infrared sensor for different acquisition region, rather than primary and secondary is carried out to two infrared sensors or is successively defined.Its
In, periocualr skin can be specially canthus.
When carrying out infrared detection using infrared sensor, infrared inspection is carried out to periocualr skin using the first infrared sensor
It surveys, and the second infrared sensor then detects the designated position of eyeball.
Preferably, in embodiments of the present invention, it is contemplated that degree of reflection and pigmented situation of the skin to infrared ray
It is related.For example, when with 0.9 micron of wavelength of infrared radiation, non-pigmented skin reflex its energy about 60%;And it is coloured
Plain calm its energy of skin reflex about 40%.As it can be seen that the eyelid of the different colours of skin, detects the first obtained infrared detection value meeting
Opposite variation.For example, first red corresponding to the eyelid of the first infrared detection value and casting skin corresponding to the eyelid of pale skin
Outer detected value can have larger difference.If will, corresponding the first infrared detection value and the second infrared detection value under eyes-open state
Between difference be defined as eye opening difference;It closes one's eyes corresponding to illiterate people between the first infrared detection value and the second infrared detection value
Difference be defined as eye closing difference.In order to preferably determine whether to blink, it is clear that between eye opening difference and eye closing difference more
Greatly, then Detection accuracy is higher.Therefore, in embodiments of the present invention, different eyeball detections can be set for the different colours of skin
Designated position.That is, be that corresponding second infrared sensor in eyeball designated position acquires the second infrared detection value using pickup area,
Include: to carry out infrared detection using the white of the eye or pupil position of second infrared sensor to eyeball, obtains the second infrared detection value.
That is, eyeball designated position can be specially pupil position or white of the eye position.Specifically, can be by yellow and the corresponding eyeball of white people
Designated position is set as pupil, sets the white of the eye for the corresponding eyeball designated position of black race.That is, it is only necessary in AR equipment
Or on intelligent glasses, the fixed position relative of the first infrared sensor of adjustment can meet the blink detection of the different colours of skin.
Detection difference between S102, the first infrared detection value of calculating and the second infrared detection value, and will test difference
Absolute value is as blink parameter.
After obtaining the first infrared detection value and the second infrared detection value, the first infrared detection value and second infrared can be calculated
Detection difference between detected value, and using the absolute value of the detection difference as blink parameter.
S103, the blink duration that blink parameter is greater than blink threshold value is obtained.
The even same person, the colour of skin of different location also have different degrees of pigementation, the detected value of infrared detection
It also can different from.Preferably, the process of blink threshold value is obtained, comprising:
Step 1: the corresponding third infrared detection value of periocualr skin under closed-eye state is acquired using infrared sensor, and
The corresponding 4th infrared detection value in eyeball designated position;
Step 2: the eye closing difference of third infrared detection value and the 4th infrared detection value is calculated, by the absolute of difference of closing one's eyes
Value is as blink threshold value.
It is illustrated for ease of description, below combining above-mentioned two step.
Wherein, third infrared detection value and the 4th infrared detection value, respectively collect under closed-eye state respectively
The corresponding infrared detection value of the corresponding infrared detection value of periocualr skin and sign test designated position, therein third and fourth only
For specifying under concrete condition and the corresponding infrared detection value of specific location, and meaning is limited without other.It is adopted according to big crowd
The difference of infrared detection value, can generally be selected within 100 after sample: greater than all groups close one's eyes.
It is understood that the second infrared detection value is the infrared detection value of eyelid under closed-eye state, i.e., at this point,
The difference of first infrared detection value and the second infrared detection value is relatively small;And under eyes-open state, the second infrared detection value is
For the designated position of eyeball, such as the infrared detection value of the white of the eye or eyeball, the difference of the first infrared detection value and the second infrared detection value
It is worth relatively large.Therefore, when parameter of blinking is greater than blink threshold value, it may be determined that eyes are in close state.
And in order to protect eyes, eyes meeting instinct blink, so that tear equably moistens cornea, conjunctiva, keep eyeball
It is wet, cornea gloss is kept, conjunctival sac dust and bacterium are removed.As it can be seen that being different from button or touch detection, it is based on eye motion
Operation, often fail because of the Physiological protection mechanism that human eye itself has.Thus, to avoid the interference of instinct blink from actively blinking
Eye detection can obtain the blink duration that blink parameter is greater than blink threshold value.
Wherein, the blink duration that blink parameter is greater than blink threshold value is obtained, may particularly include: blink parameter is carried out
It continues to monitor, obtains blink duration.The initial time of blink threshold value can be greater than to blink parameter and the termination time carries out
Record, using initial time and the time difference for terminating the time as the blink duration.
S104, it is greater than blink duration threshold value in blink duration, determines and occur actively blinking.
In embodiments of the present invention, a blink duration threshold for judging whether actively blink occur can be preset
Value.Instinct blinks the usual used time all can be shorter, therefore can determine and occur when duration of blinking is greater than blink duration threshold value
Actively blink.Therefore, obtain the process of blink duration threshold value, comprising: acquire that the people of specified quantity blinks naturally it is lasting when
Between data;Duration data is counted, nature blink maximum time is obtained;Using blink maximum time naturally as blink
Duration threshold value.For example, blink duration threshold value may be set to 0.5s.
It certainly, in other embodiments of the invention, can also be directly by instinct wink time identified in medical research
It is set as blink duration threshold value.
Using method provided by the embodiment of the present invention, can detect simultaneously the corresponding first infrared detection value of periocualr skin and
The corresponding second infrared detection value in eyes designated position.Obviously, in blink, the second infrared detection value is eyes designated position
The corresponding infrared detection value of eyelid, and under eyes-open state, the second infrared detection value is that the eyeball of eyes designated position is corresponding
Infrared detection value.Again because absorption of the object of different colors to infrared light is different, and there are the color of eyeball and the face of eyelid
Color usually can all differ difference that is larger, thus can calculating the first infrared detection value Yu the second infrared detection value, and by the difference
The absolute value of value is as blink parameter.It is greater than blink duration threshold value in the blink duration that blink parameter is greater than blink threshold value
When, it is determined that occur actively blinking.Relative to the method for comparing eyelid position, this method can be carried out active blink subject to more
True detection.
It should be noted that based on the above embodiment, the embodiment of the invention also provides be correspondingly improved scheme.Excellent
It can mutually be referred between step or corresponding steps same with the above-mentioned embodiment involved in choosing/improvement embodiment, it is corresponding beneficial
Effect can also be cross-referenced, no longer repeats one by one in preferred/improvement embodiment of this paper.
Preferably, by active blink detection method provided by the embodiment of the present invention, it is applied to arrive AR equipment or intelligence
When in glasses, when determining that appearance is actively blinked, then control instruction corresponding with actively blinking is run, to control augmented reality
Equipment or intelligent glasses.To be taken pictures, be chosen, be confirmed by accurately detecting active blink in AR equipment or intelligent glasses
Deng operation, man-machine interaction experience is promoted.Obviously, active blink detection method provided by the embodiment of the present invention can also be used further
In fatigue detecting.
To more fully understand active blink detection method provided by the embodiment of the present invention convenient for those skilled in the art, under
Face is provided for the embodiments of the invention active blink detection method and is described in detail by taking specific application scenarios as an example.
As shown in Fig. 2, Fig. 2 is a kind of infrared sensor detection scheme schematic diagram in the embodiment of the present invention.Wherein,
SensorA is the second infrared sensor and sensorB is the first infrared sensor, and sensorB, which is used as, refers to sensor, is directed at people
Canthus partial skin, implement through IR irradiation acquisition return value, this return value is related to the colour of skin of wearer.And sensorA
Pupil portion as main sensor alignment human eye.
The main logic of active blink detection can refer to shown in Fig. 3, and Fig. 3 is a kind of active blink inspection in the embodiment of the present invention
The specific implementation schematic diagram of survey method;Wherein, V is infrared detection value, and V0 is blink threshold value, and T is the duration, when T0 is blink
Between threshold value.The setting of threshold value V0: taking the difference of a certain number of eye closings, in the difference for taking a certain number of eye openings, by big
Sample data determines that can accurately distinguish the value closed or opened eyes;The setting of threshold value T0: a certain number of people are acquired certainly
The duration data so blinked determines that a value can be greater than nature and blink, and is less than the value of actively blink.This method can answer
For in system as shown in Figure 4.Fig. 4 is a kind of structural schematic diagram of active blink detection system in the embodiment of the present invention.
Since the object of different colours is different to the absorption of infrared light, lead to Infrared irradiation volume reflection difference on object
It is very big, so to infrared albedo, well below skin, (skin referred herein is yellow skin or white skin to the pupil of black
Skin).So passing through the return value difference for the synchronization for acquiring two sensor in real time: ▲=| Va-Vb |, wherein Va, Vb are
The respectively collected infrared external reflection value of sensorA, sensorB, since the reflected value of eyelid is identical as Vb, so when people is blinking
When eye, ▲ ≈ 0, therefore can judge whether wearer blinks by the difference of double sensor.Meanwhile it is close according to difference
In 0 duration, software filter is set, can effectively filter the time of human body instinct blink, is accurately caught actively
The movement of blink.As shown in figure 5, Fig. 5 is a kind of schematic diagram that blink parameter value changes over time in the embodiment of the present invention.Pass through
After software filter, the movement that wearer actively blinks three times can be accurately captured.It is being applied to AR equipment and intelligence
In glasses, hand-free promotes user experience.
Embodiment two:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of active blink detection devices, hereafter
The active blink detection device of description can correspond to each other reference with above-described active blink detection method.
Shown in Figure 6, which comprises the following modules:
Infrared detection module, fingerprint identification module 101, for acquiring the corresponding first infrared detection value of periocualr skin using infrared sensor, with
And the corresponding second infrared detection value in eyeball designated position;
Blink parameter acquisition module 102, for calculating the detection between the first infrared detection value and the second infrared detection value
Difference, and will test the absolute value of difference as blink parameter;
Blink parameter monitoring module 103, the blink duration for being greater than blink threshold value for obtaining blink parameter;
Determining module of actively blinking 104 determines for being greater than blink duration threshold value in blink duration and occurs actively blinking
Eye.
In the present apparatus, while detecting the corresponding first infrared detection value of periocualr skin and eyes designated position corresponding
Two infrared detection values.Obviously, in blink, the second infrared detection value is the corresponding infrared detection of eyelid of eyes designated position
Value, and under eyes-open state, the second infrared detection value is the corresponding infrared detection value of eyeball of eyes designated position.Again because of difference
Color object it is different to the absorption of infrared light, and there is the color of eyeball usually can all differ larger with the color of eyelid, because
And the difference of the first infrared detection value Yu the second infrared detection value can be calculated, and join the absolute value of the difference as blink
Number.When the blink duration that parameter of blinking is greater than blink threshold value is greater than blink duration threshold value, it is determined that occur actively blinking.
Relative to the method for comparing eyelid position, this method can carry out more accurate detection to active blink.
In a kind of specific embodiment of the invention, infrared detection module, fingerprint identification module 101, comprising:
First acquisition unit, for acquiring the first infrared inspection using the first infrared sensor that pickup area is periocualr skin
Measured value;
Second acquisition unit, for being eyeball designated position corresponding second infrared sensor acquisition the using pickup area
Two infrared detection values.
In a kind of specific embodiment of the invention, the second acquisition unit is specifically used for utilizing the second infrared sensor
The white of the eye or pupil position to eyeball carry out infrared detection, obtain the second infrared detection value.
In a kind of specific embodiment of the invention, comprising:
Blink threshold setting module, for red using the corresponding third of periocualr skin under infrared sensor acquisition closed-eye state
The corresponding 4th infrared detection value of outer detected value and eyeball designated position;Calculate third infrared detection value and the 4th infrared inspection
The eye closing difference of measured value, using the absolute value for difference of closing one's eyes as blink threshold value.
In a kind of specific embodiment of the invention, comprising:
Blink duration threshold setting module, the duration data that the people for acquiring specified quantity blinks naturally;To holding
Continuous time data are counted, and nature blink maximum time is obtained;Using blink maximum time naturally as blink duration threshold value.
In a kind of specific embodiment of the invention, further includes:
Module is realized in blink control, for when determining that appearance is actively blinked, then running control corresponding with actively blinking
Instruction, to control augmented reality equipment or intelligent glasses.
In a kind of specific embodiment of the invention, blink parameter monitoring module 103, be specifically used for blink parameter into
Row continues to monitor, and obtains blink duration.
Embodiment three:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of active blink detection systems, hereafter
A kind of active blink detection system of description can correspond to each other reference with a kind of above-described active blink detection method.
Referring to FIG. 4, the system includes:
Infrared sensor and the MCU being connected with infrared sensor output end, MCU are stored with computer program, computer
When program is executed by MCU, realize such as the step of above method embodiment active blink detection method.
Wherein, sensorA and sensorB is infrared sensor, and infrared sensor can be connect by I2C bus with MCU.
The circuit diagram of the system can be a kind of active blink detection system in the embodiment of the present invention with specific reference to Fig. 7, Fig. 7
The circuit diagram of system.Wherein, I2C_SEN1_N, I2C_SEN2_N are separately connected the output end of two infrared sensors, U2518
For MCU, MCU can also be micro-control unit (the Micro Control of other models in other embodiments of the invention certainly
Unit, single-chip microcontroller).
Active blink detection system provided by the embodiment of the present invention has the technology effect that above method embodiment has
Fruit, this is no longer going to repeat them.
Example IV:
Corresponding to above method embodiment, the embodiment of the invention also provides a kind of readable storage medium storing program for executing, are described below
A kind of readable storage medium storing program for executing can correspond to each other reference with a kind of above-described active blink detection method.
A kind of readable storage medium storing program for executing is stored with computer program on readable storage medium storing program for executing, and computer program is held by processor
The step of active blink detection method of above method embodiment is realized when row.
The readable storage medium storing program for executing be specifically as follows USB flash disk, mobile hard disk, read-only memory (Read-Only Memory,
ROM), the various program storage generations such as random access memory (Random Access Memory, RAM), magnetic or disk
The readable storage medium storing program for executing of code.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
Claims (10)
1. a kind of active blink detection method characterized by comprising
Utilize the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and eyeball designated position corresponding second
Infrared detection value;
The detection difference between the first infrared detection value and the second infrared detection value is calculated, and detects the exhausted of difference for described
To value as blink parameter;
Obtain the blink duration that the blink parameter is greater than blink threshold value;
It is greater than blink duration threshold value in the blink duration, determines and occur actively blinking.
2. active blink detection method according to claim 1, which is characterized in that described to acquire eye using infrared sensor
The corresponding first infrared detection value of all skin and the corresponding second infrared detection value in eyeball designated position, comprising:
The first infrared detection value is acquired using the first infrared sensor that pickup area is the periocualr skin;
It is that corresponding second infrared sensor in eyeball designated position acquires the second infrared detection value using pickup area.
3. active blink detection method according to claim 2, which is characterized in that described to be referred to using pickup area for eyeball
Positioning sets corresponding second infrared sensor and acquires the second infrared detection value, comprising:
Infrared detection is carried out using the white of the eye or pupil position of second infrared sensor to eyeball, it is infrared to obtain described second
Detected value.
4. active blink detection method according to claim 1, which is characterized in that the process of the blink threshold value is obtained,
Include:
Utilize the corresponding third infrared detection value of periocualr skin described under infrared sensor acquisition closed-eye state and eyeball
The corresponding 4th infrared detection value in designated position;
The eye closing difference for calculating the third infrared detection value and the 4th infrared detection value, by the absolute of the eye closing difference
Value is used as the blink threshold value.
5. active blink detection method according to claim 1, which is characterized in that obtain the mistake of the blink duration threshold value
Journey, comprising:
The duration data that the people of acquisition specified quantity blinks naturally;
The duration data is counted, nature blink maximum time is obtained;
Using the maximum time of blink naturally as the blink duration threshold value.
6. active blink detection method according to claim 1, which is characterized in that further include:
When determining that appearance is actively blinked, then control instruction corresponding with actively blinking is run, to control augmented reality equipment
Or intelligent glasses.
7. active blink detection method according to any one of claims 1 to 6, which is characterized in that obtain the blink ginseng
Number is greater than the blink duration of blink threshold value, comprising:
The blink parameter is continued to monitor, the blink duration is obtained.
8. a kind of active blink detection device characterized by comprising
Infrared detection module, fingerprint identification module, for utilizing the corresponding first infrared detection value of infrared sensor acquisition periocualr skin and eyeball
The corresponding second infrared detection value in designated position;
Blink parameter acquisition module, it is poor for calculating the detection between the first infrared detection value and the second infrared detection value
Value, and using the absolute value of the detection difference as blink parameter;
Blink parameter monitoring module, the blink duration for being greater than blink threshold value for obtaining the blink parameter;
Determining module of actively blinking determines for being greater than blink duration threshold value in the blink duration and occurs actively blinking.
9. a kind of active blink detection system characterized by comprising
Infrared sensor and the MCU being connected with the infrared sensor output end, the MCU are stored with computer program, institute
When stating computer program and being executed by MCU, realize as described in any one of claim 1 to 7 the step of active blink detection method.
10. a kind of readable storage medium storing program for executing, which is characterized in that be stored with computer program, the meter on the readable storage medium storing program for executing
It is realized when calculation machine program is executed by processor as described in any one of claim 1 to 7 the step of active blink detection method.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910882669.0A CN110477927A (en) | 2019-09-18 | 2019-09-18 | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910882669.0A CN110477927A (en) | 2019-09-18 | 2019-09-18 | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110477927A true CN110477927A (en) | 2019-11-22 |
Family
ID=68558491
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910882669.0A Pending CN110477927A (en) | 2019-09-18 | 2019-09-18 | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110477927A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111281403A (en) * | 2020-03-09 | 2020-06-16 | 西安交通大学 | Fine-grained human body fatigue detection method and device based on embedded equipment |
CN112329504A (en) * | 2020-04-15 | 2021-02-05 | 深圳Tcl新技术有限公司 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
CN113331824A (en) * | 2021-04-20 | 2021-09-03 | 北京九辰智能医疗设备有限公司 | Blink judgment method and device based on laser measurement |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104272168A (en) * | 2012-04-02 | 2015-01-07 | 谷歌公司 | Proximity sensing for wink detection |
CN104757981A (en) * | 2015-03-16 | 2015-07-08 | 于莹光 | Method and device for high-sensitively receiving and transmitting integrated infrared detection of driver's fatigue |
CN105006105A (en) * | 2015-08-04 | 2015-10-28 | 三峡大学 | Eye state identification device and eye state identification method based on infrared detection |
CN105759945A (en) * | 2014-12-17 | 2016-07-13 | 富泰华工业(深圳)有限公司 | Wearable equipment control system and method |
US20160225244A1 (en) * | 2015-01-29 | 2016-08-04 | Vigo Technologies Inc. | Infrared sensing of eye and eyelid movements to detect drowsiness |
-
2019
- 2019-09-18 CN CN201910882669.0A patent/CN110477927A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104272168A (en) * | 2012-04-02 | 2015-01-07 | 谷歌公司 | Proximity sensing for wink detection |
CN105759945A (en) * | 2014-12-17 | 2016-07-13 | 富泰华工业(深圳)有限公司 | Wearable equipment control system and method |
US20160225244A1 (en) * | 2015-01-29 | 2016-08-04 | Vigo Technologies Inc. | Infrared sensing of eye and eyelid movements to detect drowsiness |
CN104757981A (en) * | 2015-03-16 | 2015-07-08 | 于莹光 | Method and device for high-sensitively receiving and transmitting integrated infrared detection of driver's fatigue |
CN105006105A (en) * | 2015-08-04 | 2015-10-28 | 三峡大学 | Eye state identification device and eye state identification method based on infrared detection |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111281403A (en) * | 2020-03-09 | 2020-06-16 | 西安交通大学 | Fine-grained human body fatigue detection method and device based on embedded equipment |
CN111281403B (en) * | 2020-03-09 | 2021-08-13 | 西安交通大学 | Fine-grained human body fatigue detection method and device based on embedded equipment |
CN112329504A (en) * | 2020-04-15 | 2021-02-05 | 深圳Tcl新技术有限公司 | Door opening and closing state monitoring method, device, equipment and computer readable storage medium |
WO2021208986A1 (en) * | 2020-04-15 | 2021-10-21 | 深圳Tcl新技术有限公司 | Door opening/closing state monitoring method, device and apparatus, and computer readable storage medium |
CN113331824A (en) * | 2021-04-20 | 2021-09-03 | 北京九辰智能医疗设备有限公司 | Blink judgment method and device based on laser measurement |
CN113331824B (en) * | 2021-04-20 | 2023-09-26 | 北京九辰智能医疗设备有限公司 | Blink judgment method and device based on laser measurement |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104090659B (en) | Operating pointer based on eye image and Eye-controlling focus indicates control device | |
Kurylyak et al. | Detection of the eye blinks for human's fatigue monitoring | |
CN110477927A (en) | A kind of active blink detection method, apparatus, equipment and readable storage medium storing program for executing | |
CN103838378B (en) | A kind of wear-type eyes control system based on pupil identification positioning | |
CN102496005A (en) | Eye characteristic-based trial auxiliary study and judging analysis system | |
KR102096617B1 (en) | Driver drowsiness detection system using image and ppg data based on multimodal deep learning | |
CN104049761B (en) | Eye electro-detection method and eye electric detection means | |
CN107562213A (en) | Detection method, device and the wear-type visual device of visual fatigue state | |
CN104224204B (en) | A kind of Study in Driver Fatigue State Surveillance System based on infrared detection technology | |
CN112034977A (en) | Method for MR intelligent glasses content interaction, information input and recommendation technology application | |
CN107007255A (en) | Electronic type ophthalmic lens with sleep monitor | |
CN104820495B (en) | A kind of micro- Expression Recognition of exception and based reminding method and device | |
WO2016090376A1 (en) | Eye tracking via patterned contact lenses | |
Del Coco et al. | Study of mechanisms of social interaction stimulation in autism spectrum disorder by assisted humanoid robot | |
CN109376621A (en) | A kind of sample data generation method, device and robot | |
CN111307290A (en) | Non-contact type identity recognition and body temperature monitoring method and device applying iris recognition | |
CN105030244B (en) | The detection method and detecting system of a kind of blink | |
CN107730834A (en) | A kind of antifatigue Intelligent worn device being combined based on attitude detection with image recognition | |
CN113887386B (en) | Fatigue detection method based on multi-feature fusion of deep learning and machine learning | |
Riztiane et al. | Driver drowsiness detection using visual information on android device | |
CN110174937A (en) | Watch the implementation method and device of information control operation attentively | |
CN109549649A (en) | A kind of movable wearable device of detection neck | |
CN107209936A (en) | Message processing device, information processing method and program | |
CN202472688U (en) | Inquest-assisting judgment and analysis meter based on eyeball characteristic | |
JP2016146978A (en) | Drowsiness detection device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20201012 Address after: 261031 north of Yuqing street, east of Dongming Road, high tech Zone, Weifang City, Shandong Province (Room 502, Geer electronic office building) Applicant after: GoerTek Optical Technology Co.,Ltd. Address before: 266100 Qingdao, Laoshan District, North House Street investment service center room, Room 308, Shandong Applicant before: GOERTEK TECHNOLOGY Co.,Ltd. |