CN104850217A - Human eye movement monitoring device, method and equipment - Google Patents
Human eye movement monitoring device, method and equipment Download PDFInfo
- Publication number
- CN104850217A CN104850217A CN201410056748.3A CN201410056748A CN104850217A CN 104850217 A CN104850217 A CN 104850217A CN 201410056748 A CN201410056748 A CN 201410056748A CN 104850217 A CN104850217 A CN 104850217A
- Authority
- CN
- China
- Prior art keywords
- human eye
- monitoring
- action
- reflected signal
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The application discloses a human eye movement monitoring device, a human eye movement monitoring method and equipment, which are used for solving the technical problem that electronic equipment cannot be used for providing a control mode of non-touch input control instruction to a user in the prior art, wherein the monitoring device comprises a monitoring main body; a fixing device which is connected with the monitoring main body and is used for fixing the monitoring main body on a monitoring position where the monitoring main body could be used for monitoring the human eye of an user; a first transmitting unit which is arranged at a first position of the monitoring main body; a first receiving unit which is arranged at a second position of the monitoring main body different from the first position, wherein the first receiving unit is used for receiving a first monitoring signal reflected by the human eye to form a first reflected signal after the first transmitting unit is used for transmitting the first monitoring signal to the human eye, and determining a first parameter value of the first reflected signal via the monitoring main body, and determining the movement of the human eye corresponding to the first reflected signal based on the first parameter value.
Description
Technical field
The application relates to electronic technology field, particularly a kind of human eye action monitoring device, method and apparatus.
Background technology
Along with the fast development of electronic technology, major part electronic equipment is provided with abundant application function, can meet the various user demands of user, and electronic equipment is also for user provides human-computer interaction function, controls electronic equipment to enable user and open, run and stop each application.
Such as, televisor (or on telepilot of televisor) is provided with hardware controls button, and as power switch is used for controlling the unlatching of electronic equipment or closedown, turntable button is used for the conversion of the channel controlling electronic equipment, Sound control button is used for controlling the size of output volume, etc.And for example, the display screen of smart mobile phone is provided with software controlled button, different display interfaces having different software controls, realizing the control etc. to electronic equipment, for providing the selection of multiple interactive mode between user and electronic equipment for user's touch control display screen.
But present inventor is in the process realizing invention technical scheme in the embodiment of the present application, find that above-mentioned technology at least exists following technical matters:
When needs control electronic equipment, user must the specific control knob (comprising hardware control button or software controls button) of hand electric shock subset, could send steering order to electronic equipment; Relative, when user some time cannot touch above-mentioned specific control knob because both hands are busy with other thing time, just to electronic equipment input control information, the control to electronic equipment cannot be realized.That is, there is electronic equipment cannot provide the control mode of the input control order of non-touch-control technical matters for user in prior art, for the use of user is made troubles.
Summary of the invention
The embodiment of the present application is by providing a kind of human eye action monitoring device, method and apparatus, the technical matters of the control mode of the input control order of non-touch-control cannot be provided for user in order to solve the electronic equipment existed in prior art, achieve electronic equipment judges user's human eye action by monitoring, just the steering order that user controls electronic equipment can be obtained, and respond the user demand that this steering order meets user, for user provides great convenience to the control of electronic equipment.
First aspect, the embodiment of the present application provides a kind of human eye action monitoring device, comprising:
One monitoring body;
One stationary installation, is connected with described monitoring body, for described monitoring body being fixed on the monitoring location that the human eye of described monitoring body to a user can be made to monitor;
First transmitter unit, is arranged in the primary importance of described monitoring body;
First receiving element, is arranged in the second place different from described primary importance of described monitoring body;
Wherein, after described first transmitter unit launches the first monitor signal to described human eye, the first reflected signal that described first receiving element receives the first monitor signal described in described people's eye reflex and formed, and determined the first parameter value of described first reflected signal by described monitoring body, and determine the human eye action corresponding with described first reflected signal of described human eye based on described first parameter value.
Optionally, the first position of described monitoring body is provided with through hole;
Wherein, when described monitoring body is positioned at described monitoring location, described first position is relative with described human eye, and to make described monitoring body when monitoring described human eye, the sight line of described human eye can pass described through hole.
Optionally, described monitoring device also comprises:
Perspective body, is arranged on described first position of described monitoring body;
Wherein, when described monitoring body is positioned at described monitoring location, described perspective body is relative with described human eye, and to make described monitoring body when monitoring described human eye, the sight line of described human eye can pass described perspective body.
Optionally, described monitoring device also comprises:
Second transmitter unit, is arranged on the 3rd position different from described primary importance of described monitoring body;
Second receiving element, is arranged on the 4th position relative with described 3rd position of described monitoring body;
Wherein, described first transmitter unit and described first receiving element are for monitoring the first human eye of described human eye, and described second transmitter unit and described second receiving element are for monitoring second human eye different from described first human eye of described human eye.
Optionally, described monitoring device also comprises: the first camera, is arranged on the 5th position of described monitoring body, for carrying out image information collecting according to described human eye action.
Optionally, described monitoring device also comprises: second camera, is arranged on the 6th position different from described 5th position of described monitoring body, for carrying out image information collecting according to described human eye action.
Optionally, described monitoring device also comprises: alarm unit, for when needs, sends alarm signal.
Second aspect, the embodiment of the present application additionally provides a kind of human eye action monitoring method, and be applied in a human eye action monitoring equipment, described method comprises:
When needing to monitor the human eye of a user, send the first monitor signal to described human eye;
Receive the first monitor signal described in described people's eye reflex and the first reflected signal formed;
Determine the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
Optionally, described when needing to monitor the human eye of a user, send the first monitor signal to described human eye, specifically comprise:
Obtain the first operation for making the first mode of operation of described monitoring equipment be in opening, wherein, when described monitoring equipment works in described first mode of operation, whether described monitoring equipment is in tired shape body for monitoring described human eye;
Respond described first operation, control described first mode of operation and be in opening;
Send described first monitor signal to described human eye.
Optionally, described the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the first signal energy of described first reflected signal;
Judge whether described first signal energy is less than the first preset energy, obtains the first judged result;
When the first judged result is for being, obtain the first reception number of times receiving described first reflected signal in the first preset time period;
Judge whether described first reception number of times is greater than the first preset times, obtains the second judged result;
When the second judged result is for being, determine that described human eye action is show that described human eye is in the human eye action of fatigue state.
Optionally, described determine described human eye action be show that described human eye is in the human eye action of fatigue state after, described method also comprises:
The alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
Optionally, described the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the second reception number of times receiving described first reflected signal in the second Preset Time;
Judge that described second receives number of times and whether meet described first pre-conditioned, obtain the 3rd judged result;
When described 3rd judged result is for being, determine that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
Optionally, determine that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, described method also comprises described:
The image acquisition units controlling described monitoring equipment is in opening.
Optionally, after the image acquisition units of the described monitoring equipment of described control is in opening, described method also comprises:
In the 3rd preset time period, obtain the secondary signal energy of the first reflected signal;
Judge that whether described secondary signal energy meets second pre-conditioned, obtain the 4th judged result;
When described 4th judged result is for being, determine that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
Control described image acquisition units and be in closed condition.
The third aspect, the embodiment of the present application additionally provides a kind of human eye action monitoring equipment, comprising:
First sending module, for when needing to monitor the human eye of a user, sends the first monitor signal to described human eye;
First receiver module, the first reflected signal formed for receiving the first monitor signal described in described people's eye reflex;
First determination module, for determining the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
Optionally, described first sending module, specifically comprises:
First obtains submodule, for obtaining the first operation for making the first mode of operation of described monitoring equipment be in opening, wherein, when described monitoring equipment works in described first mode of operation, whether described monitoring equipment is in tired shape body for monitoring described human eye;
First implementation sub-module, for responding described first operation, controlling described first mode of operation and being in opening;
First sends submodule, for sending described first monitor signal to described human eye.
Optionally, described first determination module, specifically comprises:
Second obtains submodule, for obtaining the first signal energy of described first reflected signal;
First judges submodule, for judging whether described first signal energy is less than the first preset energy, obtains the first judged result;
3rd obtains submodule, for when the first judged result is for being, obtains the first reception number of times receiving described first reflected signal in the first preset time period;
Second judges submodule, for judging whether described first reception number of times is greater than the first preset times, obtains the second judged result;
First determines submodule, for when the second judged result is for being, determines that described human eye action is show that described human eye is in the human eye action of fatigue state.
Optionally, described monitoring equipment, also comprises:
First control module, for described first determine submodule determine described human eye action be show that described human eye is in the human eye action of fatigue state after, the alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
Optionally, described first determination module, specifically comprises:
4th obtains submodule, for obtaining the second reception number of times receiving described first reflected signal in the second Preset Time;
Second judges submodule, for judging that described second receives number of times and whether meet described first pre-conditioned, obtains the 3rd judged result;
Second determines submodule, for when described 3rd judged result is for being, determines that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
Optionally, described monitoring equipment also comprises:
Second control module, for determining that submodule determines that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, the image acquisition units controlling described monitoring equipment is in opening described second.
Optionally, described monitoring equipment also comprises:
First acquisition module, after the image acquisition units for controlling described monitoring equipment in the first control module is in opening, in the 3rd preset time period, obtains the secondary signal energy of the first reflected signal;
First judge module, second pre-conditioned for judging that whether described secondary signal energy meets, obtain the 4th judged result;
Second determination module, for when described 4th judged result is for being, determines that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
3rd control module, is in closed condition for controlling described image acquisition units.
The one or more technical schemes provided in the embodiment of the present application, at least have following technique effect or advantage:
Due in the embodiment of the present application, by proposing a kind of human eye action monitoring device, comprise, a monitoring body; One stationary installation be connected with monitoring body, for being fixed on the position that the human eye of described monitoring body to a user can be made to monitor by monitoring body; First transmitter unit, is arranged in the primary importance of described monitoring body; First receiving element, is arranged in the second place different from described primary importance of described monitoring body; Wherein, after described first transmitter unit launches the first monitor signal to described human eye, the first reflected signal that described first receiving element receives the first monitor signal described in described people's eye reflex and formed, and determined the first parameter value of described first reflected signal by described monitoring body, and determine the human eye action corresponding with described first reflected signal of described human eye based on described first parameter value.That is, by monitoring user's human eye action, and based on the first parameter value determination human eye action obtained, and the steering order parsed corresponding to human eye action, solve the electronic equipment existed in prior art cannot provide the control mode of the input control order of non-touch-control technical matters for user, achieve electronic equipment judges user's human eye action by monitoring, just the steering order that user controls electronic equipment can be obtained, and respond the user demand that this steering order meets user, for user provides great convenience to the control of electronic equipment.
Accompanying drawing explanation
The structural representation of a kind of human eye action monitoring device that Fig. 1 provides for the embodiment of the present application;
The method flow diagram of a kind of human eye action monitoring device that Fig. 2 provides for the embodiment of the present application;
The image acquisition units scan mode schematic diagram of the monitoring equipment that Fig. 3 A-Fig. 3 B provides for the embodiment of the present application;
The structured flowchart of a kind of human eye action monitoring equipment that Fig. 4 provides for the embodiment of the present application.
Embodiment
The embodiment of the present application is by providing a kind of human eye action monitoring device, method and apparatus, the technical matters of the control mode of the input control order of non-touch-control cannot be provided for user in order to solve the electronic equipment existed in prior art, achieve electronic equipment judges user's human eye action by monitoring, just the steering order that user controls electronic equipment can be obtained, and respond the user demand that this steering order meets user, for user provides great convenience to the control of electronic equipment.
Technical scheme in the embodiment of the present application is for solving the problem, and general thought is as follows:
The embodiment of the present application provides a kind of human eye action monitoring device, comprising: a monitoring body; One stationary installation, is connected with described monitoring body, for described monitoring body being fixed on the monitoring location that the human eye of described monitoring body to a user can be made to monitor; First transmitter unit, is arranged in the primary importance of described monitoring body; First receiving element, is arranged in the second place different from described primary importance of described monitoring body; Wherein, after described first transmitter unit launches the first monitor signal to described human eye, the first reflected signal that described first receiving element receives the first monitor signal described in described people's eye reflex and formed, and determined the first parameter value of described first reflected signal by described monitoring body, and determine the human eye action corresponding with described first reflected signal of described human eye based on described first parameter value.
Visible, due in the embodiment of the present application, by utilizing a stationary installation, one monitoring body is fixed on the monitoring location that can monitor the human eye of a user, user's human eye action is monitored, and respectively by the first transmitter unit and the first receiving element, send and receive monitor signal, obtain the first parameter value by the monitor signal after people's eye reflex, and based on the first parameter value determination human eye action obtained, and the steering order parsed corresponding to human eye action, solve the electronic equipment existed in prior art cannot provide the control mode of the input control order of non-touch-control technical matters for user, achieve electronic equipment judges user's human eye action by monitoring, just the steering order that user controls electronic equipment can be obtained, and respond the user demand that this steering order meets user, for user provides great convenience to the control of electronic equipment.
In order to better understand technique scheme, below in conjunction with Figure of description and concrete embodiment, technique scheme is described in detail, the specific features being to be understood that in the embodiment of the present application and embodiment is the detailed description to technical scheme, instead of the restriction to technical scheme, when not conflicting, the technical characteristic in the embodiment of the present application and embodiment can combine mutually.
Embodiment one
Please refer to Fig. 1, the embodiment of the present application provides a kind of human eye action monitoring device, comprising:
One monitoring body 10;
One stationary installation 20, is connected with described monitoring body 10, for described monitoring body 10 being fixed on the monitoring location that the human eye 301 of described monitoring body 10 to a user can be made to monitor;
First transmitter unit 401, is arranged in the primary importance of described monitoring body 10;
First receiving element 501, is arranged in the second place different from described primary importance of described monitoring body 10;
Wherein, after described first transmitter unit 301 launches the first monitor signal to described human eye 301, described first receiving element 501 receives described human eye 301 and reflects described first monitor signal and the first reflected signal formed, and determined the first parameter value of described first reflected signal by described monitoring body 10, and determine the human eye action corresponding with described first reflected signal of described human eye 301 based on described first parameter value.
In specific implementation process, first transmitter unit 401 is specifically as follows an infrared transmitter, first receiving element 501 can be the infrared ray sensor film corresponding to the Infrared wavelength that infrared transmitter is launched, and is provided with miniature built-in power supply in the first transmitter unit 401 and the first receiving element 501.When monitoring user's human eye action, infrared transmitter launches infrared monitoring signal to human eye position, when human eye be in open state time, infrared monitoring signal can carry out signal reflex by human eye eyeball, the reflected signal obtained after reflection is received by infrared ray sensor film, infrared ray sensor film, according to the reflected signal received, obtains reflected signal middle infrared (Mid-IR) energy value, and judges human eye action based on this energy value.
Such as, user A is when normal conditions eyes are opened, the reflected signal middle infrared (Mid-IR) energy of the monitor signal that the first receiving element can receive is X, when user A is in eyes closed, due to the biological nature of human eye eyelid, can diffuse reflection be there is in monitor signal through human eye eyelid, so the reflected signal middle infrared (Mid-IR) that receives of the first receiving element is little, and being designated as Y(also may be 0), wherein, X, Y are all more than or equal to 0, and Y is less than X.Based on the above characteristic to human eye reflected infrared monitor signal, the human eye action monitoring device in known the present embodiment, at least can judge following human eye action:
(1) according to the reflected signal received, the size degree that user's human eye is opened is judged
Concrete, when the first transmitter unit and the first receiving element in running order time, for the first transmitting element, the first monitor signal that the first transmitter unit is launched is constant; For the first receiving element, along with human eye opens the difference of situation, the energy value size of its reflected signal monitored is indefinite.Still for infrared monitoring signal monitoring, above-mentionedly to describe, when the eyes of user A are opened under normal conditions, the first Received signal strength middle infrared (Mid-IR) energy that first receiving element monitors is X, when user A eyes closed, the first Received signal strength middle infrared (Mid-IR) energy that the first receiving element receives is Y.
In specific implementation process, human eye action monitoring device in the embodiment of the present application has learning functionality, namely when a certain user has just brought into use this monitoring device, monitoring device can opened in situation to this user's human eye usually, the energy of the monitor signal of reflection is monitored, and obtains the first preset energy value X; And to user's human eye when closure state, the energy of the monitor signal of reflection is monitored, and obtains the second preset energy value Y; And X and Y is stored in the first receiving element.Further, in actual applications, when the first receiving element receives and the current energy value monitoring reflected signal is Z, by Z and X, Y are compared and can be learnt: as Z=X, judge that the human eye action of this user is as normally opening; As Y<Z<X, judge that the human eye action of this user is not as opening completely (little under namely opening degree compared with normal situation); As Z=Y, judge that the human eye action of this user is as closing.Wherein, but open state compared with normal situation lower hour when the eyes of user are in, linear ratio calculation can be carried out according to the current energy value Z that monitors and the first preset energy value X, thus know active user's human eye open degree, as as Z/X=2, so determine that eyes of user is in and partly open state.In addition, when the first receiving element monitor Z be greater than X time, still can judge that user's human eye action is as normally opening.
(2) according to the reflected signal received, the frequency that user's human eye is blinked is judged
Concrete, first receiving element is according to the energy value Z of the reflected signal monitored, compare with the second preset energy value Y, if after judgement obtains Z>Y, and then judge to obtain Z=Y, so determine that the human eye action of user is for action nictation, and when this obtains Z=Y, recording current time is the first moment t1, and then after judgement obtains Z>Y, when judging again to obtain Z=Y, record current time t2, then, calculate the difference in the second moment and the first moment, just frequency of wink can be obtained based on this difference.Certainly, in specific implementation process, be not only determine the frequency of wink of this user by the time interval of twice eye closing of arbitrary neighborhood, in order to make the frequency of wink that obtains more accurate, by calculating a preset time period T(as 60s) in, user number of winks N altogether, then, just can obtain frequency of wink by N/T.
Same, in specific implementation process, human eye action monitoring device has learning functionality, and when a certain user has just brought into use this monitoring device, monitoring device can calculate user's human eye frequency of wink under normal conditions, obtains predeterminated frequency P.Further, in actual applications, user can from main control frequency of wink, or when eyes of user is tired, frequency of wink can accelerate relative to normal conditions, that is, the actual frequency of wink of user may be not equal to predeterminated frequency P, and the current frequency of wink monitoring user when the first receiving element is Q.Known by comparing P and Q: as P>Q, judge that user's human eye action is as action of blinking at a slow speed, as P=Q, judge that user's human eye action is normal blinking actions; As P<Q, judge that user's human eye action is rapid eye movements action.
In above-mentioned observation process, the first transmitter unit 401 and the first receiving element 501 can be monitor for a certain eyes in user's eyes, may also be and monitor for two eyes of user simultaneously.
Further, the above-mentioned human eye action of user is associated with the steering order of electronic equipment, so when electronic equipment detects relevant human eye action, the steering order corresponding to this human eye action can be parsed, with when performing this instruction, realize the object controlling electronic equipment.As when user's human eye action is rapid eye movements, defining this human eye action is the operation controlling unlocking electronic equipment, and so when electronic equipment monitoring is described rapid eye movements action to human eye action, electronic equipment enters opening by closed condition.
Above the principle of work of human eye action monitoring device in the embodiment of the present application is introduced, below the structure of this monitoring device is specifically introduced.
Concrete, still please refer to Fig. 1, is solid-state material under monitoring the normal temperature such as body 10 is plastic cement, metal (being preferably light-weight metal), resin; Stationary installation 20 material can be above-mentioned is equally solid-state material at normal temperatures, and it can be fixedly connected with monitoring body 10, or carries out on-fixed connection by such as buckle, screw etc.As shown in Figure 1, the first end of stationary installation 20 is connected with monitoring body 10, its second end 202 relative with first end 201 is bending, so that when this monitoring device is monitored human eye action, on the head (as people's ear) that the second end 202 can be fixed on user or neck.The position of the first transmitter unit 401 and the first receiving element 402 can exchange, and namely the first transmitter unit 401 is arranged in the second place, and the first receiving element 501 is arranged in primary importance.Wherein, preferably situation is that primary importance and the second place are symmetrical.First transmitter unit 401 and the first receiving element 501 can be fixedly connected with (as by connected modes such as stickum are bonding) on monitoring body 10, also can be that non-to be fixedly connected with (as by connected modes such as clampings) first-class at monitoring body 10.
In addition, when monitoring device be in the monitoring location of human eye action monitoring is carried out to user time, when the first end 201 of stationary installation is in user's visual line of sight, first transmitter unit 401 or the first receiving element 501 can be arranged on the first end 201 of stationary installation, as long as ensure when the first transmitter unit 401 is arranged on first end 201, first monitor signal can arrive user's human eye 30, or when the first transmitter unit 501 is arranged on first end 201, the first transmitter unit 501 can receive the monitor signal that human eye 30 is launched.
In specific implementation process, please continue to refer to Fig. 1, in order to make this monitoring device when monitoring user's human eye action, can not stop the sight line of user, namely user's human eye can normally work, and the first position of described monitoring body 10 is provided with through hole 60;
Wherein, when described monitoring body 10 is positioned at described monitoring location, described first position is relative with described human eye 30, and to make described monitoring body 10 when monitoring described human eye 30, the sight line of described human eye 30 can pass described through hole 60.
In specific implementation process, because user has two eyes, a rectangular through-hole can be dug at the first position, make the sight line of user's eyes all can pass this rectangular through-hole; Or dig two less through holes at the first position for user's images of left and right eyes is corresponding respectively, make user's eyes sight line can be each passed through two less through holes.Certainly, the shape of through hole does not limit, only otherwise affect the normal monitoring of the first transmitter unit and the first receiving element.
Further, in order to make this monitoring device, there is good appearance, and when eyes of user be in protected and by external interference less, as when the interference to human eye such as the grains of sand or wind-force is less, user's human eye action is monitored, described monitoring device also comprises: perspective body 70, is arranged on described first position of described monitoring body 10;
Wherein, when described monitoring body 10 is positioned at described monitoring location, described perspective body 70 is relative with described human eye 30, and to make described monitoring body 10 when monitoring described human eye 30, the sight line of described human eye 30 can pass described perspective body 70.
Please continue to refer to Fig. 1, this human eye action monitoring device is specially the appearance design being similar to common spectacles, and wherein, monitoring body 10 is similar to the framework part of eyeglasses frame, stationary installation 20 is similar to the mirror foot section of eyeglasses frame, and perspective body 70 is similar to the optic portion of eyeglasses frame.First transmitter unit 401 and/or the first receiving element 501 can be arranged on perspective body 70, only otherwise block user's human eye sight.
Further, as shown in Figure 1, in order to pass through to monitor the eyes of user respectively simultaneously, make human eye action monitoring result more accurate, described monitoring device also comprises:
Second transmitter unit 402, is arranged on the 3rd position different from described primary importance of described monitoring body 10;
Second receiving element 502, is arranged on the 4th position relative with described 3rd position of described monitoring body 10;
Wherein, described first transmitter unit 401 and described first receiving element 501 are for monitoring the first human eye 301 of described human eye 30, and described second transmitter unit 402 and described second receiving element 502 are for monitoring second human eye 302 different from described first human eye 301 of described human eye.
In specific implementation process, image acquisition can be carried out to make human eye action monitoring device, described monitoring device also comprises: the first camera 801, is arranged on the 5th position of described monitoring body 10, for carrying out image information collecting according to described human eye action.Concrete, the first camera 801 is arranged on the position can not blocking user's sight line of monitoring body 10, as upper marginal position, lower edge position etc.
Further, in order to make the image collecting function of human eye action monitoring device more advanced, as wider in carried out the scope of image acquisition or image acquisition to same target more quickly, described monitoring device also comprises: second camera 802, be arranged on the 6th position different from described 5th position of described monitoring body 10, for carrying out image information collecting according to described human eye action.Wherein, second camera 802 is arranged on the position can not blocking user's sight line of monitoring body 10 equally, concrete, the first camera 801 can be arranged on the side relative with the left eye of user's human eye, and second camera 802 can be arranged on the side relative with the right eye of user's human eye.
In specific implementation process, first camera 801 and second camera 802 also can be arranged in stationary installation 20, make this human eye action monitoring device when being fixed on described monitoring location by stationary installation 20, first camera 801 and second camera 802 can towards user's face towards front, thus image acquisition can be carried out to the object in user front (as bar code etc.).
In specific implementation process, in order to make this human eye action monitoring device have alarm function, as audio output function, vibrating function etc., described monitoring device also comprises: alarm unit, for when needs, sends alarm signal.
Embodiment two
Please refer to Fig. 2, the embodiment of the present application provides a kind of human eye action monitoring method, and be applied in a human eye action monitoring equipment, described method comprises:
S101: when needing to monitor the human eye of a user, sends the first monitor signal to described human eye;
S102: receive the first monitor signal described in described people's eye reflex and the first reflected signal formed;
S103: the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
Concrete, the human eye action monitoring method in the embodiment of the present application realize principle, with human eye action monitoring device in embodiment one to realize principle identical, repeat no longer one by one here.
Human eye action monitoring method in the present embodiment specifically may be used for but is not limited to human eye fatigue monitoring and image acquisition controls two aspects.That is, the monitoring equipment applying human eye action monitoring method in the application at least comprises two kinds of mode of operations, namely under a kind of mode of operation, carries out human eye fatigue monitoring, in another operation mode, carries out image acquisition control.
(1) human eye fatigue monitoring is applied to
In specific implementation process, during in order to have multiple-working mode (i.e. multiple monitoring purposes) at human eye action monitoring equipment, can therefrom determine a kind of mode of operation, that monitoring equipment can be monitored user's human eye degree of fatigue in this operating mode, step S101: when needing to monitor the human eye of a user, send the first monitor signal to described human eye, specifically comprise:
Obtain the first operation for making the first mode of operation of described monitoring equipment be in opening, wherein, when described monitoring equipment works in described first mode of operation, whether described monitoring equipment is in fatigue state for monitoring described human eye;
Respond described first operation, control described first mode of operation and be in opening;
Send described first monitor signal to described human eye.
That is, when user will use the human eye fatigue monitoring function of monitoring equipment, user needs first mode of operation of opening monitoring equipment.Concrete, monitoring equipment being provided with the hardware button corresponding to the first mode of operation, to enable user by controlling this hardware button, opening the first mode of operation of this monitoring equipment; Or user monitoring equipment is fixed on can carry out on the monitoring location of human eye action monitoring active user time, the first mode of operation of monitoring equipment is opened automatically.
Further, in order to know whether the current human eye action monitored is show that the human eye of user is in fatigue state, step S103: the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the first signal energy of described first reflected signal;
Judge whether described first signal energy is less than the first preset energy, obtains the first judged result;
When the first judged result is for being, obtain the first reception number of times receiving described first reflected signal in the first preset time period;
Judge whether described first reception number of times is greater than the first preset times, obtains the second judged result;
When the second judged result is for being, determine that described human eye action is show that described human eye is in the human eye action of fatigue state.
When human eye is in frazzle, the degree that human eye is opened can be less than the degree that human eye in normal (non-fatigue) situation is opened, and meanwhile, the frequency of wink of user can increase, and utilizes this feature of human eye just, judges whether human eye is in fatigue state.Concrete, the human eye monitoring device in conjunction with the embodiments in realize principle known, the first preset energy for when eyes of user is opened under normal conditions, signal energy (as infrared energy) in the first Received signal strength that the first receiving element monitors.First judge in the current human eye reflected signal monitored, whether signal energy is less than the first preset energy, when judged result is for being, then can determine human eye current open degree be less than under normal circumstances open degree; Further, judge whether the first reception number of times of the first reflected signal received in the first preset time period is greater than the first preset times, namely judge in the first preset time period (as 60s), whether the current frequency of wink of eyes of user is greater than frequency of wink under normal conditions, and when judged result is for being, determine that described human eye action is show that described human eye is in the human eye action of fatigue state.
Further, in order to when monitoring user's human eye and being in fatigue state, warning user makes it regain consciousness, particularly when user drives to travel on a highway, it is this that to judge whether human eye is in the method for fatigue state by monitoring human eye action very useful, when monitoring user's human eye fatigue state, making user be in waking state by alarm unit, can reduce or alleviate the generation of traffic hazard.Described determine described human eye action be show that described human eye is in the human eye action of fatigue state after, described method also comprises:
The alarm unit (as vibrating device or audio devices etc.) controlling described monitoring equipment is in opening, is in waking state for warning described user.
(2) control of image acquisition units is applied to
In specific implementation process, in order to the image collecting function that can control monitoring equipment by specific human eye action (as rapid eye movements etc.) enters opening, described the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the second reception number of times receiving described first reflected signal in the second Preset Time;
Judge that described second receives number of times and whether meet described first pre-conditioned, obtain the 3rd judged result;
When described 3rd judged result is for being, determine that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
Concrete, namely second receives number of times reflects the frequency of wink of user in the second preset time period.Wherein, step: judge that second receives number of times and whether meet first pre-conditioned, specifically can be expressed as: judge whether current frequency of wink is greater than a predeterminated frequency value, as in 1s, the usual frequency of wink of user is 1 ~ 2 time, and monitoring equipment monitors the current frequency of wink of user in 1s when being 3 times, judge that user is as rapid eye movements action.
Further, in order to realize when monitoring equipment monitors the first action nictation, can image acquisition units being opened, determining that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, described method also comprises described:
The image acquisition units controlling described monitoring equipment is in opening.
Further again, in order to when the image acquisition units of monitoring equipment is in opening, close image acquisition units by the second human eye action monitored, after the image acquisition units of the described monitoring equipment of described control is in opening, described method also comprises:
In the 3rd preset time period, obtain the secondary signal energy of the first reflected signal;
Judge that whether described secondary signal energy meets second pre-conditioned, obtain the 4th judged result;
When described 4th judged result is for being, determine that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
Control described image acquisition units and be in closed condition.
Specifically, in the 3rd preset time period, as in 2s, under normal conditions, user can complete twice action nictation, in this process, receiving element mainly eyes of user be in open state time, the signal energy in reflected signal can be monitored, be designated as M, but in 2s when eyes of user is in closure state, signal energy in the reflected signal that receiving element monitors is very little, is designated as N, wherein, N must be less than M, M, N be more than or equal to zero number.Utilize this principle, judge whether the energy value transmitted that in preset time period, receiving element monitors is less than M, when judged result is for being, determine that human eye action is the second human eye action (as long-time closed action), and close image acquisition units based on the second human eye action.
In specific implementation process, human eye fatigue monitoring and image acquisition units can be controlled to combine, namely when judging that human eye is in non-fatigue state, monitoring equipment enters the second mode of operation, concrete, in the second operation mode, the human eye action that monitoring equipment monitors controls relevant to image acquisition units.
In addition, the second human eye action can be utilized as the human eye action of opening image acquisition units, same also can utilize the first human eye action as the human eye action of closing image acquisition units, also the first human eye action can be utilized simultaneously as the human eye action opening and closing image acquisition units, the second human eye action equally also can be utilized simultaneously as the human eye action opening and closing image acquisition units.Human eye action, except opening, closing, blink, also comprises goggle etc., as long as judge that obtaining human eye action all meets the present embodiment category by monitoring reflected signal energy.
Carry out scanning to be realized controlling image acquisition units by human eye action monitoring equipment, the first image acquisition units can the second image acquisition units can work simultaneously, realizes quicker, various scan mode.Concrete, the first image acquisition units and the second image acquisition units startup scan function is controlled by the action of monitor user ' human eye, such as namely start scan pattern when monitoring device monitors twice continuous rapid eye movements, eyes are simultaneously closed exits scan pattern etc.; Scan mode as shown in Figure 3 A and Figure 3 B simultaneously, in figure, the direction of arrow represents direction of scanning, wherein, Fig. 3 A represent two cameras respectively from by the two ends, left and right of sweep object simultaneously to interscan, Fig. 3 B represent two cameras respectively from by the two ends up and down of sweep object simultaneously to interscan, make sweep velocity quickness and high efficiency more.Certainly, the scan mode of dual camera is not limited to above two kinds.
Embodiment three
Based on same inventive concept, the embodiment of the present application also provides a kind of human eye action monitoring equipment, please refer to Fig. 4, specifically comprises:
First sending module 401, for when needing to monitor the human eye of a user, sends the first monitor signal to described human eye;
First receiver module 402, the first reflected signal formed for receiving the first monitor signal described in described people's eye reflex;
First determination module 403, for determining the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
In specific implementation process, during in order to have multiple-working mode (i.e. multiple monitoring purposes) at human eye action monitoring equipment, can therefrom determine a kind of mode of operation, that monitoring equipment can be monitored user's human eye degree of fatigue in this operating mode, described first sending module 401, specifically comprises:
First obtains submodule, for obtaining the first operation for making the first mode of operation of described monitoring equipment be in opening, wherein, when described monitoring equipment works in described first mode of operation, whether described monitoring equipment is in tired shape body for monitoring described human eye;
First implementation sub-module, for responding described first operation, controlling described first mode of operation and being in opening;
First sends submodule, for sending described first monitor signal to described human eye.
In order to know whether the current human eye action monitored is show that the human eye of user is in fatigue state, and described first determination module 403, specifically comprises:
Second obtains submodule, for obtaining the first signal energy of described first reflected signal;
First judges submodule, for judging whether described first signal energy is less than the first preset energy, obtains the first judged result;
3rd obtains submodule, for when the first judged result is for being, obtains the first reception number of times receiving described first reflected signal in the first preset time period;
Second judges submodule, for judging whether described first reception number of times is greater than the first preset times, obtains the second judged result;
First determines submodule, for when the second judged result is for being, determines that described human eye action is show that described human eye is in the human eye action of fatigue state.
Further, in order to when monitoring user's human eye and being in fatigue state, warning user makes it regain consciousness, particularly when user drives to travel on a highway, it is this that to judge whether human eye is in the method for fatigue state by monitoring human eye action very useful, when monitoring user's human eye fatigue state, making user be in waking state by alarm unit, can reduce or alleviate the generation of traffic hazard.Described monitoring equipment, also comprises:
First control module, for described first determine submodule determine described human eye action be show that described human eye is in the human eye action of fatigue state after, the alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
In order to the image collecting function that can control monitoring equipment by specific human eye action (as rapid eye movements etc.) enters opening, described first determination module, specifically comprises:
4th obtains submodule, for obtaining the second reception number of times receiving described first reflected signal in the second Preset Time;
Second judges submodule, for judging that described second receives number of times and whether meet described first pre-conditioned, obtains the 3rd judged result;
Second determines submodule, for when described 3rd judged result is for being, determines that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
Further, in order to realize when monitoring equipment monitors the first action nictation, can open image acquisition units, described monitoring equipment also comprises:
Second control module, for determining that submodule determines that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, the image acquisition units controlling described monitoring equipment is in opening described second.
Further again, in order to when the image acquisition units of monitoring equipment is in opening, close image acquisition units by the second human eye action monitored, described monitoring equipment also comprises:
First acquisition module, after the image acquisition units for controlling described monitoring equipment in the first control module is in opening, in the 3rd preset time period, obtains the secondary signal energy of the first reflected signal;
First judge module, second pre-conditioned for judging that whether described secondary signal energy meets, obtain the 4th judged result;
Second determination module, for when described 4th judged result is for being, determines that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
3rd control module, is in closed condition for controlling described image acquisition units.
According to description above, above-mentioned human eye action monitoring equipment is used for realizing above-mentioned human eye action monitoring method, so the course of work of this monitoring equipment is consistent with one or more embodiments of said method, has just repeated no longer one by one at this.
The one or more technical schemes provided in the embodiment of the present application, at least have following technique effect or advantage:
Due in the embodiment of the present application, by proposing a kind of human eye action monitoring device, comprise, a monitoring body; One stationary installation be connected with monitoring body, for being fixed on the position that the human eye of described monitoring body to a user can be made to monitor by monitoring body; First transmitter unit, is arranged in the primary importance of described monitoring body; First receiving element, is arranged in the second place different from described primary importance of described monitoring body; Wherein, after described first transmitter unit launches the first monitor signal to described human eye, the first reflected signal that described first receiving element receives the first monitor signal described in described people's eye reflex and formed, and determined the first parameter value of described first reflected signal by described monitoring body, and determine the human eye action corresponding with described first reflected signal of described human eye based on described first parameter value.That is, by monitoring user's human eye action, and based on the first parameter value determination human eye action obtained, and the steering order parsed corresponding to human eye action, solve the electronic equipment existed in prior art cannot provide the control mode of the input control order of non-touch-control technical matters for user, achieve electronic equipment judges user's human eye action by monitoring, just the steering order that user controls electronic equipment can be obtained, and respond the user demand that this steering order meets user, for user provides great convenience to the control of electronic equipment.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the process flow diagram of the method for the embodiment of the present invention, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing device produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
Specifically, computer program instructions corresponding to the human eye action monitoring method in the embodiment of the present application can be stored in CD, hard disk, on the storage mediums such as USB flash disk, when the computer program instructions corresponding with this monitoring method in storage medium is read by an electronic equipment or be performed, comprise the steps:
When needing to monitor the human eye of a user, send the first monitor signal to described human eye;
Receive the first monitor signal described in described people's eye reflex and the first reflected signal formed;
Determine the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
Optionally, store in described storage medium with step when needing to monitor the human eye of a user, send the first monitor signal to described human eye, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
Obtain the first operation for making first mode of operation whether being in fatigue state for monitoring described human eye of described monitoring equipment be in opening;
Respond described first operation, control described first mode of operation and be in opening;
Send described first monitor signal to described human eye.
Optionally, what store in described storage medium determines the first parameter value of described first reflected signal with step, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
Obtain the first signal energy of described first reflected signal;
Judge whether described first signal energy is less than the first preset energy, obtains the first judged result;
When the first judged result is for being, obtain the first reception number of times receiving described first reflected signal in the first preset time period;
Judge whether described first reception number of times is greater than the first preset times, obtains the second judged result;
When the second judged result is for being, determine that described human eye action is show that described human eye is in the human eye action of fatigue state.
Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: determining that described human eye action is show that described human eye is in after computer instruction corresponding to the human eye action of fatigue state is performed to be performed described, comprising the steps: when being performed
The alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
Optionally, what store in described storage medium determines the first parameter value of described first reflected signal with step, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, corresponding computer instruction, being specifically performed in process, specifically comprises the steps:
Obtain the second reception number of times receiving described first reflected signal in the second Preset Time;
Judge that described second receives number of times and whether meet described first pre-conditioned, obtain the 3rd judged result;
When described 3rd judged result is for being, determine that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: determining that described human eye action is that image collecting function for controlling described monitoring equipment is in after computer instruction corresponding to the first human eye action of opening is performed and is performed described, comprising the steps: when being performed
The image acquisition units controlling described monitoring equipment is in opening.
Optionally, other computer instruction is also stored in described storage medium, these computer instructions with step: being in after computer instruction corresponding to opening is performed in the image acquisition units of the described monitoring equipment of described control and being performed, comprising the steps: when being performed
In the 3rd preset time period, obtain the secondary signal energy of the first reflected signal;
Judge that whether described secondary signal energy meets second pre-conditioned, obtain the 4th judged result;
When described 4th judged result is for being, determine that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
Control described image acquisition units and be in closed condition.
Although describe the preferred embodiments of the present invention, those skilled in the art once obtain the basic creative concept of cicada, then can make other change and amendment to these embodiments.So claims are intended to be interpreted as comprising preferred embodiment and falling into all changes and the amendment of the scope of the invention.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (21)
1. a human eye action monitoring device, comprising:
One monitoring body;
One stationary installation, is connected with described monitoring body, for described monitoring body being fixed on the monitoring location that the human eye of described monitoring body to a user can be made to monitor;
First transmitter unit, is arranged in the primary importance of described monitoring body;
First receiving element, is arranged in the second place different from described primary importance of described monitoring body;
Wherein, after described first transmitter unit launches the first monitor signal to described human eye, the first reflected signal that described first receiving element receives the first monitor signal described in described people's eye reflex and formed, and determined the first parameter value of described first reflected signal by described monitoring body, and determine the human eye action corresponding with described first reflected signal of described human eye based on described first parameter value.
2. monitoring device as claimed in claim 1, it is characterized in that, the first position of described monitoring body is provided with through hole;
Wherein, when described monitoring body is positioned at described monitoring location, described first position is relative with described human eye, and to make described monitoring body when monitoring described human eye, the sight line of described human eye can pass described through hole.
3. monitoring device as claimed in claim 2, it is characterized in that, described monitoring device also comprises:
Perspective body, is arranged on described first position of described monitoring body;
Wherein, when described monitoring body is positioned at described monitoring location, described perspective body is relative with described human eye, and to make described monitoring body when monitoring described human eye, the sight line of described human eye can pass described perspective body.
4. the monitoring device as described in claim as arbitrary in claims 1 to 3, is characterized in that, described monitoring device also comprises:
Second transmitter unit, is arranged on the 3rd position different from described primary importance of described monitoring body;
Second receiving element, is arranged on the 4th position relative with described 3rd position of described monitoring body;
Wherein, described first transmitter unit and described first receiving element are for monitoring the first human eye of described human eye, and described second transmitter unit and described second receiving element are for monitoring second human eye different from described first human eye of described human eye.
5. the monitoring device as described in claim as arbitrary in claims 1 to 3, is characterized in that, described monitoring device also comprises: the first camera, is arranged on the 5th position of described monitoring body, for carrying out image information collecting according to described human eye action.
6. monitoring device as claimed in claim 5, it is characterized in that, described monitoring device also comprises: second camera, is arranged on the 6th position different from described 5th position of described monitoring body, for carrying out image information collecting according to described human eye action.
7. the monitoring device as described in claim as arbitrary in claims 1 to 3, is characterized in that, described monitoring device also comprises: alarm unit, for when needs, sends alarm signal.
8. a human eye action monitoring method, be applied in a human eye action monitoring equipment, described method comprises:
When needing to monitor the human eye of a user, send the first monitor signal to described human eye;
Receive the first monitor signal described in described people's eye reflex and the first reflected signal formed;
Determine the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
9. method as claimed in claim 8, is characterized in that, described when needing to monitor the human eye of a user, sends the first monitor signal to described human eye, specifically comprises:
Obtain the first operation for making first mode of operation whether being in fatigue state for monitoring described human eye of described monitoring equipment be in opening;
Respond described first operation, control described first mode of operation and be in opening;
Send described first monitor signal to described human eye.
10. method as claimed in claim 9, it is characterized in that, described the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the first signal energy of described first reflected signal;
Judge whether described first signal energy is less than the first preset energy, obtains the first judged result;
When the first judged result is for being, obtain the first reception number of times receiving described first reflected signal in the first preset time period;
Judge whether described first reception number of times is greater than the first preset times, obtains the second judged result;
When the second judged result is for being, determine that described human eye action is show that described human eye is in the human eye action of fatigue state.
11. methods as claimed in claim 10, is characterized in that, described determine described human eye action be show that described human eye is in the human eye action of fatigue state after, described method also comprises:
The alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
12. methods as claimed in claim 8, it is characterized in that, described the first parameter value determining described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye, specifically comprise:
Obtain the second reception number of times receiving described first reflected signal in the second Preset Time;
Judge that described second receives number of times and whether meet described first pre-conditioned, obtain the 3rd judged result;
When described 3rd judged result is for being, determine that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
13. methods as claimed in claim 12, is characterized in that, determine that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, described method also comprises described:
The image acquisition units controlling described monitoring equipment is in opening.
14. methods as claimed in claim 13, it is characterized in that, after the image acquisition units of the described monitoring equipment of described control is in opening, described method also comprises:
In the 3rd preset time period, obtain the secondary signal energy of the first reflected signal;
Judge that whether described secondary signal energy meets second pre-conditioned, obtain the 4th judged result;
When described 4th judged result is for being, determine that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
Control described image acquisition units and be in closed condition.
15. 1 kinds of human eye action monitoring equipments, comprising:
First sending module, for when needing to monitor the human eye of a user, sends the first monitor signal to described human eye;
First receiver module, the first reflected signal formed for receiving the first monitor signal described in described people's eye reflex;
First determination module, for determining the first parameter value of described first reflected signal, and described first parameter value meet first pre-conditioned time, determine the human eye action corresponding with described first reflected signal of described human eye.
16. monitoring equipments as claimed in claim 15, it is characterized in that, described first sending module, specifically comprises:
First obtains submodule, for obtaining the first operation for making first mode of operation whether being in fatigue state for monitoring described human eye of described monitoring equipment be in opening;
First implementation sub-module, for responding described first operation, controlling described first mode of operation and being in opening;
First sends submodule, for sending described first monitor signal to described human eye.
17. monitoring equipments as claimed in claim 15, it is characterized in that, described first determination module, specifically comprises:
Second obtains submodule, for obtaining the first signal energy of described first reflected signal;
First judges submodule, for judging whether described first signal energy is less than the first preset energy, obtains the first judged result;
3rd obtains submodule, for when the first judged result is for being, obtains the first reception number of times receiving described first reflected signal in the first preset time period;
Second judges submodule, for judging whether described first reception number of times is greater than the first preset times, obtains the second judged result;
First determines submodule, for when the second judged result is for being, determines that described human eye action is show that described human eye is in the human eye action of fatigue state.
18. monitoring equipments as claimed in claim 17, it is characterized in that, described monitoring equipment, also comprises:
First control module, for described first determine submodule determine described human eye action be show that described human eye is in the human eye action of fatigue state after, the alarm unit controlling described monitoring equipment is in opening, is in waking state for warning described user.
19. monitoring equipments as claimed in claim 15, it is characterized in that, described first determination module, specifically comprises:
4th obtains submodule, for obtaining the second reception number of times receiving described first reflected signal in the second Preset Time;
Second judges submodule, for judging that described second receives number of times and whether meet described first pre-conditioned, obtains the 3rd judged result;
Second determines submodule, for when described 3rd judged result is for being, determines that described human eye action is the first human eye action that image collecting function for controlling described monitoring equipment is in opening.
20. monitoring equipments as claimed in claim 19, it is characterized in that, described monitoring equipment also comprises:
Second control module, for determining that submodule determines that described human eye action is that after image collecting function for controlling described monitoring equipment is in the first human eye action of opening, the image acquisition units controlling described monitoring equipment is in opening described second.
21. monitoring equipments as claimed in claim 20, it is characterized in that, described monitoring equipment also comprises:
First acquisition module, after the image acquisition units for controlling described monitoring equipment in the first control module is in opening, in the 3rd preset time period, obtains the secondary signal energy of the first reflected signal;
First judge module, second pre-conditioned for judging that whether described secondary signal energy meets, obtain the 4th judged result;
Second determination module, for when described 4th judged result is for being, determines that described human eye action is the second human eye action being in closed condition for controlling described image collecting function;
3rd control module, is in closed condition for controlling described image acquisition units.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410056748.3A CN104850217A (en) | 2014-02-19 | 2014-02-19 | Human eye movement monitoring device, method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410056748.3A CN104850217A (en) | 2014-02-19 | 2014-02-19 | Human eye movement monitoring device, method and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104850217A true CN104850217A (en) | 2015-08-19 |
Family
ID=53849915
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410056748.3A Pending CN104850217A (en) | 2014-02-19 | 2014-02-19 | Human eye movement monitoring device, method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104850217A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106526863A (en) * | 2017-01-03 | 2017-03-22 | 京东方科技集团股份有限公司 | Glasses |
| CN107333177A (en) * | 2017-06-01 | 2017-11-07 | 梁小红 | A kind of intelligent television exits the method and device of played in full screen |
| CN109496309A (en) * | 2018-08-07 | 2019-03-19 | 深圳市汇顶科技股份有限公司 | Detection method, device and the equipment of fatigue state |
| CN117653350A (en) * | 2024-02-01 | 2024-03-08 | 科弛医疗科技(北京)有限公司 | Surgical robot and method for preventing fatigue of surgical robot |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141567A (en) * | 2006-09-08 | 2008-03-12 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101526719A (en) * | 2008-03-07 | 2009-09-09 | 欧姆龙株式会社 | Measurement device and method, imaging device, and program |
| CN102068237A (en) * | 2004-04-01 | 2011-05-25 | 威廉·C·托奇 | Controllers and Methods for Monitoring Eye Movement, System and Method for Controlling Calculation Device |
| WO2013117999A1 (en) * | 2012-02-06 | 2013-08-15 | Sony Ericsson Mobile Communications Ab | Gaze tracking with projector |
| CN103499886A (en) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
-
2014
- 2014-02-19 CN CN201410056748.3A patent/CN104850217A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102068237A (en) * | 2004-04-01 | 2011-05-25 | 威廉·C·托奇 | Controllers and Methods for Monitoring Eye Movement, System and Method for Controlling Calculation Device |
| CN101141567A (en) * | 2006-09-08 | 2008-03-12 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101526719A (en) * | 2008-03-07 | 2009-09-09 | 欧姆龙株式会社 | Measurement device and method, imaging device, and program |
| WO2013117999A1 (en) * | 2012-02-06 | 2013-08-15 | Sony Ericsson Mobile Communications Ab | Gaze tracking with projector |
| CN103499886A (en) * | 2013-09-30 | 2014-01-08 | 北京智谷睿拓技术服务有限公司 | Imaging device and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106526863A (en) * | 2017-01-03 | 2017-03-22 | 京东方科技集团股份有限公司 | Glasses |
| US10334212B2 (en) | 2017-01-03 | 2019-06-25 | Boe Technology Group Co., Ltd. | Memory auxiliary device and method, spectacle frame and pair of spectacles |
| CN106526863B (en) * | 2017-01-03 | 2019-10-01 | 京东方科技集团股份有限公司 | A kind of glasses |
| CN107333177A (en) * | 2017-06-01 | 2017-11-07 | 梁小红 | A kind of intelligent television exits the method and device of played in full screen |
| CN109496309A (en) * | 2018-08-07 | 2019-03-19 | 深圳市汇顶科技股份有限公司 | Detection method, device and the equipment of fatigue state |
| CN117653350A (en) * | 2024-02-01 | 2024-03-08 | 科弛医疗科技(北京)有限公司 | Surgical robot and method for preventing fatigue of surgical robot |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10356398B2 (en) | Method for capturing virtual space and electronic device using the same | |
| KR101850034B1 (en) | Mobile terminal and control method therof | |
| CN117356116A (en) | Beacon for locating and delivering content to a wearable device | |
| EP3373032B1 (en) | Method and device for determining status of terminal, and terminal | |
| CN104391572B (en) | Electronic installation and its control method with eyeball tracking function | |
| CN105204625A (en) | Safety protection method and device for virtual reality game | |
| CN104850217A (en) | Human eye movement monitoring device, method and equipment | |
| CN106231419A (en) | Operation performs method and device | |
| CN102609091A (en) | Mobile terminal and method for starting voice operation thereof | |
| US9607572B2 (en) | Information processing method and electronic device | |
| US9811993B2 (en) | Vehicle operator impairment detection system and method | |
| CN105869348A (en) | Alarming method, alarming device and monitoring equipment | |
| WO2016193550A1 (en) | Human-computer-interaction through scene space monitoring | |
| CN103699228A (en) | Blink control method and portable terminal | |
| CN105306819A (en) | Gesture-based photographing control method and device | |
| CN106292994A (en) | The control method of virtual reality device, device and virtual reality device | |
| CN105278809A (en) | Reading reminding method and apparatus | |
| CN106033255A (en) | Information processing method and electronic device | |
| CN107170048A (en) | Information displaying method and device | |
| KR20180005521A (en) | Mobile terminal and method for controlling the same | |
| CN104793747A (en) | Method, device and system for inputting through wearable device | |
| US20180203515A1 (en) | Monitoring | |
| EP3037916B1 (en) | Monitoring | |
| CN104932782A (en) | Information processing method and apparatus and smart glasses | |
| CN109164456B (en) | Depth camera module, mobile terminal and camera module mutual interference processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150819 |
|
| RJ01 | Rejection of invention patent application after publication |