CN106547453A - A kind of self-service nursing system controlled based on eyes - Google Patents

A kind of self-service nursing system controlled based on eyes Download PDF

Info

Publication number
CN106547453A
CN106547453A CN201611241735.9A CN201611241735A CN106547453A CN 106547453 A CN106547453 A CN 106547453A CN 201611241735 A CN201611241735 A CN 201611241735A CN 106547453 A CN106547453 A CN 106547453A
Authority
CN
China
Prior art keywords
instruction
user
module
eyes
self
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611241735.9A
Other languages
Chinese (zh)
Inventor
童小鸣
张伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Automotive Research Institute of Tsinghua University
Original Assignee
Suzhou Automotive Research Institute of Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Automotive Research Institute of Tsinghua University filed Critical Suzhou Automotive Research Institute of Tsinghua University
Priority to CN201611241735.9A priority Critical patent/CN106547453A/en
Publication of CN106547453A publication Critical patent/CN106547453A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61GTRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G7/00Beds specially adapted for nursing; Devices for lifting patients or disabled persons
    • A61G7/05Parts, details or accessories of beds
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/04Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G05B19/0423Input/output
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

The invention discloses a kind of self-service nursing system controlled based on eyes, including information acquisition module and message processing module, described information acquisition module, for gathering the face-image of user, and image is passed to into message processing module;Described information processing module, user's face-image for collecting to information acquisition module is processed, the eye motion of detection user simultaneously tracks its sight line motion, and eye motion is resolved to into user's instruction to be assigned according to established rule, and instruction is passed to into instruction performing module;The instruction performing module, the command content that the user being resolved to for execution information processing module assigns.Operational order is assigned by way of eye motion and sight line motion combine, can more be guaranteed that system receives the accuracy of instruction, be reduced maloperation, and several functions can be provided.

Description

A kind of self-service nursing system controlled based on eyes
Technical field
The present invention relates to a kind of self-service nursing system, more particularly to a kind of self-service nursing system controlled based on eyes.
Background technology
Currently for the nursing of the disability personnel such as paralysis, mutilation, mostly family members or engagement nurse's nursing.But it is long-term Nursery work will consume substantial amounts of human cost, monetary cost and time cost, while by the physiology and the heart of nursing staff Reason demand also usually cannot accurately be understood and meet.
In the last few years, the research for self-service nursing system is also more and more, but major part is required for being manipulated by caregiver Realizing a certain care actions, this mode is for the disability personnel such as paralysis, mutilation for remote control or control panel Then cannot be suitable for completely.
Currently, Visual Trace Technology has developed very ripe as the means of man-machine interaction.If can be by this technology It is applied in self-service nursing system, the nursing of the disability personnel such as paralysis, mutilation will be significantly facilitated.Patent CN 2015203875965 to be related to a kind of eye control full automatic nursing bed, and which passes through to track is realized to full-automatic shield by nursing staff's sight line The operation and adjustment of reason bed.On the one hand but, due to by the unicity of the particularity and care environments of nursing staff's health, Unconscious can be rested in manipulation instruction region unavoidably by the sight line of nursing staff, maloperation occurs.On the other hand, nursed During long-term and uninteresting rehabilitation nursing, often fluctuation in psychological condition to personnel there is, and needs obtain the external world and timely draw Lead and dredge, but this also imply that nursing staff must 24 hours it is on duty, in addition for part disability personnel demand not Correctly can be understood.
The content of the invention
For the defect that such scheme is present, the present invention is provided a kind of self-service nursing system controlled based on eyes, is passed through The eye motion of detection user simultaneously tracks its sight line and moves, and understands and complete its command content assigned, including nursing calling, Manipulation is automatic care bed, multimedia video is selected and plays, long-distance video is conversed, edit word etc..
In order to solve these problems of the prior art, the technical scheme that the present invention is provided is:
A kind of self-service nursing system controlled based on eyes, including image capture module and message processing module, described information are adopted Image for gathering the face-image of user, and is passed to message processing module by collection module;Described information processing module, User's face-image for collecting to information acquisition module is processed, and is detected the eye motion of user and is tracked which Sight line is moved, and eye motion is resolved to user's instruction to be assigned according to established rule, and instruction is passed to finger Make performing module;The instruction performing module, the command content that the user being resolved to for execution information processing module assigns.
Preferably, when detecting that sight line resides in the time of instruction area more than threshold value, eye motion is detected, judges which is It is no to meet established rule, the one-to-one relationship of user's eye motion and direction of visual lines and command content is set up if meeting, The instruction of corresponding instruction area is parsed, control instruction performing module performs corresponding action.
Preferably, the established rule opens the quantizating index for closing action generation for eyes.
Preferably, if meeting established rule, illuminating state indicator lamp, when instruction performing module has performed corresponding action Afterwards, OFF state indicator lamp.
Preferably, the instruction performing module includes:Local wired or wireless electronic notification device, controllable automatic nursing Bed, multimedia video are played and display device, long-distance video call module.
Relative to scheme of the prior art, it is an advantage of the invention that:
1. the present invention need not start, but the self-service nursing system controlled based on eyes, can be good at conveniently paralysis, limbs residual Lack and wait disability personnel voluntarily to carry out part NP and other operations, greatly reduce manpower and money that long-term care brings Cost;
2. user assigns operational order by way of eye motion and sight line motion combine, and can more guarantee that system is received The accuracy of instruction, reduces maloperation;
3. system provides nursing calling, multimedia video selection and broadcasting, long-distance video call, editor's word etc. for user Function, more can accurately and timely express the physiology and psychological needs of user, and with convenient nursing, personnel timely respond to.
Description of the drawings
Below in conjunction with the accompanying drawings and embodiment the invention will be further described:
Fig. 1 is the theory diagram of the self-service nursing system that the present invention is controlled based on eyes;
Fig. 2 is a kind of connection diagram of the self-service nursing system that the present invention is controlled based on eyes;
Fig. 3 is the structural representation of the self-service nursing system that the present invention is controlled based on eyes.
Specific embodiment
Such scheme is described further below in conjunction with specific embodiment.It should be understood that these embodiments are for illustrating The present invention and be not limited to limit the scope of the present invention.The implementation condition adopted in embodiment can be done according to the condition of concrete producer Further adjust, not marked implementation condition is usually the condition in normal experiment.
Embodiment
As shown in figure 1, a kind of self-service nursing system controlled based on eyes, including information acquisition module, information processing mould Image for gathering the face-image of user, and is passed to letter by block and instruction performing module, described information acquisition module Breath processing module;Described information processing module, the user's face-image for collecting to information acquisition module are processed, The eye motion of detection user simultaneously tracks its sight line motion, and it is wanted that eye motion is resolved to user according to established rule The instruction assigned, and instruction is passed to into instruction performing module;The instruction performing module, for execution information processing module solution The command content that the user for analysing assigns.
When detecting that sight line resides in the time of instruction area more than threshold value, eye motion is detected, judges whether which meets Established rule, sets up the one-to-one relationship of user's eye motion and direction of visual lines and command content if meeting, and solves phase separation The instruction of the instruction area answered, control instruction performing module perform corresponding action.Established rule is opened for eyes and closes action generation Quantizating index, can such as be frequency of wink or closed-eye time etc..
Preferably, if meeting established rule, illuminating state indicator lamp, when instruction performing module has performed corresponding action Afterwards, OFF state indicator lamp.
Preferably, performing module is instructed to include:It is local wired or wireless electronic notification device, controllable automatic care bed, many The audio-visual broadcasting of media and display device, long-distance video call module.Select there is provided nursing calling, multimedia video and play, The functions such as long-distance video call, editor's word.
In terms of particular hardware, information acquisition module and message processing module are integrated into self-service nursing system main frame 1, such as Fig. 2 It is shown.CMOS camera 1-1 and infrared lamp 1-2 are used for Real-time Collection user's face-image, and self-service shield is shown on display screen 1-4 The various functions instruction that reason system possesses(As shown in Figure 3), can be selected by eyes and be operated, status indicator lamp 1-3 is used Recognize successfully in the resident instruction area of instruction sight line long-time.Self-service nursing system main frame 1 is based on ARM core processors, adopts Android system, possesses multimedia video and selects and playing function, long-distance video call function and copy editor's function.Additionally, Automatic care bed 2 control module is connected by RS485, the operation to bed body is realized;Hospital's calling system is accessed by IO, it is real Call function is nursed now.
In terms of concrete function, as a example by adjusting care bed function.After system starts, the face figure of Real-time Collection user Picture, the sight line motion and eye motion to user are detected and stored.When user's long-time(Such as 3 seconds)Watch display attentively After device " adjustment care bed " functional module, status indicator lamp 1-3 is lighted, and user completes eye motion according to established rule(Example As 3 blinks are completed in 2 seconds), system selectes " adjustment care bed " functional module and simultaneously enters submenu, and status indicator lamp extinguishes 1- 3.User's long-time(Such as 3 seconds)Watch display attentively " above to bend one's legs " after functional module, status indicator lamp lights 1-3, user Eye motion is completed according to established rule(3 blinks are completed in 2 seconds for example), system assigns " above bending one's legs " and orders and pass through RS485 passes to automatic care bed 2 control module, and automatic care bed thigh support post rises certain distance(Such as 10cm), Status indicator lamp 1-3 extinguishes.
It should be noted that public in the patent before applicant with regard to the technology of human eye state and motion detection Open, belong to prior art, therefore here is omitted.
Examples detailed above technology design only to illustrate the invention and feature, its object is to allow the person skilled in the art be Will appreciate that present disclosure and implement according to this, can not be limited the scope of the invention with this.It is all smart according to the present invention Equivalent transformation or modification that refreshing essence is done, should all be included within the scope of the present invention.

Claims (5)

1. a kind of self-service nursing system controlled based on eyes, including information acquisition module and message processing module, its feature exist In image for gathering the face-image of user, and is passed to message processing module by described information acquisition module;It is described Message processing module, the user's face-image for collecting to information acquisition module are processed, and detect the eye of user Portion's action simultaneously tracks its sight line motion, and eye motion is resolved to user's instruction to be assigned according to established rule, and Instruction is passed to into instruction performing module;The instruction performing module, for the user that execution information processing module is resolved to The command content assigned.
2. it is according to claim 1 based on eyes control self-service nursing system, it is characterised in that when detection sight line be resident When the time of instruction area threshold value is exceeded, eye motion is detected, judges whether which meets established rule, setting up if meeting makes User's eye motion and direction of visual lines and the one-to-one relationship of command content, parse the instruction of corresponding instruction area, control Instruction performing module performs corresponding action.
3. the self-service nursing system controlled based on eyes according to claim 2, it is characterised in that the established rule is Eyes open the quantizating index for closing action generation.
4. it is according to claim 2 based on eyes control self-service nursing system, it is characterised in that if meet both established rules Then, illuminating state indicator lamp, after instructing performing module to perform corresponding action, OFF state indicator lamp.
5. the self-service nursing system controlled based on eyes according to claim 1, it is characterised in that the instruction performs mould Block includes:Local wired or wireless electronic notification device, controllable automatic care bed, multimedia video is played and display device, remote Journey video calling module.
CN201611241735.9A 2016-12-29 2016-12-29 A kind of self-service nursing system controlled based on eyes Pending CN106547453A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611241735.9A CN106547453A (en) 2016-12-29 2016-12-29 A kind of self-service nursing system controlled based on eyes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611241735.9A CN106547453A (en) 2016-12-29 2016-12-29 A kind of self-service nursing system controlled based on eyes

Publications (1)

Publication Number Publication Date
CN106547453A true CN106547453A (en) 2017-03-29

Family

ID=58396350

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611241735.9A Pending CN106547453A (en) 2016-12-29 2016-12-29 A kind of self-service nursing system controlled based on eyes

Country Status (1)

Country Link
CN (1) CN106547453A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108392333A (en) * 2018-02-06 2018-08-14 复旦大学附属中山医院 A kind of induction type moving aid bed
CN109846635A (en) * 2019-02-20 2019-06-07 浙江强脑科技有限公司 Nursing bed system based on glasses and brain-computer interface
EP3949832A4 (en) * 2019-04-02 2022-05-18 Cross Sync, Inc. Illness aggravation estimation system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104216521A (en) * 2014-09-10 2014-12-17 苏州德品医疗器械技术开发有限公司 Eye movement calling method and system for ward
JP2015014938A (en) * 2013-07-05 2015-01-22 由田新技股▲分▼有限公司 In-vehicle eye control method, and electronic device realizing the same method
CN204932058U (en) * 2015-06-08 2016-01-06 莱州科亿宏电动床有限公司 A kind of eye control is full automatic nursing bed
CN106101786A (en) * 2016-06-15 2016-11-09 北京小米移动软件有限公司 The method and apparatus controlling target device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015014938A (en) * 2013-07-05 2015-01-22 由田新技股▲分▼有限公司 In-vehicle eye control method, and electronic device realizing the same method
CN104216521A (en) * 2014-09-10 2014-12-17 苏州德品医疗器械技术开发有限公司 Eye movement calling method and system for ward
CN204932058U (en) * 2015-06-08 2016-01-06 莱州科亿宏电动床有限公司 A kind of eye control is full automatic nursing bed
CN106101786A (en) * 2016-06-15 2016-11-09 北京小米移动软件有限公司 The method and apparatus controlling target device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108392333A (en) * 2018-02-06 2018-08-14 复旦大学附属中山医院 A kind of induction type moving aid bed
CN109846635A (en) * 2019-02-20 2019-06-07 浙江强脑科技有限公司 Nursing bed system based on glasses and brain-computer interface
EP3949832A4 (en) * 2019-04-02 2022-05-18 Cross Sync, Inc. Illness aggravation estimation system

Similar Documents

Publication Publication Date Title
CN105082150B (en) A kind of robot man-machine interaction method based on user emotion and intention assessment
WO2021121381A1 (en) Rehabilitation management system and method
CN104799826B (en) A kind of intelligence Ankang service system and the reliable detection method of alarm
CN104055478B (en) Based on the medical endoscope control system that Eye-controlling focus controls
US9436887B2 (en) Apparatus and method for automatic action selection based on image context
CN107320090A (en) A kind of burst disease monitor system and method
CN106547453A (en) A kind of self-service nursing system controlled based on eyes
CN104090659A (en) Operation pointer indication control device based on human eye image and sight tracking
CN106781324A (en) Vertebra system for prompting and light fixture are protected in a kind of eyeshield
CN206400521U (en) A kind of self-service nursing system controlled based on eyes
CN109745011A (en) User's sleep-respiratory risk monitoring and control method, terminal and computer-readable medium
CN106681509A (en) Interface operating method and system
CN110507891A (en) A kind of sleeping method of Combining with technology of virtual reality and psychological consultation
CN107657965A (en) Vagitus identifier and knowledge method for distinguishing
CN110930780A (en) Virtual autism teaching system, method and equipment based on virtual reality technology
CN109192267A (en) Virtual robot is accompanied in movement
WO2018016142A1 (en) Information processing system, information processing device, information processing method, and program
CN109620265A (en) Recognition methods and relevant apparatus
TWI684160B (en) System and method for analysis demonstration
CN115662591A (en) Ward integrated management platform and server
CN115966023A (en) Protective clothing standardized putting-on and taking-off detection method and related system
CN110458076A (en) A kind of teaching method based on computer vision and system
CN115040114A (en) Remote rehabilitation system and training method based on virtual reality and man-machine interaction
CN209055910U (en) A kind of E.E.G participates in the apallic syndrome patient interaction instrument of control
CN215007534U (en) Autism plementary rehabilitation training instrument

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170329

RJ01 Rejection of invention patent application after publication