CN107016224A - The Nounou intelligent monitoring devices accompanied for health care for the aged - Google Patents
The Nounou intelligent monitoring devices accompanied for health care for the aged Download PDFInfo
- Publication number
- CN107016224A CN107016224A CN201610875911.8A CN201610875911A CN107016224A CN 107016224 A CN107016224 A CN 107016224A CN 201610875911 A CN201610875911 A CN 201610875911A CN 107016224 A CN107016224 A CN 107016224A
- Authority
- CN
- China
- Prior art keywords
- information
- intelligent monitoring
- monitoring device
- monitor
- custodial person
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- G06F19/3418—
Abstract
The invention provides the Nounou intelligent monitoring devices that a kind of health care for the aged is accompanied, including body conformation monitoring unit, behavior act monitoring unit, the information induction element of Emotion expression monitoring unit, physiological situation monitoring unit and configuration.The intelligent monitoring device can be connected with information system, and described information system carries out information induction, processing, reception, transmission and stored.The intelligent monitoring device include main body and can relative to the body rotation pedestal, the main body has Main Processing Unit, display, touch-control panel, touch key-press, audio-video sensing element and can be equipped with Worn type detection or sensing element.The intelligent monitoring device information fusion can be carried out by information processor and information division is handled, and carries out intelligentized deep learning to the behavior state of custodial person by neutral net.
Description
Technical field
, can the present invention relates to the intelligent monitoring device and system of artificial intelligence field, more particularly to aged family company
It is tracked and monitors for the body to household old man, health and safety situation.
Background technology
Ageing phenomenon is on the rise since this century, and many old men usually have the feeling of lonely away from society, in addition also
The problem of there may be daily nursing and medical security aspect.These problems are largely due to effective monitoring tool
Relative absence, custodial care facility and service fee is prohibitively expensive and operation of custodial care facility is excessively complicated.Common custodial care facility
Lack of wisdom mechanism, it is impossible to effectively monitor the body and mind that behavior, health and mood are characterized that includes of custodial person
Feature, for example, can not effectively monitor important sign of the such as melancholy and anxiety etc. about health status of custodial person
And information.
The content of the invention
The intelligent guarding system that the aged family health care that the present invention is provided is accompanied is not only able to effectively monitor custodial person
Psychophysical characteristics in terms of being characterized about behavior, health and mood, moreover it is possible to further carried according to the psychophysical characteristics
Communication contact for communication of accompanying and attending in real time with custodial person, with related personnel or facility and building in time to custodial person
Negotiate peace help.
The invention provides a kind of Nounou intelligent monitoring devices accompanied for health care for the aged,
For detecting that custodial person includes the situation that behavior, physical signs and mood are characterized, the monitor device bag
Include：
Body posture monitoring unit, can be identified and monitor to the image of the body posture of custodial person；
Behavior act monitoring unit, can be identified and monitor to the behavior act of custodial person；
Mood characterizes monitoring unit, the mood of custodial person can be characterized and be identified and monitor；
Physical signs monitoring unit, can be identified and monitor to the physical signs of custodial person；
The monitor device may also be configured with sensing element, including wearable heart monitor for custodial person, can
Wrist strap is worn, wherein the sensing element can be used for obtaining induction information from the custodial person and can be to the intelligence
Monitor device transmits the induction information；
The intelligent monitoring device can be connected with information system, and described information system includes：
Information receiver, including the wireless senser that monitoring server uses；
Information processor, including high in the clouds computing unit, for handling the induction information, include the knowledge of information
Not, fusion and division；
Information carrying means, for the induction information acquired in the sensing element is transferred into described information processing
Device, and the processing information after the processing of described information processing unit is further transferred to described information reception device；
Information-storing device, including memory card and high in the clouds storage element, for storing the institute acquired in the sensing element
State the processing information after induction information and the processing of described information processing unit；
Wherein, the intelligent monitoring device can include wired connection or wireless connection with the connection of information system.
According to a kind of embodiment of the intelligent guarding system, the intelligent monitoring device includes：
Main body, including Main Processing Unit, display, positive photographing element, backward photographing element, touch-control panel, multiple touches
Button, connector, battery unit and power outlet；And
Pedestal, the main body is set on the body and can carried out using stepper motor relative to the main body
Rotate.
According to a kind of embodiment of the intelligent guarding system, the main body of the intelligent monitoring device is relative to the base
The rotation of seat provides the apparent energy naturally continuously rotated from the pedestal using slip ring to the rotatable main body to be made
Tracking closely can be carried out without being limited by rotation to custodial person by obtaining the intelligent monitoring device.
According to a kind of embodiment of the intelligent guarding system, the stepper motor of the intelligent monitoring device be by
Built-in controller is simultaneously controlled by the Main Processing Unit, using the teaching of the invention it is possible to provide the slewing rate of optimization and torque.
According to a kind of embodiment of the intelligent guarding system, the positive photographing element of the intelligent monitoring device
It is arranged within the monitoring arrangement front glass surface, is wide-angle imaging element, 175 degree of water is included using wide-angle lens
Look squarely angle and up to 90 degree of vertical angle of view；The backward photographing element includes two parts, is separately positioned on close to left and right two
Angular position, includes up to 90 degree of horizontal view angle and up to 45 degree of vertical angle of view；So as to, the positive photographing element and
The backward photographing element can provide the full-time continuous omni-directional visual to surrounding environment.
According to a kind of embodiment of the intelligent guarding system, the touch-control panel of the intelligent monitoring device is electricity
Appearance formula touch screen, is arranged on the positive middle part of the main body；The multiple button is two capacitance keys, is set respectively
Two side positions in the main body front touch-control panel are put, so that, the custodial person can be dynamic conveniently by tactile
Make to carry out interaction with the intelligent monitoring device.
According to a kind of embodiment of the intelligent guarding system, the intelligent guarding system further comprises guarding electronics
System, including a variety of peripheral electronic devices being connected with the Main Processing Unit, contact panel, liquid crystal display, SD card interface, biography
Sound device, loudspeaker, microcontroller and shooting distributor plate；Wherein described microcontroller can carry out real-time programming, to realize in real time
Control, the shooting distributor plate is using frequency multiplexing technique to realize panoramic vision.
According to a kind of embodiment of the intelligent guarding system, wherein the fusion of the induction information utilizes deep learning
Neutral net, its can regularly to user provide learn sequence prompting, wherein, for specific induction information exist set
Determine after the continuous mistake deciphering of number of times, or when not enough data can appropriately be understood to the induction information,
The study sequence will start, so that, the intelligent monitoring device can be by the neutral net to each induction information
The display form of the corresponding custodial person carries out intelligentized study and the custodial person can be coordinated to provide accurately
Deciphering；Wherein described study sequence includes visual learning sequence and sense of hearing study sequence.
According to a kind of embodiment of the intelligent guarding system, described information processing unit have Function of Information Fusion and
Information splitting function.
Described intelligent guarding system includes data fusion processor, with Function of Information Fusion, wherein all senses
Answer information to be transferred to the data fusion processor and carry out information fusion；It is probability for having in the induction information
The information of feature uses Kalman filters, for receiving the reading information of particular sensor and by the reading with other sensors
Information fusion is taken to get up to form custodial person's pattern with high confidence level, so that the monitor device can be held at any time
Continuously the state to the custodial person carries out high probability assessment.
Described information splitting function enables the intelligent guarding system to export the intelligent monitoring device and the quilt
Interactive effect information between observer, so as on the basis of being merged in described information to the custodial person and the prison
Shield server provides the suggestion related to monitoring or information respectively.
The intelligent guarding system that the family health care is accompanied can be to the behavior of custodial person, physical signs and mood
Sign is detected in real time, communication of accompanying and attending in real time can be carried out with custodial person, and can also set up custodial person and bag
Include real-time contacts in terms of relatives and friends, health worker, physiotherapy mechanism and exchange.So as to be directed to the invention provides one kind
Intelligent companys of custodial person, status tracking, spy's feelings bulletin, it is critical seek help in terms of technical scheme.
Brief description of the drawings
Above-mentioned brief introduction for the present invention and following detailed descriptions, can be better understood with reference to accompanying drawing.
Fig. 1, which is described, is used for the prison for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
Protection unit.
The pedestal and the decomposing schematic representation of rotatable components of Fig. 2 monitor devices shown in description Fig. 1.
Fig. 3 A and 3B describe touch on the preceding screen of monitor device shown in Fig. 1, button, taken pictures and display function position arrangement
A kind of embodiment.
Fig. 4 is described according to what a kind of embodiment of the invention was used for the intelligent guarding system that family health care is accompanied
System framework.
Fig. 5, which is described, is used for the electricity for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
Sub- annexation.
Fig. 6 is described is used for taking the photograph for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
The annexation of element.
Fig. 7, which is described, is used for the sense for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
Answer the information fusion (fusion) and division (fission) mechanism of unit.
Fig. 8 is described is used for regarding for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
Feel study sequence.
Fig. 9 describe according to a kind of embodiment of the invention be used for family health care accompany intelligent guarding system from
Right language learning sequence.
Figure 10 is described is used for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
Follow the trail of user pattern of the custodial person to be chosen.
Figure 11 is described is used for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
The user interface that custodial person uses is suitable to based on Android system.
Figure 12 is described is used for the intelligent guarding system that family health care is accompanied according to a kind of embodiment of the invention
The positive animation shape of face of monitor device.
The FA Facial Animation that Figure 13 describes in animation shape of face as described in Figure 12 corresponding to different moods is expressed.
Embodiment
According to a kind of embodiment of the invention, as depicted in figs. 1 and 2, the intelligent monitor accompanied for family health care
The monitor device 100 of system, or accompanied and attended to device, including front wide-angle imaging element, backward photographing element, touch screen for remote control
Face, both sides button, RJ45 connectors, battery frame and power outlet.
The monitor device 100 can be divided into two parts, as shown in figure 1, the i.e. rotatable upper body 110 of rhombus inclined
With round base 120.The pedestal 120 can be designed as more steady and utilize NEMA stepper motors (stepper
Motor) 102 enable the lighter main part 110 being mounted above to carry out the rotation relative to pedestal 120.The step
Stepper motor 102 is by built-in electric machine controller 103 and is controlled by Main Processing Unit 104.The rotating mechanism is utilized
Slip ring provides the apparent energy naturally continuously rotated from pedestal 170 to rotatable upper body 110.So as to the prison
Protection unit 100 can carry out tracking closely without being limited by rotation to custodial person.
The stepper motor 102 can deliver the torque to the pedestal by a series of spur gear (spur gears)
120 so that provide slewing rate and the torque of optimization, as shown in Figure 1.So as to can just provide pin by means of the rotating mechanism
Apparent natural tracking to custodial person.The stepper motor 102 is by the overall plastics for being placed in and being connected with the pedestal 120
Within frame shell.The stepper motor 102 can be by closed loop feedback control device (closed loop feedback control) institute
Substitution, the controller includes point position device (potentiometer) and brush motor (brushed motor) or continuous rotate is watched
Take device.
The positive photographing element 106 using wide-angle lens include 175 degree horizontal view angle and up to 90 degree hang down
Look at angle straight.The wide-angle lens is arranged within the front glass surface 101 of monitoring arrangement 100.The backward shooting member
Part 107 is separately positioned on the position of close two jiaos of left and right.In this way, these photographing elements can be just provided to the complete of context
When Continuous Vision, that is, commonly referred to as omni-directional visual.The level that the backward photographic element includes up to 90 degree is regarded
Angle and up to 45 degree of vertical angle of view.These photographic elements are arranged within the frame of plastic shell of the upper body, only
Camera lens exposes from surface.Touch screen plate 108 is arranged on the middle part within the monitoring arrangement front glass surface.In addition,
The grade of loudspeaker 109 element described later also can be set.
The monitor device 100 can be operated using battery and power outlet.Battery can provide long distance use with
And use temporarily, the use time of 3 hours is able to maintain that under full-charge state.Battery case is arranged on rotatable upper body
110 rear side position, and with easy-to-mount panel.Having the situation of socket and battery concurrently, socket can be set to acquiescence and set
Put.For example, in one embodiment, the power supply provided by battery or socket is 3 amperes 12 volts.It is described for the sake of flexibly
Power outlet can be using the standard portable Socket for computor shown in Fig. 1.Specifically, the monitor device can be by internal battery
Or external receptacle provides power supply.In the situation using battery or socket, all carried out when electric current is transferred to the monitor device
Power modulation.
Fig. 3 A and 3B embodiments in accordance with the present invention describe the Nounou monitor devices 110 or remote control is accompanied and attended to device
Haptic interaction effect and respective element.Haptic interaction effect be by the positive capacitive touch screens 105A of remote control with
And capacitance key 105B, 105C, 105D realization of side setting.So, custodial person just can easily only by
Tactile is acted carries out interaction with remote control.In another embodiment, the touch screen is resistance-type.It is described
Touch screen 105A and button 105B, 105C, 105D are arranged on below the face glass panel 101 of monitor device 100.
The touch screen 105 is arranged on the middle part of panel, the front side in the rotatable upper body 110
Between two buttons 105B, 105C.Positive photographing element 106 is arranged on the top of the touch screen 105A, with the touch screen 105A
Towards identical.
Fig. 4 describes a kind of system architecture of the Nounou intelligent guarding systems 400 according to embodiment.The prison
Protecting system includes Nounou monitor devices 410, and it is configured with wearable heart monitor 421 and wearable wrist strap 422.Its
Its embodiment may also include wireless speaker, clip microphone or CCTV camera.Remote monitoring device 410 itself
The intelligent mechanism of system is also provided, can be exchanged and be connected by internet with high in the clouds 431 into racking with wireless device
Calculate and store.So, custodial person, such as the elderly, it becomes possible to pass through the single other senses of management system platform connection
Answer equipment or wearable device.Relevant information is stored by the remote control equipment, analyzed so that learnt, so as to further increase
Or the interactive experience in abundant future.
Specifically, wireless induction element can using Bluetooth 4.0 and IEEE 802.11n standard with it is described distant
Control monitor device is attached.Internet of Things (IoT) device can pass through wired Internet or wireless Internet and the Nounou
Monitor device 410 is attached.In a kind of embodiment, the compatible wrist strap of bluetooth is also used, internet control
The necklace of Long Term Evolution (LTE) global positioning system (GPS), and 5GHz sleep heart rate monitors.
The wrist strap can be Internet of Things (IoT) element, can be filled by the wireless connection technology of such as bluetooth with monitoring
410 connections are put, and various other devices, such as mobile phone, notebook computer or desktop computer can also be connected to.Thus,
The wrist strap can have but be not limited to following function：Display and transmission such as time, heat consumption, distance and bearing, sleep
The monitoring informations such as state, pedimeter number, HR Heart Rate；Receive or store data by external or built-in SIM card or SD card；Even
It is connected to neutral net and uploads the information such as relevant user's data；Connect by elements such as external or built-in loudspeakers or loudspeaker
By or send audio-frequency information, for example conversed or called；Help carries out web search；With shooting, video show, such as electricity
Talk about the functions such as data display, the game such as number；Vibration is produced to send wearer the signals such as prompting, alarm or prompting；Institute
Signal can be received or send by stating in the case that monitor device is in abnormal operating state.
Bluetooth element be by touch screen navigate on user interface selection be attached with Android operation system.Local area radio
The simple search for connecting can be mated by download application program or the IP address of related device of 2.4GHz or 5GHz devices
Carry out.Special purpose device can provide customization software, and open system has corresponding software support.The software is connected to described device
IP address and port numbers and obtain real time data be used for operated and analyzed.Custodial person, such as old man, it becomes possible to from
The data are seen on remote monitoring device 410.Internet of things device is matched using Internet connection with said apparatus.It is outside
The offer of IP address and port numbers is furnished with security password.The Internet of things device can be arranged on from anywhere in the world, passed through
It is wirelessly connected to internet, and the service provider of internet is to both connection and unrestricted.
Related data is also optionally stored in SD card 441 by the remote monitoring device 410, or by because of spy
Pass to high in the clouds 431 on the net.In this way, custodial person just can be easily selected by internet or SD card and doctor, medical care mechanism
Or kith and kin share information.In a kind of embodiment, monitored object can pass to relevant information in high in the clouds 431, then
Information will can also be stored in by mobile communication equipment 451 (such as mobile phone) and accompany and attend to mechanism or personnel's reading information
Then SD card is handed over to doctor or medical care mechanism 452.
Related data can be stored in SD card 441 by the Android operation system with utilization C++ and Java software, and described
The application programming interfaces (API) that data can be provided by cloud service business upload to high in the clouds 431.When no high in the clouds is connected,
Data can be postponed being stored in SD card 441, then, after recovery is connected, remote monitoring device is with regard to that can synchronize process.Institute
State synchronizing process has the time to mark and identifying code respectively to the data of cloud service and local storage.
Fig. 5 describes the composition of the electronic system in monitor device.For Main Processing Unit 501, there are various ancillary equipment point
Pick out and.The ancillary equipment includes contact panel 511, liquid crystal display (LCD) 512, SD card 513, microphone 514, raised one's voice
Device 515, microcontroller 521 and the distributor plate of photographing element 525.The photographing element 525 carries positive photographing element, rear left to taking the photograph
Element and rear right are to photographing element.The real-time behaviour of the requirement such as described 521 pairs of stepper motors 522 of microcontroller, LED and button
The other ancillary equipment made are controlled.
The Main Processing Unit 501 can be the compact processor of any operation Android operation system.In one embodiment,
Primary processor is the APQ 8016 assembled by the circuit boards of Inforce 6309.Generally speaking, the Main Processing Unit 501 can include
Any peripheral equipment and computing unit, as long as ancillary equipment that at least can be shown in control figure 5.The Main Processing Unit 501 itself
It is to be obtained from third party, is not belonging to the scope of the present invention.
Control is to be discharged into microcontroller in real time, and microcontroller can carry out real-time programming.In one embodiment,
The microcontroller used is ATMega 328.The microcontroller implements the control to controllor for step-by-step motor, touch key-press and LED
System.The microcontroller sends higher and relatively low signal to control LED, via it is traditional have resilience key circuit from touch by
The input sampling of key, and send pulse to controllor for step-by-step motor.
In other embodiment, may have potentiometer and motor rather than stepper motor, or with watching
Take device.In the situation with potentiometer and motor, microcontroller can be exchanged with motor controller, and simulation water is read from potentiometer
Put down to close feedback control loop.It with servomechanism situation, can say that train of pulse is sent to motor.The electric power of the motor is that have battery
Or socket without regulation power supply provide.In other embodiment, the motor can be by the electricity through overregulating
Source provides electric power.
Touch-control panel and liquid crystal display may be coupled to mainboard, wherein being shown via high definition media interface (HDMI)
And carry out touch support via USB (uSB).In one embodiment, touch-control panel is believed via low-voltage differential
Number (LVDS) display interface and touch-control panel interface are connected to mainboard.The touch-control panel can have any size to adapt to
The ratio of layout shown in Fig. 3.The LCD display can be substituted using light-emitting diode display.So, the remote monitoring device tool
There is high resolution display, and with response touch interface.
Loudspeaker and microphone are encapsulated in inside remote monitoring device, and can be via analog signal or data signal
It is attached.Available numeral connection includes wireless Bluetooth standard, IEEE 802.11x standards, USB or HDMI audio pins.At this
In embodiment, analog signal provides audio to microphone from primary processor, and receives simulation letter from loudspeaker to primary processor
Number.
In order to support multichannel, such as 3 tunnels, camera data stream simultaneously, Fig. 6 is described with shooting serial line interface (CST-2)
The imaging circuit plate of the multi-channel video technology of standard.In the present embodiment, including 3 road CSI Port Multipliers 601, using connecing for 51 pins
Head is 4 passages as double CSI interfaces 602, one, and another is 2 passages.It is logical to three 2 that the circuit board includes 2 channel circuit boards
Road CSI interface, with the Port Multiplier that general purpose I/O is controlled on Main Processing Unit.So, custodial person can just monitor all three
The full detail of video camera, and switching rate is below 1 microsecond.The hardware of the frequency multiplexing technique is the part of the present invention, is used
To support panoramic vision so as to improve the guard condition and Ambient Transfer of custodial person.
All ancillary equipment use the bus driver framework from Main Processing Unit, in addition to stepper motor.USB passes energy
Microcontroller is sent to, CSI transfers the energy to video camera, and LVDS transfers the energy to display and touch panel.Rotate electricity
Machine is to provide energy to prevent the high electric noise caused by higher inductive load as unregulated power supply respectively.
Fig. 7 is described is used for the intelligent monitoring device system that family health care is accompanied according to a kind of embodiment of the invention
Sensor fusion algorithm, be related to the sensing unit of intelligent monitoring device system information fusion (fusion) and division
(fission) mechanism.Sensor includes extracting actual environment sample and is translated into the device of electric signal.In present embodiment
In, the sensor includes the sensing such as touch-control panel 711, touch controlled key, wireless module 712, video camera 713 and loudspeaker 714
Element.The wireless module 712 includes any wireless senser being connected with the remote monitoring device.The sensor can be with
Including exterior I oT elements, from varying environment, the area or national for passing through network connection with the remote monitoring device.It is described
Network is such as internet.
The initial data of each sensing element is obtained by respective connected mode, and the connected mode is included but not
It is limited to wireless Bluetooth, wireless IEEE 802.11x, cable network, USB or simulation input.So, the remote monitoring dress
Message sample can be obtained from the custodial person in actual environment by putting, so as in the information analysis of the remote monitoring device
Information fusion 710a and the division 710b processing of further information are carried out in processor 710.
The information fusion of sensor includes the neutral net for deep learning, utilizes such as tactile Jing Guo fusion treatment
Information in terms of analysis, tidal data recovering analysis, computer vision, natural language processing and Emotion identification, passes through Nounou intelligence
The deep learning 720 of system is further analyzed processing.The deep learning provides a kind of by sensor reading information and quilt
The method that the natural performance or behavior of guardian such as old man is allocated.So as to which the sensor can adapt to and coordinate old
Different behaviors, physical trait, sound, ethnic background and the action of people.The neutral net is supervised deep learning
One kind application, can regularly provide user the prompting for learning sequence, for example, by soft including high in the clouds storage 725, Android
Part 727, stepper motor and microphone 727, image show 728 be supplied to user to the approach such as subscriber data SD card 729, it is related
Personnel and organizations and aftertreatment systems.After being understood for some sensing reading information in the presence of 5 continuous mistakes, or
When not enough data can read information to sensing appropriately to be understood, the study sequence will start.So, institute
The intelligentized study of the corresponding performance progress of information can just be read by neutral net to each sensing by stating remote monitoring device
And accurate understand can be provided with the use of person.
The study sequence provides the supervised learning needed, and is unique for various kinds of sensors.The study
Sequence includes visual learning sequence and sense of hearing study sequence.Due to the wearable device being connected with remote monitoring device exist it is unknown
Selection situation, the present embodiment uses unsupervised learning.The remote monitoring device can be with the in the market during software development
Without wearable device.So, the remote monitoring device can just be directed to the data obtained from uncertain source and be supervised
Survey and learn.
Fig. 8 describes a kind of embodiment on visual learning sequence, it may for example comprise step 801-810.It is described
Study is started in the room of the omnidirection circumstance light source good illumination with optimization.It is exactly then, custodial person, for example
The old man guarded, stands directly on the front of the remote monitoring device and in the centre position of wide angle cameras.At this
Between point, front display can show the image that monitor device is seen, thus old man according to the Image Adjusting on display screen from
Left and right orientation and longitudinal separation that oneself stands.Next step is exactly to require the degree that displaying arm stretches according to several postures.Want
The posture profile asked can also be showed on a display screen.So, if user just according to posture profile be adjusted without
Instruction must be made to monitor device with listening.The next step of the visual learning is to show different postures, including sit down and
Lie down.This be it is critically important, due to monitor device can work as can when old man falls down because of malfunction or posture or be injured
Monitored by pattern-recognition.Next step is exactly walking motion in the way of the old man's walking that correctly judges.So, monitoring is worked as
To the quick acting of non-expectation, monitor device will start tumble or the injury for noting occurring.For this movement velocity,
Certain threshold value can be set to target tracking algorithm with rejecting abnormalities situation.
At any time point, when user wants to leave out or skips over some learning procedure, user just can so do
Do, only need to click the touch key-press on the left side.Any process being skipped may cause poor study, but can be by rear
Corrected in continuous successive learning.The continuous profile followed is needed also with auditory tone cues by monitoring old man.So, supervised
The old man of shield, even if having the sense of hearing or dysopia, can also follow study sequence.
Face recognition is a careful process, is also the part for learning sequence.Face recognition belongs to the monitoring dress
The key character put, for correctly recognizing the old man in room, and differentiates to user.The study sequence will
The closely smiling face towards wide angle cameras is asked, so that facial characteristics is recorded and learnt.So, the monitor device is with regard to energy
It is enough that people in room is differentiated, include smiling face and the identity of identification old man.
Neutral net for deep learning is using forwardly and rearwardly transmission method and supervised learning.In order to avoid unified purchase god
Heavy computation burden when initially learning through layer, the original state of network is stored in SD card and when next needs learn
Time is recovered again.So, the situation of user's all neutral nets in monitor device can be just output, and in power breakdown
Or also can be saved in the case of equipment transfer or maintenance.
Fig. 9 describes a kind of embodiment of the study sequence about natural language, such as including step 901-
905.The language that the old man guarded must be thought it first.Next step be exactly from old man from word paragraph set in advance to
Monitor device is read out.The monitor device will be evaluated user's pattern using supervised learning.A little times are spent when old
People has read more word paragraphs to monitor device, and learning system is with regard to that can reach to the certain of old man's speech understanding, such as
At least 90% or 95% accuracy.Point at any time, old man can be selected under the order of accuarcy of study sequence at that time slightly
The step for crossing.So, monitor device just adapts to the especial sound of old man, and the accuracy rate for any kind of speech like sound can reach
More than 90%.By each word paragraph, old man just can from being found on display by neutral net user's pattern to which
It is incorrect that the estimating of a little words, which is sentenced,.
When sensing data is operated by the data fusion processor shown in Fig. 7, using from from unexpected
The unsupervised learning of sensing data.Old man can select to exempt sensor fusion steps, so that data would not be introduced to again
Data fusion processor.In this situation, the data will be stored by local within Android operation system.
Computer vision neutral net can be combined with image processing algorithm, specially basic filtering, feature detection, target point
Class and target tracking algorithm.So, the monitor device can carry out image intelligent disposal and identification for custodial person.
So, the monitor device for the identification that user is intended to is judged based on probabilistic, but routine techniques
It is to be judged based on two condition.The natural reaction provided by the probability judgement of statistical analysis is like interpersonal reaction.
Thus, the monitor device can be well adapted for guardianship, the behaviors and habits of people.
In order to further support above-mentioned functions, the monitor system further comprises mood detecting and alarm.With on monitor device
Other signal transacting engines it is similar, mood detection learnt within a certain period of time by unsupervised learning using neutral net or
Solve the behavior act of user.
All induction informations are all transferred to data fusion processor, are fused together.According to except touch key-press and touch
The probability feature for the information that all the sensors are transmitted, employs Kalman filters outside control panel.The Kalman filterings
Device receives particular sensor and reads the probability characteristics of information and read information and the reading information of other sensors by described
Fusion gets up to have for being formed end user's pattern of confidence level as high as possible.
In one embodiment, sensor fusion treatment device by vision process and natural language detection all merged from
And monitor emergency health situation.So, the monitor device just can form credible using the various sensors connected
State of user's pattern to detect user, including health status.
The state forecast, update and exported by Kalman filters is exactly user's pattern.User's pattern is such as
Shown in Figure 10.User pattern embodied user, i.e., between the mood of guardianship such as old man, posture and monitor device away from
From, whether speak, whether do gesture, health status, activity and whether in room.User's pattern is evaluated on time
And store, and each time block is updated when stylish sensor reads information by Kalman filters.
Kalman filters are the algorithms widely used, its part of application as the present invention.So, the monitor device can be
The state constantly to user carries out high probability assessment any time.
In other embodiment, the monitor device uses a kind of different data anastomosing algorithm, and it includes
Ordered Weighted average filter, Bayesian methods or Dempster Shafer methods.
User's pattern is used to do decision-making, so as to export interactive effect information, commonly referred to as sensor information point
Split or crack.The decision-making is asked using unsupervised learning to user's interaction to make up society isolation sense and related health
Topic.For example, monitoring the melancholy and suggestion that a series of Voice ＆ Video may be provided after impatience of old man so as to help
The people that helps the elderly adjusts mood.After some times, unsupervised learning can just utilize the feedback information of old man, so as to correctly select
Select the type suitable for the Voice ＆ Video of audiovisual under specific mind state.Monitor device is provided by receiving or refusing suggestion
Feedback information.So, the monitor device can just use cooperatively the hobby of person, thus improve the health of old man, it is happiness, happy
With society relegation sense.
Another embodiment includes suggestiveness hygienic measures, to be asked in cardiac monitoring Sensor monitoring to heart
The problems such as being quivered when topic to the heart provides help.The suggestiveness hygienic measures includes but is not limited to suggestion health worker, contact
Doctor, the personnel for being provided with the care video quivered and having same cardiac problem share information, provide relevant product information.
Monitor device and the interaction mechanism of user have carried out complete customized improvement to Android operation system, including divide
Fork, modification etc. are improved, and the interface that old man uses is suitable for so as to provide.The interface is as shown in fig. s 11a through 11d.For example,
Button body is larger in Figure 11 A, the general image with intuition, is also equipped with more eye-catching word indicating.This interface can lead to
Cross sound instruction, limb action or touch progress and search choosing.Therefore, this user interface is used more flexibly, and for
The old man for having touch, movement or voice disorder can also be applicable.
A kind of big square icon is each employed corresponding to the application of every kind of Android and lower section also carries word indicating.These
Application software is arranged by class, can be selected by the membrane keyboard with icon on display screen, and the Android of standard is operated
It is unclassified.During the installation of new Android application software, user, which can choose new Android application in advance, to return
The classification entered.In the case where not chosen to classification, Android application will be assigned to general miscellany.
Two embodiments shown in Figure 11 B and 11C show the feelings of the monitor device display screen under two kinds of concrete conditions
Shape.For example, Figure 11 B present the relevant social or alternative icon membrane keyboard of exchange way on display screen, and Figure 11 C are in then
The alternative icon membrane keyboard of relevant health status on display screen is showed.
Again as shown in Figure 11 D, using the control button being located on display screen on three angles, it can enter for the option of menu
Row searches choosing, wherein three buttons intuitively point to different directions respectively.So, provide for convenient, flexible in addition to touch-screen
Search player section.
In order to realize the user for being related to other sound and action behavior interactive and modification that is being carried out to Android operation system
And adjustment, carry out modification and adjustment to Android kernel, Android hardware abstraction layer (HAL) and Android Java superficial layers.As
A part for technical solution of the present invention there is provided the monitor device user interface easy to use of the old man based on Android system so as to
Enough it is applied to the situation that various old man's behaviors are limited.
In a kind of embodiment, the Android interface can utilize be connected with Bluetooth or IoT without traditional thread binding
Put and be controlled.These devices include remote control pointer, wheelchair accessory, glasses tracker or ECG interpreter.
It is unselected so as to supervise when monitor device is being spoken or listened to, or in touch interface or LCD display
Protection unit is in the state of wait, and the Android user interface will be changed and show the animated face table shown in Figure 12
Feelings.These animated faces expression can include various types of expression forms described in Figure 13, including talk, listen attentively to, it is glad and
It is sad.So, the monitor device can just show the various facial expressions of simulation people using animated face icon to old man.
More than embodiment be for being further described and demonstrated to technical solution of the present invention, not for pair
The scope of the present invention is limited.The equivalent knot that the specification and claim of those skilled in the art application present invention is done
The change of structure or step, belongs to protection scope of the present invention.
Claims (7)
1. it is a kind of for health care for the aged accompany Nounou intelligent monitoring devices, for detect custodial person include behavior,
The situation that physical signs and mood are characterized, the monitor device includes：
Body posture monitoring unit, can be identified and monitor to the image of the body posture of custodial person；
Behavior act monitoring unit, can be identified and monitor to the behavior act of custodial person；
Mood characterizes monitoring unit, the mood of custodial person can be characterized and be identified and monitor；
Physical signs monitoring unit, can be identified and monitor to the physical signs of custodial person；
The monitor device is also configured with sensing element, including wearable heart monitor, wearable wrist for custodial person
Band, wherein the sensing element can be used for obtaining induction information from the custodial person and can filling to the intelligent monitor
Put the transmission induction information；
The intelligent monitoring device can be connected with information system, and described information system includes：
Information receiver, including the wireless senser that monitoring server uses；
Information processor, including high in the clouds computing unit, for handling the induction information, including information identification,
Fusion and division；
Information carrying means, for the induction information acquired in the sensing element is transferred into described information processing dress
Put, and the processing information after the processing of described information processing unit is further transferred to described information reception device；
Information-storing device, including memory card and high in the clouds storage element, for storing the sense acquired in the sensing element
Answer the processing information after information and the processing of described information processing unit；
Wherein, the intelligent monitoring device can include wired connection or wireless connection with the connection of information system.
2. the intelligent monitoring device described in claim 1, including：
Main body, including Main Processing Unit, display, positive photographing element, backward photographing element, touch-control panel, multiple touch key-press,
Connector, battery unit and power outlet；And
Pedestal, the main body is set on the body and can turned using stepper motor relative to the main body
It is dynamic.
3. the intelligent monitoring device described in claim 2, wherein rotation of the main body relative to the pedestal utilizes slip ring
The apparent energy naturally continuously rotated is provided so that the intelligent monitoring device from the pedestal to the rotatable main body
Tracking closely can be carried out to custodial person without being limited by rotation.
4. the intelligent monitoring device described in claim 2, wherein the stepper motor is by built-in controller and by described
Main Processing Unit is controlled, using the teaching of the invention it is possible to provide the slewing rate of optimization and torque.
5. the intelligent monitoring device described in claim 2, wherein the positive photographing element is arranged at the monitoring arrangement front portion
Be wide-angle imaging element within glass surface, using wide-angle lens include 175 degree horizontal view angle and up to 90 degree hang down
Look at angle straight；The backward photographing element includes two parts, is separately positioned on close to two angular positions of left and right, includes up to 90 degree
Horizontal view angle and up to 45 degree of vertical angle of view；So as to which the positive photographing element and the backward photographing element can be carried
For the full-time continuous omni-directional visual to surrounding environment.
6. the intelligent monitoring device described in claim 2, wherein the touch screen face is capacitive touch screens, is arranged on the master
The positive middle part of body；The multiple button is two capacitance keys, is separately positioned on the main body front described tactile
Two side positions of panel are controlled, so that, the custodial person can enter conveniently by tactile action with the intelligent monitoring device
Row is interactive.
7. the intelligent monitoring device described in claim 2 further comprises guarding electronic system, it includes contact panel, liquid crystal
Show device, 5D card interfaces, microphone, loudspeaker, microcontroller, shooting distributor plate and be connected with the Main Processing Unit it is a variety of outside
Enclose electronic equipment；Wherein described microcontroller can carry out real-time programming, and to realize real-time control, the shooting distributor plate is used
Frequency multiplexing technique is to realize panoramic vision.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610875911.8A CN107016224A (en) | 2016-10-03 | 2016-10-03 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
| CN201710929245.6A CN107895101A (en) | 2016-10-03 | 2017-10-01 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610875911.8A CN107016224A (en) | 2016-10-03 | 2016-10-03 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107016224A true CN107016224A (en) | 2017-08-04 |
Family
ID=59439527
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610875911.8A Pending CN107016224A (en) | 2016-10-03 | 2016-10-03 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
| CN201710929245.6A Withdrawn CN107895101A (en) | 2016-10-03 | 2017-10-01 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710929245.6A Withdrawn CN107895101A (en) | 2016-10-03 | 2017-10-01 | The Nounou intelligent monitoring devices accompanied for health care for the aged |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107016224A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108814567A (en) * | 2018-04-16 | 2018-11-16 | 东南大学 | A kind of family endowment intelligently guards robot system |
| CN108877942A (en) * | 2018-06-11 | 2018-11-23 | 天津科技大学 | A kind of safe assistance system based on artificial intelligence |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107066778A (en) * | 2016-10-03 | 2017-08-18 | 朴植 | The Nounou intelligent guarding systems accompanied for health care for the aged |
| CN110116416B (en) * | 2019-06-17 | 2023-01-20 | 北京大学深圳医院 | Elderly companion drug administration health care robot and drug administration method thereof |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002344946A (en) * | 2001-05-16 | 2002-11-29 | Oki Electric Ind Co Ltd | Monitoring system |
| JP2005279895A (en) * | 2004-03-30 | 2005-10-13 | Advanced Telecommunication Research Institute International | Robot |
| US9044136B2 (en) * | 2007-02-16 | 2015-06-02 | Cim Technology Inc. | Wearable mini-size intelligent healthcare system |
| CN101448142A (en) * | 2007-11-27 | 2009-06-03 | 鸿富锦精密工业（深圳）有限公司 | Image tracking device and image tracking method thereof |
| TWI447660B (en) * | 2009-12-16 | 2014-08-01 | Univ Nat Chiao Tung | Robot autonomous emotion expression device and the method of expressing the robot's own emotion |
| US9019174B2 (en) * | 2012-10-31 | 2015-04-28 | Microsoft Technology Licensing, Llc | Wearable emotion detection and feedback system |
| CN103325080B (en) * | 2013-06-21 | 2016-10-19 | 电子科技大学 | A kind of home for the aged based on technology of Internet of things intelligent safeguard system and method |
| CN103336898A (en) * | 2013-06-24 | 2013-10-02 | 无锡交大联云科技有限公司 | Health monitoring system |
| CN104113618A (en) * | 2014-08-06 | 2014-10-22 | 石家庄恒运网络科技有限公司 | Flexible screen based wearable monitoring device |
| CN107438398A (en) * | 2015-01-06 | 2017-12-05 | 大卫·伯顿 | Portable wearable monitoring system |
| CN104545951A (en) * | 2015-01-09 | 2015-04-29 | 天津大学 | Body state monitoring platform based on functional near-infrared spectroscopy and motion detection |
| CN105976850B (en) * | 2016-04-27 | 2018-05-01 | 北京奇虎科技有限公司 | Intelligent interaction device |
-
2016
- 2016-10-03 CN CN201610875911.8A patent/CN107016224A/en active Pending
-
2017
- 2017-10-01 CN CN201710929245.6A patent/CN107895101A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108814567A (en) * | 2018-04-16 | 2018-11-16 | 东南大学 | A kind of family endowment intelligently guards robot system |
| CN108877942A (en) * | 2018-06-11 | 2018-11-23 | 天津科技大学 | A kind of safe assistance system based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107895101A (en) | 2018-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107066778A (en) | The Nounou intelligent guarding systems accompanied for health care for the aged | |
| Kim et al. | Emergency situation monitoring service using context motion tracking of chronic disease patients | |
| CN112034977B (en) | Method for MR intelligent glasses content interaction, information input and recommendation technology application | |
| CN107016224A (en) | The Nounou intelligent monitoring devices accompanied for health care for the aged | |
| CN107405081A (en) | Obtain the wearable device of diagnostic audio database | |
| JP2022501697A (en) | Myoelectric potential (EMG) assisted communication device with context-sensitive user interface | |
| CN110476141A (en) | Sight tracing and user terminal for executing this method | |
| CN106471860A (en) | Mobile terminal and the method for controlling it | |
| CN110916689A (en) | Cognitive and attention-strengthening intelligent evaluation training system and method for autism | |
| Zanella et al. | Internet of things for elderly and fragile people | |
| Gomez-Donoso et al. | A robotic platform for customized and interactive rehabilitation of persons with disabilities | |
| CN110688910A (en) | Method for realizing wearable human body basic posture recognition | |
| CN109074487A (en) | It is read scene cut using neurology into semantic component | |
| US10848711B2 (en) | Communication system for use with protected persons | |
| CN112286347A (en) | Eyesight protection method, device, storage medium and terminal | |
| Yi et al. | Home interactive elderly care two-way video healthcare system design | |
| CN111444982A (en) | Information processing method and device, electronic equipment and readable storage medium | |
| Iio et al. | Social acceptance by senior citizens and caregivers of a fall detection system using range sensors in a nursing home | |
| CN111263926B (en) | Information processing apparatus, information processing method, and computer-readable storage medium | |
| WO2020144835A1 (en) | Information processing device and information processing method | |
| Pulli et al. | User interaction in smart ambient environment targeted for senior citizen | |
| CN108959585A (en) | A kind of expression picture acquisition methods and terminal device | |
| WO2020122463A1 (en) | Dementia patient training system using virtual reality | |
| KR20210070119A (en) | Meditation guide system using smartphone front camera and ai posture analysis | |
| CN114296627B (en) | Content display method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170804 |