NL2024600B1

NL2024600B1 - Combined medical home device

Info

Publication number: NL2024600B1
Application number: NL2024600A
Authority: NL
Inventors: Koene Juul
Original assignee: Koene Juul
Priority date: 2020-01-03
Filing date: 2020-01-03
Publication date: 2021-09-06
Also published as: WO2021137702A1

Abstract

The present invention is in the field of a combined medical home device for performing measurements. These measurements are considered to represent physical characteristics of a user, such blood pressure and heart beat. The device is a handheld device and is simple to use. The device can contain limited or extended functionality.

Description

COMBINED MEDICAL HOME DEVICE

FIELD OF THE INVENTION The present invention is in the field of a combined medical home device for performing measurements. These measurements are considered to represent physical characteristics of a user, such blood pressure and heart beat. The device is a handheld device and is simple to use. The device can contain limited or extended functionality.

BACKGROUND OF THE INVENTION Typical prior art devices for performing relatively simple tasks have one or more of the following drawbacks. They are inaccessible, relate to high cost of care, are inadequate or no insurance coverage is given. In view of inaccuracy, 1.8 Billion Milleni- als try to self-diagnose on the internet, but the internet contains a lot of misinformation. In view of time consumption, 20 - 30% of all doctors’ visits are by hypochondriacs, who are getting more anxiety from the internet but are not (always) sick; Currently 1 in 8 di- agnoses by a general practitioner is a misdiagnosis. This is due to the high workload and too little time with each patient; Healthcare is organized around (acute) events. However, health is a continuous process and begins with healthy living and prevention; Due to the current healthcare situation, Dutch healthcare providers are spending rough- ly 86 billion euro’s in healthcare of which around 1/8th is related to mental healthcare. Some partial solutions are provided. A disadvantage may be that only search queries are provided to rely on. Thereby data is inherently limited in extent. Also, as mentioned above, often mis-diagnosis occurs, especially o the internet, resulting in mental anxiety. Some devices are not portable, and thereby limited in use. And some devices suffer from lack of privacy, and certainly suffer from lack of control of own data once provided. It is an objective of the present invention to overcome disadvantages of the prior art medical devices without jeopardizing functionality and advantages.

SUMMARY OF THE INVENTION The present invention relates in a first aspect to a combined medical home device, by which with early intervention health costs can be reduced by about 50% of the current expenses. The present medical home device is portable and handheld and combines various possibilities of determining characteristics of a human being. It com-

prises a sensor for obtaining an electrocardiogram, such that heart rhythm, as well as disturbances therein, artery blood flow, and in particular coronary artery blood flow, as well as blood component levels, can be obtained, a switch for activating or deactivating the device, which may be a manual switch or a software switch, such as a switch acti- vated by speech, a transceiver for receiving and sending data, preferably a wireless transceiver, the transceiver adapted to communicate with a central device, typically lo- cated elsewhere, such that input data can be analyzed, such as by comparison with reference data, speech recognition software adapted to receive spoken instructions, such that the present device can perform tasks intended to do, an interactive model manager for controlling the device, for providing an interface between device and user, and adapted for providing questions, at least one microphone for receiving spoken in- struction, typically an array of microphones, at least one speaker for providing audio- output, typically an array of speakers, at least two data storages, each data storage be- ing physically and functionally separated from one and another, at least one first data storage for storing received sensor or camera input, and at least one second data stor- age for storing output data, a processor for processing input data, typically such that personal and private aspects of the data are separated from technical aspects thereof, providing output data, typically relating to the measured data without any reference or link to a user, and for transceiving data, such that the data can be communicated with a typically external located central device, such as a server, or a cloud application, op- tionally a power source, such as a battery, typically being present, but which may be sold separately, optionally a loader for loading the power source, typically being pre- sent, but which may be sold separately, optionally a display, optionally at least one light source, optionally at least one optical indicator, wherein the device is a handheld device and is user adaptable, that is the device can be adapted by a user and can be adapted in view of continued use.

The present device, referred to as “AIVY”, is a novel combination of different existing elements. The combination of these elements in one product is new. By using high quality building blocks AIVY improves healthcare as we know it today and provides a brighter and more healthier future. Typical applications are given below. Such as, for the millennial who uses the internet to search for their symptoms, present invention an autonomous medical device, may give the millennial accurate information about their health at home before they see a doctor. For elderly who say the time of the doctor is valuable and who are having less access to care on a daily base because there is a shortage of elderly care takers. For first time parents who are learning how to be a par- ent and are in need of more information about their newborns health. For people who have a chronic disease and are in need of weekly or monthly checkups. Different from other companies, the present invention may use Big Data (extremely large data sets that may be analyzed computationally to reveal patterns, trends, and associations, es- pecially relating to human behavior and interactions), as well as it uses speech recogni- tion (Voice Al) to comfort the user by listening and asking questions, includes multiple (build-in) sensors that can be used to measure all vital organs (like heart, skin, eyes, brain, lungs), is able to use third party (sensor) data, like temperature, weight, and air quality and is completely privacy proof because all of the users personal data is stored on device. The combination of Big Data and multiple (build-in) sensors provides the us- er with useful accurate information based on their actual well-being and not based on their internet search terms or assumptions; The speech interface gives the user a hu- man interaction, as if they're talking with the doctor; By using AIVY everyday enough data is collected to get a good picture of the medical history of the user. No matter where they are in the world the user may always have complete access to their own medical history. The information that is collected is encrypted/ protected and stored in a way like the device is a data/information vault. The user is in complete control over their own medical information.

lliness can be prevented because it's seen earlier or patterns can be recog- nized if problems recur more; With AIVY, the doctor gets more time for the patients that really need it, diagnosis may be better and the user may have more control over their health at home; All this without the violation of the users privacy and security; Aivy is used wireless and autonomously.

In a first version the device includes an ECG (electrocardiogram) sensor. An electrocardiogram records the electrical signals in one’s heart. It's a common test used to detect heart problems and monitor the heart's status in many situations. Electrocardi- ograms — also called ECGs or EKGs — are often done in a doctor's office, a clinic or a hospital room. And they've become standard equipment in operating rooms and ambu- lances. An ECG is a noninvasive, painless test with quick results. This allows us to un- derstand the level of physiological arousal that someone is experiencing, but it can also be used to better understand someone’s psychological state.

In the first version the device includes a microphone array with a high quality speaker. Using voice recognition software that runs locally on the device. In the first version the device may as well include an infrared night vision camera module. This camera may in the beginning be used for two purposes. One purpose was to use the camera application in the context of pupil deviation. This to track brain activity. By using pupil recognition software and computing power the difference of environmental factors of light on the pupil may be tracked and calculated. The reaction speed may be calcu- lated with the numbers tracked by this formula: rate= Aconcentration/Atime.

The same camera application may be adapted to make pictures of the skin to detect skin diseases, check blood oxygen, body temperature and fat density. The de- vice may be extended with more (complex) sensor applications. Examples of these ap- plications are: humidity sensor, air quality sensor, weight sensor, moist sensor, motion sensor, ultrasonic sensor, blood pressure etc. These extensions can be applied as building blocks to the original center piece. In that way AIVY is a modular system that can be build out as ones at home health hub.

The combination of these build-in sensors, additional sensors and sensor da- ta, a speech application, and certified health researches in one device is unique. AIVY may include a wireless back-up docking station where in the device can be charged with power and where all the personal information can be back upped at the same time. Here the user can use the device in an autonomous way. The main device may only have one button. This button can be used to either, back up, delete or activate the de- vice. The device may be able to sense you in the room with a motion sensor and react on ones presence without violating ones privacy and security. With this, the device is able to remind the user about actions that had to be taken. For example, going to the doctor, take in medicine or check double for development of disease/feeling of the user.

Also the user can address the device by calling AIVY.

The device gives new possibilities to the everyday user and improves the us- ers knowledge on their own health. The composition of the different elements is some- thing new and gives opportunity for the user to get accurate information without having to go on the internet or make an appointment at the general practitioner.

AIVY is a solution for the everyday user, the rehabilitating user, and for the user who has no money or access to health care. AIVY is a new product concept with a new composition of available and new technologies. The combination of the sensor ap- plication with the speech on device and the data on device is new to home devices.

The reason the present invention is not obvious is the fact that it gives people who fear going to the doctor for any reason, and people that feel like they are a burden to their doctor, or people who don’t have any access to a doctor, a chance to monitor their health. This device can handle the standard tests a doctor can do, for example 5 ECG and a few other basic things. Not only does the device listen to the call of the user but it can also measure and interpret the data. So instead of having to go to the doctor and pay a lot of money and time for this with having the chance that you get sent home, the user gets a better picture about their health at home. There are currently no viable devices on the market that can make the same deductions as mine. It is not that the old way of solving the problem was not a good idea, but it is essential to have as accurate data as possible to make a possible diagnosis, and for a possible diagnosis more time and understanding is needed. By giving the doctor more time for the patients that are in need of more specific care, my device can help the people who are in need of a better understanding of their health before they take the step of going to the doctor.

Another reason why present invention is not obvious is that one’s personal data is never leaving the device, you may have full control over one’s own medical data and decide what to do with it. Present invention is, more accurate because it uses dif- ferent elements of gathered information. With this it can be more specific and it may only use certified third-party information. Present invention is more efficient because the user may know immediately what is going on in their life, or have a better view of anoth- er checkup. So, they do not have to go to the doctor and make an appointment only get 10 minutes and need to make another appointment or hear that it's not severe enough which is a complete waste of time for the user. With present invention the user doesn’t have to leave their home. Present invention is faster because it gives direct feedback to the user. Also, because it collects data it can recognize patterns earlier and sickness can be prevented instead of being sick and it’s too late. Present invention is also cheaper than the average doctors visit. Especially in the US a simple doctors visit can cost between 300-600 dollar. Present invention may cost underneath 199 euro and one may have as many doctors’ visits as you like, available 24/7 when you need them and not limited to 10 minutes per visit. One drawback for the user for present invention could be that the user needs to upgrade the device every once in a while to keep the sensors the highest available quality at that moment. A disadvantage of present invention could be that it may take a longer time for practitioners to trust what comes out of present in- vention because there is a lot of misinformation already out in the world so my device has to proof longer that its actually accurate and useful in the medical world. This disad- vantage can be overcome by showing practitioners what it can do and show them its trustworthy. Medical practitioners are also part of the advisory board, this may help with the trust.

In a second aspect the present invention relates to a computer program for a stand-alone and combined medical home device comprising instructions for operating the medical home device according to the invention, the instructions causing the medi- cal home device to carry out the following steps: providing instructions to a user, activating the sensor for obtaining an electro- cardiogram measuring and obtaining said electrocardiogram, storing said electrocardio- gram in the first storage, processing input data and providing output data to the second storage, and transmitting said output data to a central processing unit. Thereby the present invention provides a solution to one or more of the above mentioned problems. Advantages of the present description are detailed throughout the descrip- tion.

DETAILED DESCRIPTION OF THE INVENTION In an exemplary embodiment the present combined medical home device may comprise an optical camera adapted to measure a pupil reflex upon applying light. In an exemplary embodiment the present combined medical home device may comprise an optical camera adapted to measure skin disorders. In an exemplary embodiment the present combined medical home device may comprise a blood sensor for measuring at least one of oxygen content, and blood constituents. In an exemplary embodiment the present combined medical home device may comprise a temperature sensor, such as an ear sensor. In an exemplary embodiment the present combined medical home device may comprise a pressure Sensor. In an exemplary embodiment the present combined medical home device may comprise a motion sensor. In an exemplary embodiment the present combined medical home device may comprise a clock.

In an exemplary embodiment of the present combined medical home device output data may be anonymized by removing at least use and device characteristics from input data.

In an exemplary embodiment of the present combined medical home device the device may be autonomous and/or stand-alone.

In an exemplary embodiment of the present combined medical home device the interactive model manager may be adapted to provide instructions to a user.

In an exemplary embodiment of the present combined medical home device the optical camera may comprise at least one infrared sensor.

In an exemplary embodiment the present computer program may further comprise instructions for comparing input data with reference data.

The invention is further detailed by the accompanying figures and examples, which are exemplary and explanatory of nature and are not limiting the scope of the in- vention. To the person skilled in the art it may be clear that many variants, being obvi- ous or not, may be conceivable falling within the scope of protection, defined by the present claims.

The invention although described in detailed explanatory context may be best understood in conjunction with the accompanying examples and figures.

SUMMARY OF FIGURES Fig. 1a-b, 2a,b,3a,b, 4a,b and 5-15 show views of the present device.

DETAILED DESCRIPTION OF FIGURES In the figures: Drawings of the invention explained.

0, a,b: AIVY complete by itself, Health Hub that speaks, has multiple build-in sensors, and uses additional sensor data and medical researches to give us full control over our health at home.

1, a,b : Camera application used to make pictures and videos of different body parts.

2, a,b,c, d: ECG (electrocardiogram) sensor. An electrocardiogram records the electrical signals in your heart.

3, a,b : Indication lights 4, a: Speaker

5, a,b,c,d : Motion sensor 6: On/Off/Reset button 7, a, b: (Night vision) Camera for pupil analyze 8, a,b,c : Light and infrared application for pupil measurement 9: Pupil : Light ring, rainbow spectrum, interactive ring that gets a different color with different actions and can be personalized by the user when in regular conversation. 11 : Aluminum surface that can be charged wireless and can be used to transmit data to the backup docking station. 10 12 : Docking for device to wirelessly charge and transfer data to backup. 13: Data back up 14 : Encryption : Wireless charging 15 16 : Eye overlap of contraction and dilation of pupil 17 : Difference between size of pupil with dilation or contraction.

This differ- ence will be tracked with the camera application and then can be used to calculate whether the response is good enough or that something is wrong with the brain of the user.

The camera will measure while making a video recording. 18 : Difference and change in iris 19 : Pressure sensor, for the device to check if you hold it right 20 : Movement towards the device.

Hold the device with two hand and the device can do an ECG. 21 : Holding the device, an additional accelerometer and ultrasonic sensor will check the distance and whether you hold the device in the right way. 22 : Sink, context bathroom 23 : Mirror, context bathroom 24 : Human 25 : Lamp, context bedroom 26 : Bed, context bedroom 27 : (Smart) Phone, platform with data that one may include in the device (third party data). 28 : (Smart) Watch, platform with data that one may include in the device (third party data).

29 : (Smart) Temperature measurement device, platform with data that one may include in the device (third party data).

30 : (Smart) Humidifier, platform with data that one may include in the device (third party data).

31: Connected Home, all useful data that you collect in your home with a di- versity of smart devices. (Smart Heater, Smart Light, Air Quality sensor, Radiation etc.) 32 : (Smart) Scale, platform with data that one may include in the device (third party data).

33 : Additional sensors that the user will be able to add to AIVY and which are completely private and secure.

34 : Additional platforms from other parties the user is able to add data from to make their own medical information as complete as possible. (The more useful data the better the device can analyze) 35 : Personal interface for the user to include data without using voice.

36 : Personal Data Encrypted hardware, will never leave the device 37 : Anonymous Data Encrypted hardware, this data will be checked for di- agnosis inside a personal protected cloud. No person from outside is able to come in.

No one can interact with the data without triple verification. High Banking/ Credit card security protocol in place.

38 : Cloud Server where the analysis takes place. No user data is stored here. No one can interact with the data without triple verification. High Banking/Credit card security protocol in place.

39 : Voice input from user, Voice output from device 40 : Visual/data input from user, Visual/ data output from device. (with con- sent of the user) 41 : Data vault, High encryption protocol.

42 : Interactive model manager. The user interaction, call to action, voice backend.

43: Sensors included in the Hardware 44 : AIVY divided software and hardware 45, a,b,c,d: Microphone array 46 : Night stand

It should be appreciated that for commercial application it may be preferable to use one or more variations of the present system, which would similar be to the ones disclosed in the present application and are within the spirit of the invention.

For the purpose of searching the following section is added, which may be considered as embodimenits of the invention, and which section is translated into Dutch in the subsequent section.

DRAWINGS OF THE INVENTION DETAILED EXPLAINED.

Figure 1, schematically shows a perspective view of a O (a,b), AIVY(the de- vice) according to an embodiment of the current invention. AIVY a comprised health hub that uses voice Artificial Intelligence (Al) (speaks), comprises multiple build-in sensors, uses additional sensor data and medical researches to give the user full control over their health at home.

The front and back assembly comprises multiple build-in sensors on the sides, bottom and top. The side of the body comprises sensor 1(a,b), a camera applica- tion used to make pictures and videos of different body parts to use for medical exami- nation. By bringing AIVY to the place on the body you want to have examined AIVY will use the camera application to make two pictures, one very specific and up close, the other further away depending on the environmental influences like lighting and color. Next to the comprised camera application the body also comprises a light and infrared application 8(a,b,c), for pupil measurement. This light and infrared application will also make use of 7(a,b) (Nightvision) Camera for pupil analysis as seen in Figure 6 and 7. This will be explained later. Further more Figure 1 also comprises on the side of the body an 2 (a,b,c,d) ECG (electrocardiogram) sensor. An electrocardiogram records the electrical signals in the heart of the user. Additional this ECG comprises a 19, pressure sensor, for the device to check if you hold it right with the right force. To activate both sensors the user needs to hold AIVY with both hands and give in a little pressure. When the user holds the device with both hands the user will close the circuit and the ECG will be able to get good health data from the users body.

The top of the body comprises a 5 (a,b,c,d) motion sensor. This sensor is used with knowledge of the user to check the environment for motion. In this way the device is able to address the user and give the user a reminder for actions that the user needs to take. For example the user can set a medicine reminder, then when the motion sensor is triggered the device will ask the user if the user took his/her medicine.

Another action could be to remind the user to go to the doctor or give in information that the user got from the doctor.

The top of the body also comprises a 10 (a,b,c,d), Light ring, rain- bow spectrum, interactive ring that gets a different color with different actions and can be personalised by the user when in regular conversation.

Besides this the top also comprises 45 (a,b,c,d) a microphone array.

This microphone array is used to get high sound quality input from the user.

To really understand what the user is saying without any background noise interference.

The back of the device comprises 6 a On/Off/Reset button.

This button has multiple functions needs only usage when the user configures the device, when there is something wrong with the device, when the user needs a break from the device.

The front of the device comprises 3 (a,b,) indication lights.

These lights will give the user knowledge of the device being on and active.

The body of the device comprises a 4 (a) speaker.

This speaker will comprise the whole leftover surface to give the user good sound feedback through voice ai.

The speaker will comprise tweakers and a bass for good sound quality.

Figure 2 schematically shows a perspective view of AIVY the device Front and Back.

Figure 3 schematically shows a perspective view of AIVY the device Top and Bottom.

Where in the top comprises comprises a 5 (a,b,c,d) motion sensor.

This sensor is used with knowledge of the user to check the environment for motion.

In this way the device is able to address the user and give the user a reminder for actions that the user needs to take.

For example the user can set a medicine reminder, then when the motion sensor is triggered the device will ask the user if the user took his/her medicine.

Besides this the top also comprises 45 (a,b,c,d) a microphone array.

This microphone array is used to get high sound quality input from the user.

And the bottom comprises a 11 Alumium surface that can be charged wireless and can be used to transmit data to Figure 4, number 12, docking for the device to wirelessly charge and transfer data to make a backup.

This docking is able to store a 13, data backup, with a 14, encryption as a 41, data vault with a high encryption protocol. While 15, wireless charging the device. This is important because the user is the owner of their own data. For all means this data needs to be protected and thereby the device needs a high encryption protocol to make sure this data is really safe. The wireless charging is important because the user will be able to use the device autonomous. Therefore, can reach every surface on their body to do a medical examination with the device at.

Figure 5 schematically shows a perspective view of the user interaction of AIVY the device to use the 1(a,b), camera application to make pictures and videos of different body parts to use for medical examination. To be more specific for Figure 5, here the camera application will do a pupil analysis. Next to the comprised camera ap- plication the body also comprises a light and infrared application 8(a,b,c), for pupil measurement. This light and infrared application will also make use of 7(a,b) (Night- vision) Camera for pupil analysis as seen in Figure 6 and 7. This will be explained later.

The user takes the device and holds it upclose to either the left or right 9, pu- pil. The voice Al will tell the user where to hold the device and when to hold still. Then the user gets a sound indication until they need to release and take the device away from their pupil.

The front of the device comprises 3 (a,b,) indication lights. These lights will give the user knowledge of the device being on and active.

Figure 6, schematically shows a close up perspective view of the distance for the camera and the pupil to interact with.

Figure 7, schematically shows a close up perspective view of the pupil analy- sis that will take place. With the light and infrared application 8(a,b,c) and the 7(a,b) (Nightvision) camera, comprised in the camera application, the camera application will be used for two purposes. One purpose is to use the camera application in the context of pupil deviation. This to track brain activity. By using pupil recognition software and computing power the difference of environmental factors of light on the pupil will be tracked and calculated. As seen a 16, eye overlap of contraction and dilation of the pu- pil. And a 17, difference between size of pupil with dilation or contraction, as well as 18, difference and change in iris. This difference will be tracked with the camera application and then can be used to calculate whether the response is good enough or that some- thing is wrong with the brain of the user. The camera will measure while making a video recording.

The reaction speed will be calculated with the numbers tracked by this formu- la: Rate= AConcentration/ATime With Rate being the reaction speed With Concentration being the change of the reaction With Time being the time it of the reaction Figure 8, schematically shows different elements comprised in AIVY for a 44, AIVY schematics, divided software and hardware.

Figure 8 comprises a 35, personal interface for the user to include data without using voice.

The means by which the user and the computer system interact, in particular the use of input devices and software.

Figure 8 also comprises a 42, Interactive model manager.

The user interaction, call to action, voice backend.

More detailed in Figure 15. Then there is the AIVYAPI, a set of functions and procedures allowing the creation of applications that access the features or data of an operating system, application, or other service.

The AIVYAPI specifies how software components may interact as well with each other as with the hardware sensors.

AIVYVOICE, comprises a voice assistant, a digital assistant that uses voice recognition, natural language processing and speech synthesis to provide aid to users through the voice recognition application AIVY.

AIVYMOTION, comprises motion detec- tion, a 5 (a,b,c,d) motion sensor, with the process of detecting a change in the position of an object relative to its surroundings or a change in the surroundings relative to an object.

Motion detection can be achieved by either mechanical or electronic methods.

The AIVY schematics, divided software and hardware also comprises AIVYTOOLS, a set of software routines or a complete integrated set of software utilities that are used to develop and maintain the applications and databases.

Figure 9, schematically shows a perspective view of the user interaction of AIVY the device to use the 2 (a,b,c, d), ECG (electrocardiogram) sensor.

An electrocardiogram records the electrical signals in your heart.

Additional this ECG comprises a 19, pressure sensor, for the device to check if you hold it right with the right force.

To activate both sensors the user needs to 20, move both hands towards the device, to hold AIVY with both hands and give in a little pressure.

When the user holds the device with both hands the user will close the circuit and the ECG will be able to get good health data from the users body.

While 21, Hold- ing the device, an additional accelerometer and ultrasonic sensor will check the dis- tance and whether you hold the device in the right way.

The top comprises a 5 (a,b,c,d) motion sensor.

This sensor is used with knowledge of the user to check the environ-

ment for motion.

For example, the user can set a medi- cine reminder, then when the motion sensor is triggered the device will ask the user if the user took his/her medicine.

The top of the body also comprises a 10 (a,b,c,d), Light ring, rainbow spectrum, interactive ring that gets a differ- ent color with different actions and can be personalised by the user when in regular conversation.

Besides this the top also comprises 45 (a,b,c,d) a microphone array.

This microphone array is used to get high sound quality input from the user.

To really under- stand what the user is saying without any background noise interference.

Figure 10, schematically shows a perspective view of the user context of a 0 (a,b), AIVY the device.

The context comprises a bathroom, here visualised by a 22, sink and a 23, mirror.

The user a 24 (a,b), human, walks into the bathroom and there is AIVY the device.

AIVY uses the comprised motion sensor to spot the human and starts to say: “ Good Time_of_the_day.

Should we do a health check?” Whereas the user re- sponds with either yes or no.

More detailed seen in Figure 15, 42, the Interactive model manager.

The user interaction, call to action, voice backend.

Then after the users re- spond the conversation continues either to do a health check or to put in a reminder to do it later.

When the conversation continues with the health check, the conversation comprises a call to action.

Here the device AIVY will ask the user for a medical exami- nation of the users body.

Where as a result the device will draw a conclusion of the gathered data discussed and measured with the user.

The user can as well address the device directly by calling out the name AIVY.

Figure 11, schematically shows a perspective view of the user context of a 0 (a,b), AIVY the device.

The context comprises a bedroom, here visualised by a 26, bed and a 25, lamp.

The device AIVY will here be comprised on a 46, night stand.

The user a 24 (a,b), human, walks into the bedroom and there is AIVY the device.

AIVY uses the comprised motion sensor to spot the human and starts to say: * Good Time_of_the_day.

Should we do a health check?” Whereas the user responds with either yes or no.

More detailed seen in Figure 15, 42, Interactive model manager.

The user interaction, call to action, voice backend.

Then after the users respond the conversation continues either to do a health check or to put in a reminder to do it later.

When the conversation contin- ues with the health check, the conversation comprises a call to action.

Here the device AIVY will ask the user for a medical examination of the user's body.

The user can as well address the device directly by calling out the name AIVY.

Figure 12, schematically shows a perspective view of a 0 (a,b), AIVY (the de- vice) according to an embodiment of the current invention.

AIVY a comprised health hub that uses voice Artificial Intelligence (Al) (speaks), comprises multiple build-in sensors, uses additional sensor data from different sources.

The user will be able to comprise sensor data from a 27, (smart) phone, platform with data that you can include in the de- vice (third party data). This data is essentially another company's first-party data that is collected and sold by that brand.

In this case the user can include data and information about their health that they already have gathered through a (smart) phone.

The user is also able to comprise sensor data from a 28, (smart) watch, platform with data that you can include in the device (third party data). This data is essentially another company's first-party data that is collected and sold by that brand.

In this case the user can include data and information about their health that they already have gathered through a (smart) watch.

The user is also able to comprise sensor data from a 29, (smart) temper- ature measurement device, platform with data that you can include in the device (third party data). This data is essentially another company's first-party data that is collected and sold by that brand.

In this case the user can include data and information about their health that they already have gathered through a (smart) temperature measure- ment device.

The user is also able to comprise sensor data from a 30, (smart) humidifi- er, platform with data that you can include in the device (third party data). This data is essentially another company's first-party data that is collected and sold by that brand.

In this case the user can include data and information about their health that they already have gathered through a (smart) humidifier.

The user is also able to comprise sensor data from a 32, (smart) scale, platform with data that you can include in the device (third party data). This data is essentially another company's first-party data that is collected and sold by that brand.

In this case the user can include data and information about their health that they already have gathered through a (smart) scale.

The user can also comprise data from their a 31, connected home, all useful data that you collect in your home with a diversity of smart devices. (Smart Heater, Smart Light, Air Quality sensor, Radiation etc). By including all these different data sources, the overal health view of the user will be more complete.

With as result that better conclusions can be made and AIVY can recognise patterns and can prevent illnesses because its seen earlier.

Figure 13, schematically shows a perspective view of all the 43, sensors in- cluded in the hardware.

Figure 14, schematically shows a perspective view of a 0 (a,b), AVY (the device) according to an embodiment of the current invention.

AIVY a comprised health hub that uses voice Artificial Intelligence (Al) (speaks), comprises multiple build-in sensors, uses additional sensor data and medical researches to give the user full control over their health at home.

As well Figure 14 shows the comprised hardware separation within the AIVY, a 36, personal data encrypted hardware part, which will never leave the device.

This gives the, 24 (a,b), user full control over their own medical data and a 37, anonymous data encrypted hardware part, this data will be checked for diagnosis inside a 38, personal protected CloudServer where the analysis takes place.

No user data is stored here.

No one can interact with the data without triple verification.

High Banking/ Creditcard security protocol in place.

No person from outside is able to come in.

No one can interact with the data without triple verification.

High Banking/ Creditcard security protocol in place.

Connected to the CloudServer is a 35, personal interface for the user to include data without using voice.

Within the personal interface the user can also read the reports and additional information about their health.

Too this personal interface the user can also comprise a 34, additional plat- form(s) from other parties the user is able to add data from to make their own medical information as complete as possible. (The more useful data the better the device can analyse). The personal interface is a 40, Visual/data input from the user, Visual/ data output from the device. (with consent of the user). The main interaction with AIVY will be by a 39, voice input from user or voice output from device.

The voice is able to comfort the user and the user has the feeling they are in real conversation with a human being and are taken serious. 33, additional AIVY sensors that the user will be able to add to AIVY and which are completely private and secure and are build in house in a later stage.

These sensors vary and will be added over time.

The data from and within these sensors are completely secure and have a high security protocol in place.

Figure 15, schematically shows a 42, Interactive model manager.

The user interaction, call to action and voice backend.

The general setup comprises multiple vari- ations of different language elements.

The intelligent personal assistant is a software agent that can perform tasks or services for an individual based on commands or ques- tions.

AIVY, uses voice recognition, speech synthesis, and natural language processing (NLP) to provide a service through this particular application.

It should be noted that the figures are purely diagrammatic and not drawn to scale.

In the figures, elements which correspond to elements already described may have the same reference numerals.

It will be appreciated that the invention also applies to computer programs,

particularly computer programs on or in a carrier, adapted to put the invention into prac- tice.

The program may be in the form of a source code, an object code, a code interme- diate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention.

It will also be appreciated that such a program may have many different architectural de-

signs.

For example, a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines.

Many different ways of distributing the functionality among these sub-routines will be apparent to the skilled person.

The sub-routines may be stored together in one execut- able file to form a self-contained program.

Such an executable file may comprise com- puter-executable instructions, for example, processor instructions and/or interpreter in- structions (e.g.

Java interpreter instructions). Alternatively, one or more or all of the sub- routines may be stored in at least one external library file and linked with a main pro- gram either statically or dynamically, e.g. at run-time.

The main program contains at least one call to at least one of the sub-routines.

The sub-routines may also comprise function calls to each other.

An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing stage of at least one of the methods set forth herein.

These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynami- cally.

Another embodiment relating to a computer program product comprises comput- er-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein.

These instructions may be sub-divided into sub- routines and/or stored in one or more files that may be linked statically or dynamically.

The carrier of a computer program may be any entity or device capable of carrying the program.

For example, the carrier may include a data storage, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording me- dium, for example, a hard disk.

Furthermore, the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means.

When the program is embodied in such a signal, the carrier may be constituted by such a cable or other device or means.

Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or used in the performance of, the relevant method. It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many al- ternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limit- ing the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or stages other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such ele- ments. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mu- tually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Examples, embodiments or optional features, whether indicated as non- limiting or not, are not to be understood as limiting the invention as claimed.

EMBODIMENTS

1. Combined medical home device comprising a sensor for obtaining an electrocardiogram, a switch for activating or deactivating the device, a transceiver for receiving and sending data, preferably a wireless transceiver, speech recognition software adapted to receive spoken instructions, an interactive model manager for controlling the device, for providing an interface between device and user, and adapted for providing questions, at least one microphone for receiving spoken instruction, at least one speaker for providing audio-output, at least two data storages, each data storage being physically and functionally separated from one and another, at least one first data storage for storing received sen- sor or camera input, and at least one second data storage for storing output data, a processor for processing input data, providing output data, and for transceiving data, optionally a power source, such as a battery,

optionally a loader for loading the power source, optionally a display, optionally at least one light source, optionally at least one optical indicator, wherein the device is a handheld device and is user adapt-able.

2. Combined medical home device according to embodiment 1 comprising an optical camera adapted to measure a pupil reflex upon applying light.

3. Combined medical home device according to any of embodiments 1-2 comprising an optical camera adapted to measure skin disorders.

4. Combined medical home device according to any of embodiments 1-3 comprising a blood sensor for measuring at least one of oxygen content, and blood constituents.

5. Combined medical home device according to any of embodiments 1-4 comprising a temperature sensor, such as an ear sensor, a pressure sensor, a motion sensor, a clock, and combinations thereof.

6. Combined medical home device according to any of embodiments 1-5, wherein out- put data is anonymized by removing at least use and device characteristics from input data.

7. Combined medical home device according to any of embodiments 1-6 wherein the device is autonomous and/or stand-alone.

8. Combined medical home device according to any of embodiments 1-7 wherein the interactive model manager is adapted to provide instructions to a user.

9. Combined medical home device according to any of embodiments 1-8 wherein the optical camera comprises at least one infrared sensor.

10. A computer program for a stand-alone and combined medical home device compris- ing instructions for operating the medical home device according to one of the embodi- ments 1-9, the instructions causing the medical home device to carry out the following steps: providing instructions to a user, activating the sensor for obtaining an electrocardiogram and measuring and ob- taining said electrocardiogram, storing said electrocardiogram in the first storage, processing input data and providing output data to the second storage, and transmitting said output data to a central processing unit.

11. Computer program according to embodiment 10, further comprising instructions for comparing input data with reference data.

12. A combined medical home device substantially as described in the description, or in the figures, or in the above embodiments, or a combination thereof.

Claims

CONCLUSIONS

A combined home medical device comprising a sensor for acquiring an electrocardiogram, a switch for activating or deactivating the device, a transceiver for receiving and transmitting data, preferably a wireless transceiver, speech recognition software adapted to speak receive instructions, an interactive model manager for controlling the device, providing an interface between device and user, and adapted for asking questions, at least one microphone for receiving spoken instructions, at least one speaker for providing audio output, at least two data stores, each data store being physically and functionally separate from each other, at least a first data store for storing received sensor or camera input, and at least a second data store for the storage of output data, a processor for processing input data vens, providing output data, and receiving data, optionally a power source, such as a battery, optionally a charger for charging the power source, optionally a display, optionally at least one light source, optionally at least a visual indicator, in which the device is a handheld device and can be adjusted by the user.

The combined home medical device according to claim 1, comprising an optical camera adapted to measure a pupillary reflex when providing light.

The combined home medical device according to any one of claims 1-2, comprising an optical camera adapted to measure skin abnormalities.

A combined home medical device according to any one of claims 1 to 3, comprising a blood detector for measuring at least one oxygen content, and blood components.

The combined home medical device according to any one of claims 1-4, comprising a temperature sensor, such as an ear sensor, a pressure sensor, a motion sensor, a clock, and combinations thereof.

A combined home medical device according to any one of claims 1-5, wherein output data is anonymized by removing at least the usage and device characteristics from the input data.

A combined home medical device according to any one of claims 1-6, wherein the device is autonomous and/or stand-alone.

The combined home medical device of any one of claims 1 to 7, wherein the interactive model manager is adapted to instruct a user.

The combined home medical device according to any one of claims 1-8, wherein the optical camera comprises at least one infrared sensor.

A computer program for a stand-alone and combined home medical device having instructions for operating the home medical device according to any one of claims 1-9, wherein the instructions cause the home medical device to perform the following steps: providing instructions to a user, activating the sensor to acquire an electrocardiogram, and measuring and obtaining that electrocardiogram, storing the electrocardiogram in the primary storage, processing input data, and supplying output data to the second storage, and sending this output data to a central processing unit.

The computer program of claim 10, further comprising instructions for comparing the input data with the reference data.

A combined home medical device substantially as described in the specification, or in the figures, or in the claims, or a combination thereof.