WO2022258560A1 - Système d'aide pour fournir une information de diagnostic - Google Patents
Système d'aide pour fournir une information de diagnostic Download PDFInfo
- Publication number
- WO2022258560A1 WO2022258560A1 PCT/EP2022/065309 EP2022065309W WO2022258560A1 WO 2022258560 A1 WO2022258560 A1 WO 2022258560A1 EP 2022065309 W EP2022065309 W EP 2022065309W WO 2022258560 A1 WO2022258560 A1 WO 2022258560A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- person
- data
- sensor
- correction
- acquire
- Prior art date
Links
- 238000012545 processing Methods 0.000 claims abstract description 66
- 238000012937 correction Methods 0.000 claims abstract description 59
- 201000010099 disease Diseases 0.000 claims abstract description 55
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 55
- 238000005259 measurement Methods 0.000 claims abstract description 38
- 208000025721 COVID-19 Diseases 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims description 21
- 230000004044 response Effects 0.000 claims description 20
- 238000013473 artificial intelligence Methods 0.000 claims description 19
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 12
- 230000036387 respiratory rate Effects 0.000 claims description 10
- 238000011156 evaluation Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 6
- 238000003745 diagnosis Methods 0.000 description 16
- 238000012512 characterization method Methods 0.000 description 9
- 238000012774 diagnostic algorithm Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000004927 fusion Effects 0.000 description 7
- 230000000747 cardiac effect Effects 0.000 description 6
- 238000013500 data storage Methods 0.000 description 6
- 230000000241 respiratory effect Effects 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 5
- 230000033764 rhythmic process Effects 0.000 description 5
- 210000000216 zygoma Anatomy 0.000 description 5
- 206010003119 arrhythmia Diseases 0.000 description 4
- 238000009529 body temperature measurement Methods 0.000 description 4
- 230000006793 arrhythmia Effects 0.000 description 3
- 238000002496 oximetry Methods 0.000 description 3
- 206010008479 Chest Pain Diseases 0.000 description 2
- 206010011224 Cough Diseases 0.000 description 2
- 206010068319 Oropharyngeal pain Diseases 0.000 description 2
- 201000007100 Pharyngitis Diseases 0.000 description 2
- 208000036071 Rhinorrhea Diseases 0.000 description 2
- 206010039101 Rhinorrhoea Diseases 0.000 description 2
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011109 contamination Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000017574 dry cough Diseases 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 239000001301 oxygen Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000001429 visible spectrum Methods 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000004659 sterilization and disinfection Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 210000000689 upper leg Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
- A61B5/015—By temperature mapping of body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
- A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
Definitions
- the present invention relates to an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19.
- the subject of the invention is thus a system for detecting a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data,
- [7] - a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease .
- the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and to supply said diagnostic information.
- the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
- the display device is a laptop computer screen and the data processing device includes this computer's microprocessor.
- the display device is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display device and data processing being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device and possibly also the data processing device, are arranged to be embedded in a motor vehicle.
- the display device and possibly also the data processing device, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device is arranged to make the diagnosis automatically, without human intervention.
- the invention allows rapid diagnosis and/or massive screening allowing a return to work or faster deconfinement.
- the examination data acquisition device is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to examine.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safety distance, of vital signals and of thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measurements.
- the invention due to relatively light equipment, notably allows easy deployment of field hospitals in support of populations.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy. The invention allows its rapid implementation throughout a territory.
- the acquisition device comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person tested providing data characterization of the person.
- the data processing device is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a respiratory rate, an amplitude of respiration, a time of inspiration and expiration, heart rhythm and arrhythmia.
- the algorithm uses temperatures measured on remarkable areas, located by image processing, or even the oxygen level linked to the person examined.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as data on age, gender, clothing, height, body mass index , also called BMI.
- the system is arranged to carry out the acquisition of examination data until the provision of the diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the system is arranged to allow acquisition of examination data by taking measurements at a distance of 60 cm to 2 m between the acquisition device and the person. It is avoided that the person has to be in contact with the acquisition device.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. Diagnostic information can, if necessary, be automatically sent to a doctor and can be kept on a cloud-type data storage system.
- the data processing device uses an algorithm for analyzing the acquired examination data and, if necessary, for sorting people with the aim of detecting cases of sick people, based on all the data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
- This learning by artificial intelligence can be carried out by means of a set of measurements collected by the system but also by means of the medical follow-up of patients. This allows the improvement of the model over time.
- the measurements taken by the acquisition device can be used to subsequently refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate, a maximum face temperature and a reference temperature-controlled garment or surface temperature.
- the remarkable measurement points are located by an artificial intelligence by means of an object identification flowchart.
- the temperature relative to a remarkable point is obtained by time average and by average of the temperatures of a surface defined by pixels taken from an infrared camera image near the remarkable point identified on the visible image by means of an object identification algorithm.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to an identity reading of the person, thanks to a classification system which can be learned on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, a class of personal characteristics, a time of day, can be arranged to additionally use route data of the examined person to check whether he has come across a sick person or has passed through a region at risk.
- the system is arranged to operate in the absence of a radar and using RGB cameras to estimate cardiac and respiratory parameters.
- the temperature relative to a remarkable point can be obtained by time average and by average of the temperatures of a surface defined by pixels taken from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it, for example by means of the geometric mean of the sides of the image area.
- This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the system does not have an RGB camera and/or does not use the surface whose temperature is controlled.
- the system uses the external temperature and a heat transfer model on the covered areas or even only the temperature differences between the remarkable points.
- the system is arranged to use a fusion of non-contact measurements, in particular of vital signals and thermal and visible imaging.
- the diagnostic information is comprised of a class chosen from among three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
- Diagnostic information may also include an assessment of disease severity.
- the invention also relates to a method for providing diagnostic information for the detection of a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- an acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera to acquire this examination data
- the present invention can allow controls in the public space in general, in particular on people's circulation routes, at entrances and exits of buildings, at airport gates, in schools.
- a further subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data
- this device for acquisition comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person,
- a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular to be representative of a level of probability that the person is suffering from the disease, this level of probability being able in particular to be a score.
- the invention allows, thanks to the plurality of sensors that operate without contact with the person to be examined, to have enough data to establish a more reliable diagnosis.
- the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and provide said diagnostic information.
- the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
- the display device and possibly also the data processing device, are arranged to be mounted on a motor vehicle.
- the contactless sensor arranged to acquire response data provided by the person comprises a microphone arranged to receive responses provided orally by the person.
- the contactless sensor can, as a variant of the microphone which works with voice recognition, include means for analyzing the person's face to, for example, recognize a YES or a NO, for example by nodding.
- the contactless sensor may include means allowing the person to point to an answer on a screen with a finger, without contact with the screen.
- the system is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to be examined, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, for example the microphone being used to record the person's answers.
- the system comprises a data storage unit, for example forming part of a computer, arranged to store the questions of the questionnaire.
- the data processing device is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process these data in combination with data coming from other sensors of the acquisition device, with a view to providing the diagnostic information of the disease.
- the data processing device in order to obtain the diagnostic information, is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person , including respiratory rate, amplitude of respiration, time of inspiration and expiration, cardiac rhythm and arrhythmia, with also questionnaire response data.
- the system is arranged in such a way as to select the questions to be asked according to the person to be examined, in particular one or more data available on the person.
- the questions to be asked are of a medical nature, useful for improving the diagnosis in combination with the other data.
- the questions are chosen from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
- the system is arranged to perform, using one of the contactless sensors, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
- the system is arranged to acquire data relating to a context, for example an ambient temperature.
- the system is arranged to carry out a sorting based on a static model to give a score associated with the diagnosis.
- the system is arranged to operate the following steps: receiving consent data from the person to be subjected to the examination, acquiring characterization data from the person such as as gender, age, height, and data representative of the context, acquiring data in response to questions, including using a microphone, and measurements of vital signs, processing data to allow an evaluation of the level of reliability of the diagnostic information, possibly ask additional questions if necessary to refine the diagnostic information, carry out a sorting based on a static model to give a score associated with the diagnosis.
- contactless sensors are arranged to allow measurement acquisition at a distance from the person to be examined, between 50 cm and 2 m.
- Another object of the invention is a terminal that includes the help system as mentioned above.
- This terminal can for example include a processing unit arranged to process data from the sensors and deliver diagnostic information.
- This processing unit can be a computer, with or without a screen on the terminal.
- This terminal notably includes the various sensors.
- This terminal can be installed at the entrance of a building, for example.
- Another subject of the invention is an aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data, this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person, this sensor being in particular a microphone,
- this information of diagnosis which can in particular be representative of a level of probability that the person is affected by the disease, this level of probability which can in particular be a score.
- Another subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such as a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire a response datum provided by the person,
- a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability being able in particular to be a score
- the acquisition device further comprising a correction sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor,
- the data processing device being arranged to use this correction data to correct the examination data supplied by the first sensor.
- the correction sensor is arranged to acquire data representative of a movement of the person.
- this correction sensor comprises a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
- This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
- TOF Time of Flight
- this camera is an RGB camera operating with, for example, a body segmentation tool or a platform equipped with a strain gauge on which the person is installed, which person can be standing, lying or sitting.
- the correction sensor is arranged to acquire data representative of a voice of the person.
- this correction sensor arranged to acquire data representative of a voice of the person comprises a microphone (33), in particular a directional microphone or a camera.
- the acquisition device comprises both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire data representative of a person's voice.
- the first sensor in particular being a physiological measurement sensor, is a radar arranged in particular to acquire data representative of a breathing rate of the person, in particular by detecting the movement of the person's skin.
- the radar is arranged to be placed in front of the person or behind the person's back.
- the data processing device is arranged to carry out the correction of the examination data according to the correction data using artificial intelligence.
- the data processing device is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
- the data processing device is arranged to provide the examination data, for example related to the respiratory rate, after correction using the correction signal.
- the invention makes it possible to take into account the noise related to the movements of the person and/or to his voice, to provide reliable and precise examination data.
- Another object of the invention is a method for providing assistance with diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- the invention has the advantage of being able to cross-reference data in order to obtain a more reliable and/or more robust result.
- the invention makes it possible to evaluate this disturbance thanks to a microphone or a camera that allows lip reading or even by means of a 4D camera or an inertial balance.
- the method according to the invention comprises the step of taking into account the weight of the evaluations of the parameters acquired to obtain the result.
- the invention recommends giving more weight to the least disturbed parameters.
- the method in the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the method presents the stage of evaluating this disturbance using a microphone or a camera that allows lip reading or even using a 4D camera or an inertial balance, to correct the examination data.
- Figure 1 schematically illustrates a system according to a non-limiting embodiment of the invention.
- FIG. 1 shows a block diagram illustrating the steps implemented in the system of Figure 1
- FIG. 3 illustrates a block diagram illustrating the steps implemented in a system according to another example of implementation of the invention
- Figure 4 shows curves illustrating the effect of the corrections obtained thanks to the invention.
- FIG. 1 and 2 There is shown in Figures 1 and 2 an aid system 1 for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, according to the invention.
- This system 1 includes:
- a data processing device 3 arranged to receive these examination data obtained by the acquisition device 7, - a display device 30 arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information possibly being representative of a level of probability that the person is suffering from the disease.
- This system 1 includes in particular:
- this sensor being a camera operating in the near infrared
- a respiratory activity sensor in particular in frequency and/or respiratory amplitude, of at least one passenger, this sensor being a camera operating in the far infrared, or thermal camera,
- a radar arranged to measure the person's vital signs
- a sensor of the passenger's profile characteristics in particular his gender, weight, height and age, this sensor being here a Red Green Blue camera, also called RGB camera in English,
- - a card reader to read a person's identity card and obtain the person's personal data.
- sensors and cameras which are part of the acquisition device 7, are represented by the reference 2 in Figure 1.
- Some sensors 2 are for example arranged on a ceiling of the vehicle.
- One of the other cameras 2 is arranged in a side upright 6 of the vehicle V.
- the heart rate and respiration sensor may be in the seat back or in the center console at the level of the passenger's thigh, this being non-limiting.
- These sensors 2 are connected for exchange of information with a data processing device 3 placed on the vehicle V.
- the data processing device 3 comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device 7 and supply said diagnostic information.
- the data processing device 3 and the display device 30 are part of the same device, for example a computer, in particular a laptop computer.
- the display device 30 is a screen of the laptop computer and the data processing device includes this computer's microprocessor.
- the display device 30 is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and processing devices data being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device 30, and also the data processing device 3, are here arranged to be embedded in a motor vehicle.
- the display device 30, and possibly also the data processing device 3 are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device 3 is arranged to make the diagnosis automatically, without human intervention.
- the examination data acquisition device 7 is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to be examined.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safe distance, vital signals and thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measures.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a sensor of physiological measurement such as a radar and a portable personal computer, is easy.
- the acquisition device 7 comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person being tested providing data characterizing the person.
- the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a breathing rhythm, a breathing amplitude, an inspiration and expiration time, a rhythm and cardiac arrhythmia, oximetry.
- the algorithm uses temperatures measured on remarkable areas, localized by image processing.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as data on age, gender, dress, height, body mass index.
- the system is designed to carry out the acquisition of examination data until the provision of diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example.
- the diagnostic information can, if necessary, be sent automatically to a doctor and can be kept on a data storage system 40 of Cloud type.
- the data processing device 3 uses an algorithm for analyzing the acquired examination data and, if necessary, sorting people with the aim of detecting cases of sick people, based on the set collected data and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment. [127] The measurements taken by the acquisition device can be used to later refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device 7 is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, if necessary , a peak face temperature, and a reference temperature-controlled clothing or surface temperature.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to a reading of the person's identity, thanks to a classification system whose learning can be performed on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, class of personal characteristics, time of day, can be arranged to additionally use journey data of the person examined to check whether they have crossed paths with a sick person or passed through a region at risk.
- the temperature relative to a remarkable point can be obtained by temporal average and by average of the temperatures of a surface defined by pixels resulting from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
- diagnostic information for the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease (step 29).
- Steps 20 to 25 are as follows:
- step 20 the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera), this is step 20,
- step 24 - acquisition of the heart rate in step 23 using the near infrared camera, or NIR camera, - acquisition of vital signs using the radar, in step 24,
- NIR near-infrared
- Examination data may, where appropriate, include pupil size and position.
- Diagnostic information is automatically sent to a cloud-based remote data storage system.
- NIR and FIR are used.
- the FIR camera for temperatures and respiration characteristics and the NIR camera for oximetry and heart rate.
- the acquisition device is in particular arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate , a maximum facial temperature and a temperature of a garment or of a reference temperature-controlled surface, and if applicable a respiratory volume, tremors, the level of oxygen in the blood.
- Figure 3 shows another example of implementation of the invention.
- the help system 1 includes, like the example described above:
- this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data, this device acquisition comprising a plurality of sensors 2 arranged to operate without contact with the person, one at the less contactless sensors being arranged to acquire a response data provided by the person,
- a data processing device 3 arranged to receive these data obtained by several sensors of the acquisition device
- a display device 30 arranged to display diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability possibly being in particular a score.
- One of the contactless sensors 2 arranged to acquire response data provided by the person includes a microphone arranged to receive responses provided orally by the person.
- the system 1 is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to examine, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, here the microphone 33 being used to record the person's answers.
- System 1 comprises a data storage unit, for example part of a computer, arranged to store the questions of questionnaire 34.
- the data processing device 3 is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process this data in combination with data coming from other sensors of the acquisition device, in order to provide the diagnostic information of the disease.
- the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person, in particular a respiratory rate, an amplitude of respiration , a time of inspiration and expiration, cardiac rhythm and arrhythmia, also with questionnaire response data.
- the system is set up in such a way as to select the questions to be asked depending on the person to be examined, in particular one or more data available on the person.
- the system 1 is arranged to perform, using one of the contactless sensors 2, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
- Step 50 corresponds to the beginning of the process of detecting a disease in a person.
- step 51 the person enters, for example, data concerning him, for example his identity, then possibly gives his agreement or consent to continue the diagnostic process.
- This step 51 can be performed by the person via a touch screen 35 coupled to a disinfection device 36 using UV.
- a microphone 33 can be used to record the person's responses to questions.
- a voice recognition device 38 is muted at the microphone 33 to input data picked up by the microphone 33 into the data processing unit 3.
- Context data 37 for example an ambient temperature, can be acquired by a sensor 2.
- step 52 characteristics related to the person are determined using one or more sensors 2 via an object image recognition system 39, as described in the previous example.
- step 52 Additional questions are asked at the end of step 52 to clarify the person's clinical condition.
- step 53 of questions/answers the questions are chosen for example from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
- step 54 the sensors 2 proceed to the acquisition of data relating to the vital signs of the person, as described in the preceding example.
- step 55 the artificial intelligence provides a preliminary score representative of the diagnosis obtained on the basis of the data entered until then.
- step 56 additional questions are asked of the person, and the answers obtained are used to refine the preliminary score obtained in step 55.
- a final score is given in step 57 by the artificial intelligence, which is recorded on the data storage space 40.
- step 58 the final score is displayed for information to the person.
- the aid system 1 for providing diagnostic information slightly different from that described above, comprises:
- this acquisition device comprising at least a first sensor, here a physiological measurement sensor which is a radar for acquiring this examination data,
- a display device 30 arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular be representative of a level of probability that the person is affected by the disease, this level of probability possibly being in particular a score
- the acquisition device 7 further comprising a correction sensor 33 different from said first sensor, namely the radar, and arranged to acquire at least one datum on the person, this datum being a different correction datum from data acquired by the first sensor,
- the data processing device being arranged to use this correction data to correct the examination data provided by the first sensor.
- This correction sensor 33 is arranged to acquire data representative of a person's voice.
- This correction sensor 33 arranged to acquire data representative of a voice of the person comprises a microphone 33, in particular a directional microphone or a camera.
- This correction sensor for acquiring data representative of a person's movement comprises a camera, in particular of the 3D type, for acquiring data representative of a person's movement.
- This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
- TOF Time of Flight
- the radar is arranged in particular to acquire data representative of the person's breathing rate, in particular by detecting the movement of the person's skin.
- the radar is arranged to be placed in front of the person or behind the person.
- the data processing device 3 is arranged to carry out the correction of the examination data according to the correction data using an artificial intelligence.
- the data processing device 3 is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
- the data processing device 3 is arranged to provide the examination data, for example related to the breathing rate, after correction using the correction signal.
- the invention makes it possible to take into account the noise linked to the movements of the person and/or to his voice, in order to provide reliable and precise examination data.
- Curve 101 illustrates the magnitude of the error, over time, in a measurement of respiratory rate on the person, this error being induced by movements of the person during the measurement and by the fact that she speaks during the measurement.
- Curve 102 shows the magnitude of the error, over time, in a breathing rate measurement on the person, when taking into account a correction taking into account the movements of the person detected by the camera of movements.
- curve 103 illustrates the amplitude of the error, over time, on a measurement of respiratory rate on the person, when the corrections linked to both the movements and the speech of the patient are taken into account. nobody.
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Physiology (AREA)
- Signal Processing (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Pulmonology (AREA)
- Psychiatry (AREA)
- Cardiology (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22733557.7A EP4351406A1 (fr) | 2021-06-10 | 2022-06-06 | Système d'aide pour fournir une information de diagnostic |
CN202280041372.1A CN117479877A (zh) | 2021-06-10 | 2022-06-06 | 用于帮助提供诊断信息的系统 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2106142A FR3123795A1 (fr) | 2021-06-10 | 2021-06-10 | Système d’aide pour fournir une information de diagnostic |
FRFR2106142 | 2021-06-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022258560A1 true WO2022258560A1 (fr) | 2022-12-15 |
Family
ID=76807856
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2022/065309 WO2022258560A1 (fr) | 2021-06-10 | 2022-06-06 | Système d'aide pour fournir une information de diagnostic |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP4351406A1 (fr) |
CN (1) | CN117479877A (fr) |
FR (1) | FR3123795A1 (fr) |
WO (1) | WO2022258560A1 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220104771A1 (en) * | 2020-10-06 | 2022-04-07 | Nec Corporation Of America | Automated health check device and methods |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180153422A1 (en) * | 2016-12-01 | 2018-06-07 | Panasonic Intellectual Property Management Co., Ltd. | Biological information detection apparatus that includes a light source projecting a near-infrared pattern onto an object and an imaging system including first photodetector cells detecting near-infrared wavelength light and second photodetector cells detecting visible wavelength light |
US20180307927A1 (en) * | 2017-04-24 | 2018-10-25 | Oxehealth Limited | In-Vehicle Monitoring |
US10426380B2 (en) * | 2012-05-30 | 2019-10-01 | Resmed Sensor Technologies Limited | Method and apparatus for monitoring cardio-pulmonary health |
-
2021
- 2021-06-10 FR FR2106142A patent/FR3123795A1/fr active Pending
-
2022
- 2022-06-06 WO PCT/EP2022/065309 patent/WO2022258560A1/fr active Application Filing
- 2022-06-06 EP EP22733557.7A patent/EP4351406A1/fr active Pending
- 2022-06-06 CN CN202280041372.1A patent/CN117479877A/zh active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10426380B2 (en) * | 2012-05-30 | 2019-10-01 | Resmed Sensor Technologies Limited | Method and apparatus for monitoring cardio-pulmonary health |
US20180153422A1 (en) * | 2016-12-01 | 2018-06-07 | Panasonic Intellectual Property Management Co., Ltd. | Biological information detection apparatus that includes a light source projecting a near-infrared pattern onto an object and an imaging system including first photodetector cells detecting near-infrared wavelength light and second photodetector cells detecting visible wavelength light |
US20180307927A1 (en) * | 2017-04-24 | 2018-10-25 | Oxehealth Limited | In-Vehicle Monitoring |
Non-Patent Citations (3)
Title |
---|
GU CHANGZHAN ET AL: "A Hybrid Radar-Camera Sensing System With Phase Compensation for Random Body Movement Cancellation in Doppler Vital Sign Detection", IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, IEEE, USA, vol. 61, no. 12, 1 December 2013 (2013-12-01), pages 4678 - 4688, XP011531953, ISSN: 0018-9480, [retrieved on 20131128], DOI: 10.1109/TMTT.2013.2288226 * |
MASSARONI CARLO ET AL: "Contactless Methods For Measuring Respiratory Rate: A Review", IEEE SENSORS JOURNAL, IEEE, USA, vol. 21, no. 11, 11 September 2020 (2020-09-11), pages 12821 - 12839, XP011857227, ISSN: 1530-437X, [retrieved on 20210527], DOI: 10.1109/JSEN.2020.3023486 * |
WILLIAM TAYLOR ET AL: "A Review on the State of the Art in Non Contact Sensing for COVID-19", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 28 July 2020 (2020-07-28), XP081730271 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220104771A1 (en) * | 2020-10-06 | 2022-04-07 | Nec Corporation Of America | Automated health check device and methods |
US11642085B2 (en) * | 2020-10-06 | 2023-05-09 | Nec Corporation Of America | Automated health check device and methods |
Also Published As
Publication number | Publication date |
---|---|
CN117479877A (zh) | 2024-01-30 |
FR3123795A1 (fr) | 2022-12-16 |
EP4351406A1 (fr) | 2024-04-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220331028A1 (en) | System for Capturing Movement Patterns and/or Vital Signs of a Person | |
US20190216333A1 (en) | Thermal face image use for health estimation | |
US20150087926A1 (en) | System and Method for Facilitating Remote Medical Diagnosis and Consultation | |
US20150305662A1 (en) | Remote assessment of emotional status | |
CN108882853B (zh) | 使用视觉情境来及时触发测量生理参数 | |
EP4149345A1 (fr) | Système de détection d'une maladie | |
EP4351406A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
WO2020190648A1 (fr) | Procédé et système de mesure de réflexe pupillaire à la lumière avec un téléphone mobile | |
US20230060676A1 (en) | Multimodal diagnosis system, method and apparatus | |
McGinnis et al. | Validation of smartphone based heart rate tracking for remote treatment of panic attacks | |
WO2023001549A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
US20220189639A1 (en) | Healthcare device, system, and method | |
EP4333695A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
US11523742B2 (en) | System, method, and apparatus for temperature asymmetry measurement of body parts | |
RU188260U1 (ru) | Система на основе термоэлектрических приемников инфракрасного излучения и физиологических датчиков для определения достоверности ответов человека | |
WO2022096309A1 (fr) | Système de détection d'une maladie | |
CN109640819B (zh) | 用于检测对象的哮喘发作或哮喘的设备、系统和方法 | |
US11475564B2 (en) | Non-invasive non-contact system and method for measuring health parameters | |
KR102247712B1 (ko) | 빅데이터를 이용한 피부 진단 방법 및 피부 진단 장치 | |
WO2022101647A1 (fr) | Système de score d'avertissement clinique | |
TW202325221A (zh) | 協助監測糖尿病及高凝血症狀的非接觸式及非侵入式血糖監測 | |
IT202000016252A1 (it) | Sistema di valutazione dell’incidenza territoriale di sintomatologie | |
CN117218154A (zh) | 一种元诊室场景下基于信息熵的患者关注度判别方法 | |
CN116491939A (zh) | 一种用于监测用户血糖值的非接触和非侵入性方法 | |
WO2017009696A1 (fr) | Procédé de collecte et/ou de traitement de données de neuro-marketing et système pour la réalisation de celui-ci |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22733557 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280041372.1 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18569155 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022733557 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022733557 Country of ref document: EP Effective date: 20240110 |