EP4351406A1 - System for assisting with provision of diagnostic information - Google Patents
System for assisting with provision of diagnostic informationInfo
- Publication number
- EP4351406A1 EP4351406A1 EP22733557.7A EP22733557A EP4351406A1 EP 4351406 A1 EP4351406 A1 EP 4351406A1 EP 22733557 A EP22733557 A EP 22733557A EP 4351406 A1 EP4351406 A1 EP 4351406A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- person
- data
- sensor
- correction
- acquire
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 claims abstract description 66
- 238000012937 correction Methods 0.000 claims abstract description 59
- 201000010099 disease Diseases 0.000 claims abstract description 55
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 55
- 238000005259 measurement Methods 0.000 claims abstract description 38
- 208000025721 COVID-19 Diseases 0.000 claims abstract description 16
- 238000000034 method Methods 0.000 claims description 21
- 230000004044 response Effects 0.000 claims description 20
- 238000013473 artificial intelligence Methods 0.000 claims description 19
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 12
- 230000036387 respiratory rate Effects 0.000 claims description 10
- 238000011156 evaluation Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 6
- 238000003745 diagnosis Methods 0.000 description 16
- 238000012512 characterization method Methods 0.000 description 9
- 238000012774 diagnostic algorithm Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000004927 fusion Effects 0.000 description 7
- 230000000747 cardiac effect Effects 0.000 description 6
- 238000013500 data storage Methods 0.000 description 6
- 230000000241 respiratory effect Effects 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 5
- 230000033764 rhythmic process Effects 0.000 description 5
- 210000000216 zygoma Anatomy 0.000 description 5
- 206010003119 arrhythmia Diseases 0.000 description 4
- 238000009529 body temperature measurement Methods 0.000 description 4
- 230000006793 arrhythmia Effects 0.000 description 3
- 238000002496 oximetry Methods 0.000 description 3
- 206010008479 Chest Pain Diseases 0.000 description 2
- 206010011224 Cough Diseases 0.000 description 2
- 206010068319 Oropharyngeal pain Diseases 0.000 description 2
- 201000007100 Pharyngitis Diseases 0.000 description 2
- 208000036071 Rhinorrhea Diseases 0.000 description 2
- 206010039101 Rhinorrhoea Diseases 0.000 description 2
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011109 contamination Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000017574 dry cough Diseases 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 239000001301 oxygen Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000001429 visible spectrum Methods 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 238000013479 data entry Methods 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000004659 sterilization and disinfection Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 210000000689 upper leg Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
- A61B5/015—By temperature mapping of body part
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
- A61B5/7207—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts
- A61B5/721—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal of noise induced by motion artifacts using a separate sensor to detect motion or using motion information derived from signals other than the physiological signal to be measured
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
Definitions
- the present invention relates to an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19.
- the subject of the invention is thus a system for detecting a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data,
- [7] - a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease .
- the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and to supply said diagnostic information.
- the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
- the display device is a laptop computer screen and the data processing device includes this computer's microprocessor.
- the display device is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display device and data processing being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device and possibly also the data processing device, are arranged to be embedded in a motor vehicle.
- the display device and possibly also the data processing device, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device is arranged to make the diagnosis automatically, without human intervention.
- the invention allows rapid diagnosis and/or massive screening allowing a return to work or faster deconfinement.
- the examination data acquisition device is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to examine.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safety distance, of vital signals and of thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measurements.
- the invention due to relatively light equipment, notably allows easy deployment of field hospitals in support of populations.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy. The invention allows its rapid implementation throughout a territory.
- the acquisition device comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person tested providing data characterization of the person.
- the data processing device is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a respiratory rate, an amplitude of respiration, a time of inspiration and expiration, heart rhythm and arrhythmia.
- the algorithm uses temperatures measured on remarkable areas, located by image processing, or even the oxygen level linked to the person examined.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as data on age, gender, clothing, height, body mass index , also called BMI.
- the system is arranged to carry out the acquisition of examination data until the provision of the diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the system is arranged to allow acquisition of examination data by taking measurements at a distance of 60 cm to 2 m between the acquisition device and the person. It is avoided that the person has to be in contact with the acquisition device.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. Diagnostic information can, if necessary, be automatically sent to a doctor and can be kept on a cloud-type data storage system.
- the data processing device uses an algorithm for analyzing the acquired examination data and, if necessary, for sorting people with the aim of detecting cases of sick people, based on all the data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
- This learning by artificial intelligence can be carried out by means of a set of measurements collected by the system but also by means of the medical follow-up of patients. This allows the improvement of the model over time.
- the measurements taken by the acquisition device can be used to subsequently refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate, a maximum face temperature and a reference temperature-controlled garment or surface temperature.
- the remarkable measurement points are located by an artificial intelligence by means of an object identification flowchart.
- the temperature relative to a remarkable point is obtained by time average and by average of the temperatures of a surface defined by pixels taken from an infrared camera image near the remarkable point identified on the visible image by means of an object identification algorithm.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to an identity reading of the person, thanks to a classification system which can be learned on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, a class of personal characteristics, a time of day, can be arranged to additionally use route data of the examined person to check whether he has come across a sick person or has passed through a region at risk.
- the system is arranged to operate in the absence of a radar and using RGB cameras to estimate cardiac and respiratory parameters.
- the temperature relative to a remarkable point can be obtained by time average and by average of the temperatures of a surface defined by pixels taken from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it, for example by means of the geometric mean of the sides of the image area.
- This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the system does not have an RGB camera and/or does not use the surface whose temperature is controlled.
- the system uses the external temperature and a heat transfer model on the covered areas or even only the temperature differences between the remarkable points.
- the system is arranged to use a fusion of non-contact measurements, in particular of vital signals and thermal and visible imaging.
- the diagnostic information is comprised of a class chosen from among three predetermined classes which are "Healthy personâ, âPerson with a suspicion of diseaseâ, âPerson with a high probability of diseaseâ.
- Diagnostic information may also include an assessment of disease severity.
- the invention also relates to a method for providing diagnostic information for the detection of a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- an acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera to acquire this examination data
- the present invention can allow controls in the public space in general, in particular on people's circulation routes, at entrances and exits of buildings, at airport gates, in schools.
- a further subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data
- this device for acquisition comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person,
- a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular to be representative of a level of probability that the person is suffering from the disease, this level of probability being able in particular to be a score.
- the invention allows, thanks to the plurality of sensors that operate without contact with the person to be examined, to have enough data to establish a more reliable diagnosis.
- the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and provide said diagnostic information.
- the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
- the display device and possibly also the data processing device, are arranged to be mounted on a motor vehicle.
- the contactless sensor arranged to acquire response data provided by the person comprises a microphone arranged to receive responses provided orally by the person.
- the contactless sensor can, as a variant of the microphone which works with voice recognition, include means for analyzing the person's face to, for example, recognize a YES or a NO, for example by nodding.
- the contactless sensor may include means allowing the person to point to an answer on a screen with a finger, without contact with the screen.
- the system is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to be examined, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, for example the microphone being used to record the person's answers.
- the system comprises a data storage unit, for example forming part of a computer, arranged to store the questions of the questionnaire.
- the data processing device is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process these data in combination with data coming from other sensors of the acquisition device, with a view to providing the diagnostic information of the disease.
- the data processing device in order to obtain the diagnostic information, is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person , including respiratory rate, amplitude of respiration, time of inspiration and expiration, cardiac rhythm and arrhythmia, with also questionnaire response data.
- the system is arranged in such a way as to select the questions to be asked according to the person to be examined, in particular one or more data available on the person.
- the questions to be asked are of a medical nature, useful for improving the diagnosis in combination with the other data.
- the questions are chosen from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
- the system is arranged to perform, using one of the contactless sensors, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
- the system is arranged to acquire data relating to a context, for example an ambient temperature.
- the system is arranged to carry out a sorting based on a static model to give a score associated with the diagnosis.
- the system is arranged to operate the following steps: receiving consent data from the person to be subjected to the examination, acquiring characterization data from the person such as as gender, age, height, and data representative of the context, acquiring data in response to questions, including using a microphone, and measurements of vital signs, processing data to allow an evaluation of the level of reliability of the diagnostic information, possibly ask additional questions if necessary to refine the diagnostic information, carry out a sorting based on a static model to give a score associated with the diagnosis.
- contactless sensors are arranged to allow measurement acquisition at a distance from the person to be examined, between 50 cm and 2 m.
- Another object of the invention is a terminal that includes the help system as mentioned above.
- This terminal can for example include a processing unit arranged to process data from the sensors and deliver diagnostic information.
- This processing unit can be a computer, with or without a screen on the terminal.
- This terminal notably includes the various sensors.
- This terminal can be installed at the entrance of a building, for example.
- Another subject of the invention is an aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data, this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person, this sensor being in particular a microphone,
- this information of diagnosis which can in particular be representative of a level of probability that the person is affected by the disease, this level of probability which can in particular be a score.
- Another subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such as a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire a response datum provided by the person,
- a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability being able in particular to be a score
- the acquisition device further comprising a correction sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor,
- the data processing device being arranged to use this correction data to correct the examination data supplied by the first sensor.
- the correction sensor is arranged to acquire data representative of a movement of the person.
- this correction sensor comprises a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
- This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
- TOF Time of Flight
- this camera is an RGB camera operating with, for example, a body segmentation tool or a platform equipped with a strain gauge on which the person is installed, which person can be standing, lying or sitting.
- the correction sensor is arranged to acquire data representative of a voice of the person.
- this correction sensor arranged to acquire data representative of a voice of the person comprises a microphone (33), in particular a directional microphone or a camera.
- the acquisition device comprises both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire data representative of a person's voice.
- the first sensor in particular being a physiological measurement sensor, is a radar arranged in particular to acquire data representative of a breathing rate of the person, in particular by detecting the movement of the person's skin.
- the radar is arranged to be placed in front of the person or behind the person's back.
- the data processing device is arranged to carry out the correction of the examination data according to the correction data using artificial intelligence.
- the data processing device is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
- the data processing device is arranged to provide the examination data, for example related to the respiratory rate, after correction using the correction signal.
- the invention makes it possible to take into account the noise related to the movements of the person and/or to his voice, to provide reliable and precise examination data.
- Another object of the invention is a method for providing assistance with diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- the invention has the advantage of being able to cross-reference data in order to obtain a more reliable and/or more robust result.
- the invention makes it possible to evaluate this disturbance thanks to a microphone or a camera that allows lip reading or even by means of a 4D camera or an inertial balance.
- the method according to the invention comprises the step of taking into account the weight of the evaluations of the parameters acquired to obtain the result.
- the invention recommends giving more weight to the least disturbed parameters.
- the method in the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the method presents the stage of evaluating this disturbance using a microphone or a camera that allows lip reading or even using a 4D camera or an inertial balance, to correct the examination data.
- Figure 1 schematically illustrates a system according to a non-limiting embodiment of the invention.
- FIG. 1 shows a block diagram illustrating the steps implemented in the system of Figure 1
- FIG. 3 illustrates a block diagram illustrating the steps implemented in a system according to another example of implementation of the invention
- Figure 4 shows curves illustrating the effect of the corrections obtained thanks to the invention.
- FIG. 1 and 2 There is shown in Figures 1 and 2 an aid system 1 for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, according to the invention.
- This system 1 includes:
- a data processing device 3 arranged to receive these examination data obtained by the acquisition device 7, - a display device 30 arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information possibly being representative of a level of probability that the person is suffering from the disease.
- This system 1 includes in particular:
- this sensor being a camera operating in the near infrared
- a respiratory activity sensor in particular in frequency and/or respiratory amplitude, of at least one passenger, this sensor being a camera operating in the far infrared, or thermal camera,
- a radar arranged to measure the person's vital signs
- a sensor of the passenger's profile characteristics in particular his gender, weight, height and age, this sensor being here a Red Green Blue camera, also called RGB camera in English,
- - a card reader to read a person's identity card and obtain the person's personal data.
- sensors and cameras which are part of the acquisition device 7, are represented by the reference 2 in Figure 1.
- Some sensors 2 are for example arranged on a ceiling of the vehicle.
- One of the other cameras 2 is arranged in a side upright 6 of the vehicle V.
- the heart rate and respiration sensor may be in the seat back or in the center console at the level of the passenger's thigh, this being non-limiting.
- These sensors 2 are connected for exchange of information with a data processing device 3 placed on the vehicle V.
- the data processing device 3 comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device 7 and supply said diagnostic information.
- the data processing device 3 and the display device 30 are part of the same device, for example a computer, in particular a laptop computer.
- the display device 30 is a screen of the laptop computer and the data processing device includes this computer's microprocessor.
- the display device 30 is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and processing devices data being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device 30, and also the data processing device 3, are here arranged to be embedded in a motor vehicle.
- the display device 30, and possibly also the data processing device 3 are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device 3 is arranged to make the diagnosis automatically, without human intervention.
- the examination data acquisition device 7 is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to be examined.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safe distance, vital signals and thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measures.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a sensor of physiological measurement such as a radar and a portable personal computer, is easy.
- the acquisition device 7 comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person being tested providing data characterizing the person.
- the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a breathing rhythm, a breathing amplitude, an inspiration and expiration time, a rhythm and cardiac arrhythmia, oximetry.
- the algorithm uses temperatures measured on remarkable areas, localized by image processing.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as data on age, gender, dress, height, body mass index.
- the system is designed to carry out the acquisition of examination data until the provision of diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example.
- the diagnostic information can, if necessary, be sent automatically to a doctor and can be kept on a data storage system 40 of Cloud type.
- the data processing device 3 uses an algorithm for analyzing the acquired examination data and, if necessary, sorting people with the aim of detecting cases of sick people, based on the set collected data and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment. [127] The measurements taken by the acquisition device can be used to later refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device 7 is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, if necessary , a peak face temperature, and a reference temperature-controlled clothing or surface temperature.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to a reading of the person's identity, thanks to a classification system whose learning can be performed on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, class of personal characteristics, time of day, can be arranged to additionally use journey data of the person examined to check whether they have crossed paths with a sick person or passed through a region at risk.
- the temperature relative to a remarkable point can be obtained by temporal average and by average of the temperatures of a surface defined by pixels resulting from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy personâ, âPerson with a suspicion of diseaseâ, âPerson with a high probability of diseaseâ.
- diagnostic information for the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease (step 29).
- Steps 20 to 25 are as follows:
- step 20 the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera), this is step 20,
- step 24 - acquisition of the heart rate in step 23 using the near infrared camera, or NIR camera, - acquisition of vital signs using the radar, in step 24,
- NIR near-infrared
- Examination data may, where appropriate, include pupil size and position.
- Diagnostic information is automatically sent to a cloud-based remote data storage system.
- NIR and FIR are used.
- the FIR camera for temperatures and respiration characteristics and the NIR camera for oximetry and heart rate.
- the acquisition device is in particular arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate , a maximum facial temperature and a temperature of a garment or of a reference temperature-controlled surface, and if applicable a respiratory volume, tremors, the level of oxygen in the blood.
- Figure 3 shows another example of implementation of the invention.
- the help system 1 includes, like the example described above:
- this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data, this device acquisition comprising a plurality of sensors 2 arranged to operate without contact with the person, one at the less contactless sensors being arranged to acquire a response data provided by the person,
- a data processing device 3 arranged to receive these data obtained by several sensors of the acquisition device
- a display device 30 arranged to display diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability possibly being in particular a score.
- One of the contactless sensors 2 arranged to acquire response data provided by the person includes a microphone arranged to receive responses provided orally by the person.
- the system 1 is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to examine, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, here the microphone 33 being used to record the person's answers.
- System 1 comprises a data storage unit, for example part of a computer, arranged to store the questions of questionnaire 34.
- the data processing device 3 is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process this data in combination with data coming from other sensors of the acquisition device, in order to provide the diagnostic information of the disease.
- the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person, in particular a respiratory rate, an amplitude of respiration , a time of inspiration and expiration, cardiac rhythm and arrhythmia, also with questionnaire response data.
- the system is set up in such a way as to select the questions to be asked depending on the person to be examined, in particular one or more data available on the person.
- the system 1 is arranged to perform, using one of the contactless sensors 2, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
- Step 50 corresponds to the beginning of the process of detecting a disease in a person.
- step 51 the person enters, for example, data concerning him, for example his identity, then possibly gives his agreement or consent to continue the diagnostic process.
- This step 51 can be performed by the person via a touch screen 35 coupled to a disinfection device 36 using UV.
- a microphone 33 can be used to record the person's responses to questions.
- a voice recognition device 38 is muted at the microphone 33 to input data picked up by the microphone 33 into the data processing unit 3.
- Context data 37 for example an ambient temperature, can be acquired by a sensor 2.
- step 52 characteristics related to the person are determined using one or more sensors 2 via an object image recognition system 39, as described in the previous example.
- step 52 Additional questions are asked at the end of step 52 to clarify the person's clinical condition.
- step 53 of questions/answers the questions are chosen for example from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
- step 54 the sensors 2 proceed to the acquisition of data relating to the vital signs of the person, as described in the preceding example.
- step 55 the artificial intelligence provides a preliminary score representative of the diagnosis obtained on the basis of the data entered until then.
- step 56 additional questions are asked of the person, and the answers obtained are used to refine the preliminary score obtained in step 55.
- a final score is given in step 57 by the artificial intelligence, which is recorded on the data storage space 40.
- step 58 the final score is displayed for information to the person.
- the aid system 1 for providing diagnostic information slightly different from that described above, comprises:
- this acquisition device comprising at least a first sensor, here a physiological measurement sensor which is a radar for acquiring this examination data,
- a display device 30 arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular be representative of a level of probability that the person is affected by the disease, this level of probability possibly being in particular a score
- the acquisition device 7 further comprising a correction sensor 33 different from said first sensor, namely the radar, and arranged to acquire at least one datum on the person, this datum being a different correction datum from data acquired by the first sensor,
- the data processing device being arranged to use this correction data to correct the examination data provided by the first sensor.
- This correction sensor 33 is arranged to acquire data representative of a person's voice.
- This correction sensor 33 arranged to acquire data representative of a voice of the person comprises a microphone 33, in particular a directional microphone or a camera.
- This correction sensor for acquiring data representative of a person's movement comprises a camera, in particular of the 3D type, for acquiring data representative of a person's movement.
- This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
- TOF Time of Flight
- the radar is arranged in particular to acquire data representative of the person's breathing rate, in particular by detecting the movement of the person's skin.
- the radar is arranged to be placed in front of the person or behind the person.
- the data processing device 3 is arranged to carry out the correction of the examination data according to the correction data using an artificial intelligence.
- the data processing device 3 is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
- the data processing device 3 is arranged to provide the examination data, for example related to the breathing rate, after correction using the correction signal.
- the invention makes it possible to take into account the noise linked to the movements of the person and/or to his voice, in order to provide reliable and precise examination data.
- Curve 101 illustrates the magnitude of the error, over time, in a measurement of respiratory rate on the person, this error being induced by movements of the person during the measurement and by the fact that she speaks during the measurement.
- Curve 102 shows the magnitude of the error, over time, in a breathing rate measurement on the person, when taking into account a correction taking into account the movements of the person detected by the camera of movements.
- curve 103 illustrates the amplitude of the error, over time, on a measurement of respiratory rate on the person, when the corrections linked to both the movements and the speech of the patient are taken into account. nobody.
- this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Animal Behavior & Ethology (AREA)
- Physiology (AREA)
- Signal Processing (AREA)
- Artificial Intelligence (AREA)
- Cardiology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Pulmonology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Dentistry (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The present invention relates to a system (1) for assisting with provision of diagnostic information, especially with a view to detecting a disease in a person, especially a contagious disease such as COVID-19, this detecting system comprising: - a device (7) for acquiring examination data on the person, this acquiring device comprising at least a first sensor, especially a sensor, such as a thermal camera or a radar, of a physiological measurement, for acquiring these examination data, - a data-processing device (3) arranged to receive these data obtained by the acquiring device, - the acquiring device further comprising a correcting sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor, - the data-processing device being arranged to use this correction datum to correct the examination data delivered by the first sensor.
Description
SYSTĂME DâAIDE POUR FOURNIR UNE INFORMATION DEHELP SYSTEM FOR PROVIDING INFORMATION ON
DIAGNOSTIC DIAGNOSTIC
[1] La prĂ©sente invention se rapporte Ă un systĂšme dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19. [1] The present invention relates to an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19.
[2] La détection des malades potentiels du COVID 19 est aujourd'hui réalisée par la prise de température, d'examens cliniques complémentaires, puis par un test COVID 19 qui possÚde encore un niveau de confiance relativement faible. Un scanner pulmonaire peut avec un bon niveau de précision confirmer la gravité de la maladie. [2] The detection of potential COVID 19 patients is now carried out by taking the temperature, additional clinical examinations, then by a COVID 19 test which still has a relatively low level of confidence. A chest scan can with a good level of accuracy confirm the severity of the disease.
[3] Il existe un besoin important de pouvoir détecter rapidement, notamment grùce à des moyens mobiles, les malades potentiels de maladie contagieuse, par exemple la maladie liée au COVID 19. [3] There is a significant need to be able to quickly detect, in particular using mobile means, potential patients with a contagious disease, for example the disease linked to COVID 19.
[4] Lâinvention a ainsi pour objet un systĂšme de dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce systĂšme de dĂ©tection comportant: [4] The subject of the invention is thus a system for detecting a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
[5] - un dispositif dâacquisition de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant notamment au moins un capteur de mesure physiologique tel quâun radar, et une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, [5] - a device for acquiring examination data on the person, this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data,
[6] - un dispositif de traitement de donnĂ©es agencĂ© pour recevoir ces donnĂ©es dâexamen obtenues par le dispositif dâacquisition, [6] - a data processing device arranged to receive these examination data obtained by the acquisition device,
[7] - un dispositif dâaffichage agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, cette information de diagnostic pouvant ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie. [7] - a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease .
[8] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es comporte une unitĂ© dâintelligence artificielle agencĂ©e pour traiter les donnĂ©es dâexamen obtenues par le dispositif dâacquisition et fournir ladite information de diagnostic.
[9] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es et le dispositif dâaffichage font partie dâun mĂȘme appareil, par exemple un ordinateur, notamment un ordinateur portable. [8] According to one of the aspects of the invention, the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and to supply said diagnostic information. [9] According to one of the aspects of the invention, the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
[10] Dans ce cas, le dispositif dâaffichage est un Ă©cran de lâordinateur portable et le dispositif de traitement de donnĂ©es comprend microprocesseur de cet ordinateur. [10] In this case, the display device is a laptop computer screen and the data processing device includes this computer's microprocessor.
[11] Dans une variante, le dispositif dâaffichage est agencĂ© pour ĂȘtre visible de la personne examinĂ©e, et notamment le dispositif dâaffichage, qui comprend notamment un Ă©cran, est distant du dispositif de traitement de donnĂ©es, ces dispositif dâaffichage et de traitement de donnĂ©es Ă©tant par exemple reliĂ©s entre eux par une liaison sans fil, par exemple par un protocole de communication 3G, 4G ou 5G, ou par le rĂ©seau Internet, ou Wifi par exemple. [11] In a variant, the display device is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display device and data processing being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
[12] Selon lâun des aspects de lâinvention, le dispositif dâaffichage, et Ă©ventuellement Ă©galement le dispositif de traitement de donnĂ©es, sont agencĂ©es pour ĂȘtre embarquĂ©s sur un vĂ©hicule automobile. [12] According to one of the aspects of the invention, the display device, and possibly also the data processing device, are arranged to be embedded in a motor vehicle.
[13] En variante, le dispositif dâaffichage, et Ă©ventuellement Ă©galement le dispositif de traitement de donnĂ©es, sont agencĂ©s pour ĂȘtre placĂ©s de maniĂšre fixe, dans un bĂątiment ou une cour extĂ©rieure par exemple. [13] As a variant, the display device, and possibly also the data processing device, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
[14] Selon lâun des aspects de lâinvention, le dispositif de traitement est agencĂ© pour faire le diagnostic de maniĂšre automatique, sans une intervention humaine. [14] According to one of the aspects of the invention, the processing device is arranged to make the diagnosis automatically, without human intervention.
[15] Du fait dâun traitement automatique, lâinvention permet un diagnostic rapide et/ou un dĂ©pistage massif permettant un retour au travail ou un dĂ©confinement plus rapide. [15] Due to automatic processing, the invention allows rapid diagnosis and/or massive screening allowing a return to work or faster deconfinement.
[16] Selon lâun des aspects de lâinvention, le dispositif dâacquisition de donnĂ©es dâexamen est agencĂ© pour permettre des mesures sans contact et Ă distance de sĂ©curitĂ©, de signaux vitaux et d'imagerie thermique et visible sur la personne Ă examiner. [16] According to one of the aspects of the invention, the examination data acquisition device is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to examine.
[17] Le systĂšme selon lâinvention utilise ainsi avantageusement la fusion de mesures sans contact et Ă distance de sĂ©curitĂ©, de signaux vitaux et d'imagerie thermique et visible.
[18] Selon lâun des aspects de lâinvention, lâunitĂ© dâintelligence artificielle est agencĂ©e pour utiliser un modĂšle de diagnostic basĂ© sur l'intelligence artificielle et nourri par un nombre raisonnable de mesures cliniques. [17] The system according to the invention thus advantageously uses the fusion of measurements without contact and at a safety distance, of vital signals and of thermal and visible imaging. [18] According to one of the aspects of the invention, the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measurements.
[19] Lâinvention, du fait dâun Ă©quipement relativement lĂ©ger, permet notamment un dĂ©ploiement facilitĂ© dâhĂŽpitaux de campagne en soutien aux populations. [19] The invention, due to relatively light equipment, notably allows easy deployment of field hospitals in support of populations.
[20] Lâinvention permet de rĂ©alisation des diagnostics de maniĂšre mobile. Sa mise en place, par exemple Ă lâaide dâune camĂ©ra thermique, un capteur de mesure physiologique tel quâun radar et un ordinateur personnel portable, est facile. Lâinvention permet son implantation rapide sur tout un territoire. [20] The invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy. The invention allows its rapid implementation throughout a territory.
[21] Selon lâun des aspects de lâinvention, le dispositif dâacquisition comprend un radar pour acquĂ©rir des donnĂ©es relatives aux signes vitaux de la personne, une camĂ©ra thermique pour les mesures de tempĂ©rature fournissant des donnĂ©es de tempĂ©rature, et une camĂ©ra fonctionnant dans le spectre visible pour la caractĂ©risation de la personne testĂ©e fournissant des donnĂ©es caractĂ©risation de la personne. [21] According to one of the aspects of the invention, the acquisition device comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person tested providing data characterization of the person.
[22] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es est agencĂ© pour faire tourner un algorithme de diagnostic basĂ© sur une fusion des donnĂ©es vitales, notamment un rythme respiratoire, une amplitude de respiration, un temps d'inspiration et d'expiration, un rythme et arythmie cardiaque. [22] According to one of the aspects of the invention, the data processing device is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a respiratory rate, an amplitude of respiration, a time of inspiration and expiration, heart rhythm and arrhythmia.
[23] Selon lâun des aspects de lâinvention, lâalgorithme utilise des tempĂ©ratures mesurĂ©es sur des zones remarquables, localisĂ©es par traitement de l'image, ou encore le taux dâoxygĂšne liĂ© Ă la personne examinĂ©e. [23] According to one of the aspects of the invention, the algorithm uses temperatures measured on remarkable areas, located by image processing, or even the oxygen level linked to the person examined.
[24] De prĂ©fĂ©rence, ces zones remarquables de mesure de tempĂ©rature sont localisĂ©es Ă lâintĂ©rieur de la bouche, sur le bout du nez, sur les pommettes et la paume de la main. [24] Preferably, these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
[25] Selon lâun des aspects de lâinvention, lâalgorithme de diagnostic utilise une caractĂ©risation de la personne, telles que des donnĂ©es dâĂąge, de genre, dâhabillage, de taille, dâindice de masse corporelle, encore appelĂ© BMI. [25] According to one of the aspects of the invention, the diagnostic algorithm uses a characterization of the person, such as data on age, gender, clothing, height, body mass index , also called BMI.
[26] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour rĂ©aliser lâacquisition de donnĂ©es dâexamen jusquâĂ la mise Ă disposition de lâinformation de diagnostic dans un laps de temps compris notamment entre 30 et 120 secondes.
[27] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour permettre une acquisition des donnĂ©es dâexamen en faisant des mesures Ă une distance de 60 cm Ă 2 m entre le dispositif dâacquisition et la personne. On Ă©vite que la personne nâait Ă ĂȘtre en contact avec le dispositif dâacquisition. [26] According to one of the aspects of the invention, the system is arranged to carry out the acquisition of examination data until the provision of the diagnostic information in a period of time comprised in particular between 30 and 120 seconds. [27] According to one of the aspects of the invention, the system is arranged to allow acquisition of examination data by taking measurements at a distance of 60 cm to 2 m between the acquisition device and the person. It is avoided that the person has to be in contact with the acquisition device.
[28] Lâinvention permet ainsi un diagnostic rapide sans dĂ©lai dâacheminement additionnel vers un mĂ©decin par exemple. Les informations de diagnostic peuvent, le cas Ă©chĂ©ant, ĂȘtre envoyĂ©s automatiquement Ă un mĂ©decin et peuvent ĂȘtre conservĂ©s sur un systĂšme de stockage de donnĂ©es de type Cloud. [28] The invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. Diagnostic information can, if necessary, be automatically sent to a doctor and can be kept on a cloud-type data storage system.
[29] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es utilise un algorithme dâanalyse des donnĂ©es dâexamen acquises et, le cas Ă©chĂ©ant, de tri des personnes dans le but de dĂ©tecter les cas de personnes malades, en se basant sur l'ensemble des donnĂ©es collectĂ©es et une intelligence artificielle dont le premier niveau d'apprentissage est rĂ©alisĂ© sur un Ă©chantillon en milieu hospitalier. [29] According to one of the aspects of the invention, the data processing device uses an algorithm for analyzing the acquired examination data and, if necessary, for sorting people with the aim of detecting cases of sick people, based on all the data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
[30] Cet apprentissage par lâintelligence artificielle peut ĂȘtre rĂ©alisĂ©e au moyen d'un set de mesures collectĂ© par le systĂšme mais aussi au moyen du suivi mĂ©dical des patients. Ceci permet l'amĂ©lioration du modĂšle au cours du temps. [30] This learning by artificial intelligence can be carried out by means of a set of measurements collected by the system but also by means of the medical follow-up of patients. This allows the improvement of the model over time.
[31] Selon lâun des aspects de lâinvention, les mesures rĂ©alisĂ©es par le dispositif dâacquisition peuvent servir pour affiner ultĂ©rieurement le diagnostic fait par lâintelligence artificielle. [31] According to one of the aspects of the invention, the measurements taken by the acquisition device can be used to subsequently refine the diagnosis made by the artificial intelligence.
[32] GrĂące Ă lâinvention, la pose dâun diagnostic peut se faire sans contact avec la personne, ce qui limite les risques de contamination, ce qui est particuliĂšrement avantageux par exemple dans le cas dâune pandĂ©mie telle que celle liĂ©e au COVID 19. [32] Thanks to the invention, a diagnosis can be made without contact with the person, which limits the risks of contamination, which is particularly advantageous, for example, in the case of a pandemic such as that linked to COVID 19.
[33] Selon lâun des aspects de lâinvention, les donnĂ©es dâexamen mesurĂ©es comprennent au moins lâune des donnĂ©es suivantes : des tempĂ©ratures mesurĂ©es en diffĂ©rents points du corps de la personne Ă examiner, une caractĂ©ristique respiratoire ou cardiaque. [33] According to one of the aspects of the invention, the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
[34] Selon lâun des aspects de lâinvention, le dispositif dâacquisition est agencĂ© pour acquĂ©rir des donnĂ©es dâexamen comprenant une tempĂ©rature extĂ©rieure, une tempĂ©rature mesurĂ©e sur une pommette de la personne, une tempĂ©rature mesurĂ©e sur le bout du nez de la personne, et Ă©galement le cas Ă©chĂ©ant, une
tempĂ©rature maximale du visage et une tempĂ©rature dâun vĂȘtement ou dâune surface Ă tempĂ©rature contrĂŽlĂ©e de rĂ©fĂ©rence. [34] According to one of the aspects of the invention, the acquisition device is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate, a maximum face temperature and a reference temperature-controlled garment or surface temperature.
[35] Selon lâun des aspects de lâinvention, les points remarquables de mesure sont localisĂ©s par une intelligence artificielle au moyen dâun organigramme dâidentification dâobjet. [35] According to one of the aspects of the invention, the remarkable measurement points are located by an artificial intelligence by means of an object identification flowchart.
[36] Selon lâun des aspects de lâinvention, la tempĂ©rature relative Ă un point remarquable est obtenue par moyenne temporelle et par moyenne des tempĂ©ratures dâune surface dĂ©finie par des pixels issu dâune image de camĂ©ra infrarouge Ă proximitĂ© du point remarquable identifiĂ© sur lâimage visible au moyen dâun algorithme dâidentification dâobjets. [36] According to one of the aspects of the invention, the temperature relative to a remarkable point is obtained by time average and by average of the temperatures of a surface defined by pixels taken from an infrared camera image near the remarkable point identified on the visible image by means of an object identification algorithm.
[37] Selon lâun des aspects de lâinvention, lâidentification des caractĂ©risations personnelles se fait au moyen des camĂ©ras Rouge Vert Bleu (ou camĂ©ra RGB) ou Infrarouge lointain (camĂ©ra FIR) en complĂ©ment dâune lecture dâidentitĂ© de la personne, grĂące Ă un systĂšme de classification dont lâapprentissage peut ĂȘtre rĂ©alisĂ© sur des images RGB (Rouge Vert Bleu) ou Infrarouge. Lâutilisation dâun plus grand nombre de paramĂštres, notamment lâĂąge, le genre, la taille, lâindice de masse corporelle, le phĂ©notype par exemple, sert Ă amĂ©liorer les modĂšles de diagnostic. [37] According to one of the aspects of the invention, the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to an identity reading of the person, thanks to a classification system which can be learned on RGB (Red Green Blue) or Infrared images. The use of more parameters, including age, gender, height, body mass index, phenotype for example, serves to improve diagnostic models.
[38] Selon lâun des aspects de lâinvention, le modĂšle de diagnostic, ou algorithme de diagnostic, qui est nourri de plus de donnĂ©es telles que des tempĂ©ratures remarquables du corps, une tempĂ©rature ambiante, une classe de caractĂ©ristiques personnelles, une heure du jour, peut ĂȘtre agencĂ© pour en plus utiliser des donnĂ©es de parcours de la personne examinĂ©e pour vĂ©rifier si elle a croisĂ© une personne malade ou est passĂ©e par une rĂ©gion Ă risque. [38] According to one of the aspects of the invention, the diagnostic model, or diagnostic algorithm, which is fed with more data such as remarkable body temperatures, ambient temperature, a class of personal characteristics, a time of day, can be arranged to additionally use route data of the examined person to check whether he has come across a sick person or has passed through a region at risk.
[39] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour fonctionner en lâabsence dâun radar et en utilisant les camĂ©ras RGB pour estimer les paramĂštres cardiaques et respiratoires. [39] According to one of the aspects of the invention, the system is arranged to operate in the absence of a radar and using RGB cameras to estimate cardiac and respiratory parameters.
[40] Selon lâun des aspects de lâinvention, la tempĂ©rature relative Ă un point remarquable peut ĂȘtre obtenue par moyenne temporelle et par moyenne des tempĂ©ratures dâune surface dĂ©finie par des pixels issu dâune image de camĂ©ra Ă proximitĂ© du point remarquable. Le point remarquable est par exemple dĂ©fini gĂ©omĂ©triquement au moyen dâune zone dâimage appelĂ©e Building box, qui
lâentoure, par exemple au moyen de la moyenne gĂ©omĂ©trique des cĂŽtĂ©s de la zone de lâimage. Cette zone dâimage est une surface dĂ©limitĂ©e par une sĂ©rie de points qui est construite par un algorithme dâidentification dâobjets. [40] According to one of the aspects of the invention, the temperature relative to a remarkable point can be obtained by time average and by average of the temperatures of a surface defined by pixels taken from a camera image near the remarkable point. The remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it, for example by means of the geometric mean of the sides of the image area. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
[41 ] Selon lâun des aspects de lâinvention, le systĂšme est dĂ©pourvu de camĂ©ra RGB et/ou nâutilise pas la surface dont la tempĂ©rature est contrĂŽlĂ©e. Dans ce cas, le systĂšme utilise la tempĂ©rature externe et un modĂšle de transfert thermique sur les zones habillĂ©es ou encore uniquement les Ă©carts de tempĂ©ratures entre les points remarquables. [41] According to one of the aspects of the invention, the system does not have an RGB camera and/or does not use the surface whose temperature is controlled. In this case, the system uses the external temperature and a heat transfer model on the covered areas or even only the temperature differences between the remarkable points.
[42] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour utiliser une fusion de mesures sans contact, notamment de signaux vitaux et d'imagerie thermique et visible. [42] According to one of the aspects of the invention, the system is arranged to use a fusion of non-contact measurements, in particular of vital signals and thermal and visible imaging.
[43] Lâinformation de diagnostic est comporte une classe choisie parmi trois classes prĂ©dĂ©terminĂ©es qui sont « Personne saine », « Personne avec une suspicion de maladie », « Personne avec une forte probabilitĂ© de maladie ». [43] The diagnostic information is comprised of a class chosen from among three predetermined classes which are "Healthy person", "Person with a suspicion of disease", "Person with a high probability of disease".
[44] Lâinformation de diagnostic peut Ă©galement comporter une Ă©valuation de la gravitĂ© de la maladie. [44] Diagnostic information may also include an assessment of disease severity.
[45] Lâinvention a Ă©galement pour objet un procĂ©dĂ© pour fournir une information de diagnostic pour la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce procĂ©dĂ© comportant les Ă©tapes suivantes: [45] The invention also relates to a method for providing diagnostic information for the detection of a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne, Ă lâaide dâun dispositif dâacquisition comportant notamment au moins un capteur de mesure physiologique tel quâun radar, et une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, - acquiring examination data on the person, using an acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera to acquire this examination data,
- recevoir ces donnĂ©es dâexamen obtenues par le dispositif dâacquisition,- receive this examination data obtained by the acquisition device,
- traiter ces donnĂ©es dâexamen pour obtenir une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, - process this examination data to obtain diagnostic information for the disease based on an analysis of said examination data,
- afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, cette information de diagnostic pouvant ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie.
[46] La prĂ©sente invention peut permettre des contrĂŽles dans lâespace public en gĂ©nĂ©ral, notamment sur des voies de circulation des personnes, Ă des entrĂ©es et sorties des bĂątiments, Ă des portail d'aĂ©roport, dans des Ă©coles. - displaying diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease. [46] The present invention can allow controls in the public space in general, in particular on people's circulation routes, at entrances and exits of buildings, at airport gates, in schools.
[47] La présente permet également un suivi médical des personnes, par exemple pour des personnes malades en maintien à domicile. [47] This also allows medical follow-up of people, for example for sick people in home care.
[48] Lâinvention a encore pour objet, indĂ©pendamment ou en combinaison avec ce qui prĂ©cĂšde, un systĂšme dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce systĂšme de dĂ©tection comportant: [48] A further subject of the invention, independently or in combination with the foregoing, is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- un dispositif dâacquisition de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant notamment au moins un capteur de mesure physiologique tel quâun radar, et une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - a device for acquiring examination data on the person, this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data, this device for acquisition comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person,
- un dispositif de traitement de donnĂ©es agencĂ© pour recevoir ces donnĂ©es obtenues par plusieurs capteurs du dispositif dâacquisition, - a data processing device arranged to receive these data obtained by several sensors of the acquisition device,
- un dispositif dâaffichage agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es par le dispositif de traitement de donnĂ©es, cette information de diagnostic pouvant notamment ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score. - a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular to be representative of a level of probability that the person is suffering from the disease, this level of probability being able in particular to be a score.
[49] Lâinvention permet, grĂące Ă la pluralitĂ© de capteurs qui fonctionnent sans contact avec la personne Ă examiner, dâavoir suffisamment de donnĂ©e pour Ă©tablir un diagnostic plus fiable. [49] The invention allows, thanks to the plurality of sensors that operate without contact with the person to be examined, to have enough data to establish a more reliable diagnosis.
[50] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es comporte une unitĂ© dâintelligence artificielle agencĂ©e pour traiter les donnĂ©es dâexamen obtenues par le dispositif dâacquisition et fournir ladite information de diagnostic.
[51] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es et le dispositif dâaffichage font partie dâun mĂȘme appareil, par exemple un ordinateur, notamment un ordinateur portable. [50] According to one of the aspects of the invention, the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and provide said diagnostic information. [51] According to one of the aspects of the invention, the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
[52] Selon lâun des aspects de lâinvention, le dispositif dâaffichage, et Ă©ventuellement Ă©galement le dispositif de traitement de donnĂ©es, sont agencĂ©es pour ĂȘtre embarquĂ©s sur un vĂ©hicule automobile. [52] According to one of the aspects of the invention, the display device, and possibly also the data processing device, are arranged to be mounted on a motor vehicle.
[53] Selon lâun des aspects de lâinvention, le capteur sans contact agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne comporte un microphone agencĂ©e pour recevoir des rĂ©ponses fournies oralement par la personne. [53] According to one of the aspects of the invention, the contactless sensor arranged to acquire response data provided by the person comprises a microphone arranged to receive responses provided orally by the person.
[54] Selon lâun des aspects de lâinvention, le capteur sans contact peut, en variante du microphone qui fonctionne avec une reconnaissance vocale, comporter des moyens dâanalyse du visage de la personne pour par exemple reconnaĂźtre un OUI ou un NON, par exemple par hochement de tĂȘte. [54] According to one of the aspects of the invention, the contactless sensor can, as a variant of the microphone which works with voice recognition, include means for analyzing the person's face to, for example, recognize a YES or a NO, for example by nodding.
[55] En variante encore, le capteur sans contact peut comporter des moyens permettant Ă la personne de pointer une rĂ©ponse sur un Ă©cran avec un doigt, sans contact avec lâĂ©cran. [55] As a further variant, the contactless sensor may include means allowing the person to point to an answer on a screen with a finger, without contact with the screen.
[56] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour prĂ©senter un questionnaire, par exemple par affichage des questions du questionnaire sur un Ă©cran dâaffichage ou par exemple Ă lâaide dâun dispositif sonore qui prononce les questions du questionnaire, Ă la personne Ă examiner, et le dispositif dâacquisition est agencĂ© pour recevoir les rĂ©ponses fournies par la personne Ă ce questionnaire, par exemple le microphone Ă©tant utilisĂ© pour enregistrer les rĂ©ponses de la personne. [56] According to one of the aspects of the invention, the system is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to be examined, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, for example the microphone being used to record the person's answers.
[57] Selon lâun des aspects de lâinvention, le systĂšme comporte une unitĂ© de stockage de donnĂ©es, par exemple faisant partie dâun ordinateur, agencĂ©e pour stocker les questions du questionnaire. [57] According to one of the aspects of the invention, the system comprises a data storage unit, for example forming part of a computer, arranged to store the questions of the questionnaire.
[58] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es est agencĂ© pour recevoir des donnĂ©es du dispositif dâacquisition relatives aux rĂ©ponses fournies par la personne en rĂ©ponse au questionnaire, et ce dispositif de traitement de donnĂ©es est agencĂ© pour traiter ces donnĂ©es en combinaison avec des donnĂ©es provenant dâautres capteurs du dispositif dâacquisition, en vue de fournir lâinformation de diagnostic de la maladie.
[59] Selon lâun des aspects de lâinvention, en vue dâobtenir lâinformation de diagnostic, le dispositif de traitement de donnĂ©es est agencĂ© pour faire tourner un algorithme de diagnostic basĂ© sur une fusion des donnĂ©es vitales de la personne, notamment un rythme respiratoire, une amplitude de respiration, un temps d'inspiration et d'expiration, un rythme et arythmie cardiaque, avec Ă©galement des donnĂ©es de rĂ©ponse au questionnaire. [58] According to one of the aspects of the invention, the data processing device is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process these data in combination with data coming from other sensors of the acquisition device, with a view to providing the diagnostic information of the disease. [59] According to one of the aspects of the invention, in order to obtain the diagnostic information, the data processing device is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person , including respiratory rate, amplitude of respiration, time of inspiration and expiration, cardiac rhythm and arrhythmia, with also questionnaire response data.
[60] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© de maniĂšre Ă sĂ©lectionner les questions Ă poser en fonction de la personne Ă examiner, notamment dâune ou plusieurs donnĂ©es disponibles sur la personne. [60] According to one of the aspects of the invention, the system is arranged in such a way as to select the questions to be asked according to the person to be examined, in particular one or more data available on the person.
[61] Selon lâun des aspects de lâinvention, les questions Ă poser sont Ă caractĂšre mĂ©dical, utiles pour amĂ©liorer le diagnostic en combinaison avec les autres donnĂ©es. [61] According to one of the aspects of the invention, the questions to be asked are of a medical nature, useful for improving the diagnosis in combination with the other data.
[62] Selon lâun des aspects de lâinvention, les questions sont choisies dans la liste suivante : Avez-vous mal Ă la poitrine? Avez-vous une toux sĂšche? Avez-vous mal Ă la gorge? Avez-vous le nez qui coule? Avez-vous du mal Ă respirer ? [62] According to one aspect of the invention, the questions are chosen from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
[63] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour effectuer, Ă lâaide de lâun des capteurs sans contact, une mesure dont les donnĂ©es de rĂ©sultat sont comparĂ©es Ă une rĂ©ponse fournie par la personne en rĂ©ponse Ă une question du questionnaire. [63] According to one of the aspects of the invention, the system is arranged to perform, using one of the contactless sensors, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
[64] Ceci permet de rendre plus fiable, ou attribuer un niveau de fiabilitĂ©, Ă la mesure Ă lâaide du capteur. [64] This makes it possible to make more reliable, or assign a level of reliability, to the measurement using the sensor.
[65] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour acquĂ©rir une donnĂ©e relative Ă un contexte, par exemple une tempĂ©rature ambiante. [65] According to one of the aspects of the invention, the system is arranged to acquire data relating to a context, for example an ambient temperature.
[66] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour effectuer un tri basĂ© sur un modĂšle statique pour donner un score associĂ© au diagnostic. [66] According to one of the aspects of the invention, the system is arranged to carry out a sorting based on a static model to give a score associated with the diagnosis.
[67] Selon lâun des aspects de lâinvention, le systĂšme est agencĂ© pour faire fonctionner les Ă©tapes suivantes : recevoir une donnĂ©e de consentement de la personne pour ĂȘtre soumise Ă lâexamen, acquĂ©rir des donnĂ©es de caractĂ©risation de la personne telles que le genre, lâĂąge, la taille, et des donnĂ©es reprĂ©sentatives du contexte, acquĂ©rir des donnĂ©es en rĂ©ponse Ă des questions, notamment Ă lâaide dâune microphone, et mesures de signes vitaux, traiter des donnĂ©es pour
permettre une Ă©valuation du niveau de fiabilitĂ© de lâinformation de diagnostic, poser Ă©ventuellement des questions complĂ©mentaires si nĂ©cessaire pour affiner lâinformation de diagnostic, effectuer un tri basĂ© sur un modĂšle statique pour donner un score associĂ© au diagnostic. [67] According to one of the aspects of the invention, the system is arranged to operate the following steps: receiving consent data from the person to be subjected to the examination, acquiring characterization data from the person such as as gender, age, height, and data representative of the context, acquiring data in response to questions, including using a microphone, and measurements of vital signs, processing data to allow an evaluation of the level of reliability of the diagnostic information, possibly ask additional questions if necessary to refine the diagnostic information, carry out a sorting based on a static model to give a score associated with the diagnosis.
[68] Selon lâun des aspects de lâinvention, les capteurs sans contact sont agencĂ©s pour permettre une acquisition de mesure Ă une distance de la personne Ă examiner, comprise entre 50 cm et 2 m. [68] According to one aspect of the invention, contactless sensors are arranged to allow measurement acquisition at a distance from the person to be examined, between 50 cm and 2 m.
[69] Lâinvention a encore pour un objet une borne qui inclut le systĂšme dâaide tel que prĂ©citĂ©. [69] Another object of the invention is a terminal that includes the help system as mentioned above.
[70] Cette borne peut par exemple comprendre une unitĂ© de traitement agencĂ© pour traiter les donnĂ©es provenant des capteurs et dĂ©livrer lâinformation de diagnostic. [70] This terminal can for example include a processing unit arranged to process data from the sensors and deliver diagnostic information.
[71] Cette unitĂ© de traitement peut ĂȘtre un ordinateur, avec ou sans Ă©cran sur la borne. [71] This processing unit can be a computer, with or without a screen on the terminal.
[72] Cette borne comprend notamment les différents capteurs. [72] This terminal notably includes the various sensors.
[73] Cette borne est par exemple installable Ă lâentrĂ©e dâun immeuble. [73] This terminal can be installed at the entrance of a building, for example.
[74] Lâinvention a encore pour objet un procĂ©dĂ© dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce procĂ©dĂ© comportant les Ă©tapes suivantes: [74] Another subject of the invention is an aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant notamment au moins un capteur de mesure physiologique tel quâun radar, et une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, ce capteur Ă©tant notamment un microphone, - acquiring examination data on the person, this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data, this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person, this sensor being in particular a microphone,
- recevoir ces donnĂ©es obtenues par plusieurs capteurs du dispositif dâacquisition, - receive these data obtained by several sensors of the acquisition device,
- afficher une information de diagnostic de la maladie basée sur une analyse desdites données par le dispositif de traitement de données, cette information
de diagnostic pouvant notamment ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score. - displaying disease diagnostic information based on an analysis of said data by the data processing device, this information of diagnosis which can in particular be representative of a level of probability that the person is affected by the disease, this level of probability which can in particular be a score.
[75] Lâinvention a encore pour objet un systĂšme dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce systĂšme de dĂ©tection comportant: [75] Another subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
- un dispositif dâacquisition de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, notamment un capteur de mesure physiologique tel quâun radar ou une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, notamment ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, notamment lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - a device for acquiring examination data on the person, this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such as a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire a response datum provided by the person,
- un dispositif de traitement de donnĂ©es agencĂ© pour recevoir ces donnĂ©es obtenues par le dispositif dâacquisition, - a data processing device arranged to receive these data obtained by the acquisition device,
- notamment un dispositif dâaffichage agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es par le dispositif de traitement de donnĂ©es, cette information de diagnostic pouvant notamment ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score - in particular a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability being able in particular to be a score
- le dispositif dâacquisition comprenant en outre un capteur de correction diffĂ©rent dudit premier capteur et agencĂ© pour acquĂ©rir au moins une donnĂ©e sur la personne, cette donnĂ©e Ă©tant une donnĂ©e de correction diffĂ©rente de donnĂ©es acquises par le premier capteur, - the acquisition device further comprising a correction sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor,
- le dispositif de traitement de donnĂ©es Ă©tant agencĂ© pour utiliser cette donnĂ©e de correction pour corriger les donnĂ©es dâexamen fournies par le premier capteur. - the data processing device being arranged to use this correction data to correct the examination data supplied by the first sensor.
[76] Selon lâun des aspects de lâinvention, le capteur de correction est agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne.
[77] Selon lâun des aspects de lâinvention, ce capteur de correction comporte une camĂ©ra, notamment de type 3D, pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne. [76] According to one of the aspects of the invention, the correction sensor is arranged to acquire data representative of a movement of the person. [77] According to one of the aspects of the invention, this correction sensor comprises a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
[78] Cette caméra est notamment une caméra fonctionnant sur le principe du temps de vol (en anglais : Time of Flight, TOF) qui permet de mesurer en temps réel une scÚne en 3 dimensions (3D). Ce type de caméra est connu. [78] This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D). This type of camera is known.
[79] En variante, cette camĂ©ra est une camĂ©ra RGB fonctionnant avec par exemple un outil de segmentation du corps ou une plateforme Ă©quipĂ©e de jauge de contrainte sur laquelle la personne est installĂ©e, laquelle personne peut ĂȘtre debout, couchĂ©e ou assise. [79] As a variant, this camera is an RGB camera operating with, for example, a body segmentation tool or a platform equipped with a strain gauge on which the person is installed, which person can be standing, lying or sitting.
[80] Selon lâun des aspects de lâinvention, le capteur de correction est agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [80] According to one of the aspects of the invention, the correction sensor is arranged to acquire data representative of a voice of the person.
[81] Selon lâun des aspects de lâinvention, ce capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne comporte un microphone (33), notamment un microphone directionnel ou une camĂ©ra. [81] According to one of the aspects of the invention, this correction sensor arranged to acquire data representative of a voice of the person comprises a microphone (33), in particular a directional microphone or a camera.
[82] Selon lâun des aspects de lâinvention, le dispositif dâacquisition comporte Ă la fois un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne et un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [82] According to one of the aspects of the invention, the acquisition device comprises both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire data representative of a person's voice.
[83] Selon lâun des aspects de lâinvention, le premier capteur, notamment Ă©tant capteur de mesure physiologique, est un radar agencĂ© notamment pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun rythme respiratoire de la personne, notamment en dĂ©tectant le mouvement de la peau de la personne. [83] According to one of the aspects of the invention, the first sensor, in particular being a physiological measurement sensor, is a radar arranged in particular to acquire data representative of a breathing rate of the person, in particular by detecting the movement of the person's skin.
[84] Selon lâun des aspects de lâinvention, le radar est agencĂ© pour ĂȘtre placĂ© face Ă la personne ou dans le dos de la personne. [84] According to one aspect of the invention, the radar is arranged to be placed in front of the person or behind the person's back.
[85] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es est agencĂ© pour rĂ©aliser la correction des donnĂ©es dâexamen en fonction de la donnĂ©e de correction Ă lâaide dâune intelligence artificielle. [85] According to one of the aspects of the invention, the data processing device is arranged to carry out the correction of the examination data according to the correction data using artificial intelligence.
[86] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es est agencĂ© pour obtenir un signal de correction basĂ© sur les donnĂ©es de correction, ce signal de correction Ă©tant Ă©volutif en fonction du temps.
[87] Selon lâun des aspects de lâinvention, le dispositif de traitement de donnĂ©es est agencĂ© pour fournir les donnĂ©es dâexamen, par exemple liĂ©es au rythme respiratoire, aprĂšs correction Ă lâaide du signal de correction. [86] According to one of the aspects of the invention, the data processing device is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time. [87] According to one of the aspects of the invention, the data processing device is arranged to provide the examination data, for example related to the respiratory rate, after correction using the correction signal.
[88] Lâinvention permet de prendre en compte le bruit liĂ© aux mouvements de la personne et/ou Ă sa voix, pour fournir des donnĂ©es dâexamen fiables et prĂ©cises. [88] The invention makes it possible to take into account the noise related to the movements of the person and/or to his voice, to provide reliable and precise examination data.
[89] En effet les mouvements et les paroles de la personne sont susceptibles de crĂ©er des interfĂ©rences dans lâacquisition de donnĂ©es, notamment de type physiologiques telles que le rythme respiratoire. [89] Indeed, the movements and words of the person are likely to create interference in the acquisition of data, in particular of physiological type such as the respiratory rate.
[90] Lâinvention a encore pour objet un procĂ©dĂ© dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce procĂ©dĂ© comportant les Ă©tapes suivantes: [90] Another object of the invention is a method for providing assistance with diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne, Ă lâaide dâun dispositif dâacquisition de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, notamment un capteur de mesure physiologique tel quâun radar ou une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, notamment ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, notamment lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - acquiring examination data on the person, using a device for acquiring examination data on the person, this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- corriger ces donnĂ©es dâexamen Ă lâaide de donnĂ©es de correction, notamment acquises Ă lâaide dâun capteur de correction. - correcting this examination data using correction data, in particular acquired using a correction sensor.
[91] Lâinvention prĂ©sente lâavantage de pouvoir croiser des donnĂ©es en vue dâavoir un rĂ©sultat plus fiable et ou plus robuste. [91] The invention has the advantage of being able to cross-reference data in order to obtain a more reliable and/or more robust result.
[92] Dans le cas de lâĂ©valuation du rythme cardiaque au moyen dâun radar, cette Ă©valuation Ă©tant perturbĂ©e par la voix de la personne ou le mouvement de la personne, lâinvention permet dâĂ©valuer cette perturbation grĂące Ă un microphone ou une camĂ©ra qui permet une lecture labiale ou encore au moyen d'une camĂ©ra 4D ou d'une balance inertielle. [92] In the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the invention makes it possible to evaluate this disturbance thanks to a microphone or a camera that allows lip reading or even by means of a 4D camera or an inertial balance.
[93] La validitĂ© de lâĂ©valuation de ce rythme cardiaque dĂ©pend ainsi du bruit extĂ©rieur, de la posture de la personne ou de lâintensitĂ© lumineuse par exemple.
[94] Selon lâun des aspects de lâinvention, le procĂ©dĂ© selon lâinvention comporte lâĂ©tape de prendre en compte le poids des Ă©valuations des paramĂštres acquis pour lâobtention du rĂ©sultat. [93] The validity of the evaluation of this heart rate thus depends on external noise, the posture of the person or the light intensity, for example. [94] According to one of the aspects of the invention, the method according to the invention comprises the step of taking into account the weight of the evaluations of the parameters acquired to obtain the result.
[95] Ainsi lorsque des perturbations sont dâamplitudes de plus grandes, lâinvention prĂ©conise de donner davantage de poids aux paramĂštres les moins perturbĂ©s. [95] Thus when disturbances are of greater amplitude, the invention recommends giving more weight to the least disturbed parameters.
[96] Selon lâun des aspects de lâinvention, dans le cas de lâĂ©valuation du rythme cardiaque au moyen dâun radar, cette Ă©valuation Ă©tant perturbĂ©e par la voix de la personne ou le mouvement de la personne, le procĂ©dĂ© prĂ©sente lâĂ©tape dâĂ©valuer cette perturbation grĂące Ă un microphone ou une camĂ©ra qui permet une lecture labiale ou encore au moyen d'une camĂ©ra 4D ou d'une balance inertielle, pour corriger le donnĂ©es dâexamen. [96] According to one of the aspects of the invention, in the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the method presents the stage of evaluating this disturbance using a microphone or a camera that allows lip reading or even using a 4D camera or an inertial balance, to correct the examination data.
[97] Lâinvention et ses diffĂ©rentes applications seront mieux comprises Ă la lecture de la description qui suit et Ă lâexamen des figures qui lâaccompagnent : [97] The invention and its various applications will be better understood on reading the following description and examining the accompanying figures:
[98] La figure 1 illustre schĂ©matiquement un systĂšme selon un mode de rĂ©alisation non limitatif de lâinvention. [98] Figure 1 schematically illustrates a system according to a non-limiting embodiment of the invention.
[99] La figure 2 illustre un schéma blocs illustrant les étapes mises en oeuvre dans le systÚme de la figure 1 , [99] Figure 2 shows a block diagram illustrating the steps implemented in the system of Figure 1,
[100] La figure 3 illustre un schĂ©ma blocs illustrant les Ă©tapes mises en oeuvre dans un systĂšme selon un autre exemple de mise en oeuvre de lâinvention, [100] Figure 3 illustrates a block diagram illustrating the steps implemented in a system according to another example of implementation of the invention,
[101] La figure 4 montre des courbes illustrant lâeffet des corrections obtenues grĂące Ă lâinvention. [101] Figure 4 shows curves illustrating the effect of the corrections obtained thanks to the invention.
[102] On a reprĂ©sentĂ© sur les Figures 1 et 2 un systĂšme 1 dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, selon lâinvention. [102] There is shown in Figures 1 and 2 an aid system 1 for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, according to the invention.
[103] Ce systĂšme 1 comporte: [103] This system 1 includes:
- un dispositif dâacquisition 7 de donnĂ©es dâexamen sur la personne, - a device for acquiring 7 examination data on the person,
- un dispositif de traitement de donnĂ©es 3 agencĂ© pour recevoir ces donnĂ©es dâexamen obtenues par le dispositif dâacquisition 7,
- un dispositif dâaffichage 30 agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, cette information de diagnostic pouvant ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie. - a data processing device 3 arranged to receive these examination data obtained by the acquisition device 7, - a display device 30 arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information possibly being representative of a level of probability that the person is suffering from the disease.
[104] Ce systĂšme 1 comporte en particulier : [104] This system 1 includes in particular:
- un capteur de lâactivitĂ© cardiaque dâau moins un passager, ici le rythme cardiaque, ce capteur Ă©tant une camĂ©ra fonctionnant dans le proche infrarouge, - a sensor of the cardiac activity of at least one passenger, here the heart rate, this sensor being a camera operating in the near infrared,
- un capteur de lâactivitĂ© respiratoire, notamment en frĂ©quence et/ou en amplitude respiratoire, dâau moins un passager, ce capteur Ă©tant une camĂ©ra fonctionnant dans lâinfrarouge lointain, ou camĂ©ra thermique, - a respiratory activity sensor, in particular in frequency and/or respiratory amplitude, of at least one passenger, this sensor being a camera operating in the far infrared, or thermal camera,
- un radar agencé pour mesurer des signes vitaux de la personne, - a radar arranged to measure the person's vital signs,
- un capteur des caractéristiques de profil du passager, notamment son genre, poids, taille et ùge, ce capteur étant ici une caméra Rouge Vert Bleu, encore appelée caméra RGB en anglais, - a sensor of the passenger's profile characteristics, in particular his gender, weight, height and age, this sensor being here a Red Green Blue camera, also called RGB camera in English,
- un lecteur de carte pour lire une carte dâidentitĂ© de la personne et obtenir des donnĂ©es personnelles de la personne. - a card reader to read a person's identity card and obtain the person's personal data.
[105] Ces capteurs et camĂ©ras, qui font partie du dispositif dâacquisition 7, sont reprĂ©sentĂ©s par la rĂ©fĂ©rence 2 sur la figure 1. Certains capteurs 2 sont par exemple disposĂ©s sur un plafond du vĂ©hicule. Lâune des autres camĂ©ras 2 est disposĂ©e dans un montant latĂ©ral 6 du vĂ©hicule V. [105] These sensors and cameras, which are part of the acquisition device 7, are represented by the reference 2 in Figure 1. Some sensors 2 are for example arranged on a ceiling of the vehicle. One of the other cameras 2 is arranged in a side upright 6 of the vehicle V.
[106] Le capteur rythme cardiaque et respiration peut ĂȘtre dans le dossier du siĂšge ou dans la console centrale au niveau de la cuisse du passager, ceci Ă©tant no limitatif. [106] The heart rate and respiration sensor may be in the seat back or in the center console at the level of the passenger's thigh, this being non-limiting.
[107] Ces capteurs 2 sont reliĂ©s pour Ă©changes dâinformations avec un dispositif de traitement de donnĂ©es 3 placĂ©e sur le vĂ©hicule V. [107] These sensors 2 are connected for exchange of information with a data processing device 3 placed on the vehicle V.
[108] Le dispositif de traitement de donnĂ©es 3 comporte une unitĂ© dâintelligence artificielle agencĂ©e pour traiter les donnĂ©es dâexamen obtenues par le dispositif dâacquisition 7 et fournir ladite information de diagnostic.
[109] Le dispositif de traitement de donnĂ©es 3 et le dispositif dâaffichage 30 font partie dâun mĂȘme appareil, par exemple un ordinateur, notamment un ordinateur portable. [108] The data processing device 3 comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device 7 and supply said diagnostic information. [109] The data processing device 3 and the display device 30 are part of the same device, for example a computer, in particular a laptop computer.
[110] Dans ce cas, le dispositif dâaffichage 30 est un Ă©cran de lâordinateur portable et le dispositif de traitement de donnĂ©es comprend microprocesseur de cet ordinateur. [110] In this case, the display device 30 is a screen of the laptop computer and the data processing device includes this computer's microprocessor.
[111] Le dispositif dâaffichage 30 est agencĂ© pour ĂȘtre visible de la personne examinĂ©e, et notamment le dispositif dâaffichage, qui comprend notamment un Ă©cran, est distant du dispositif de traitement de donnĂ©es, ces dispositif dâaffichage et de traitement de donnĂ©es Ă©tant par exemple reliĂ©s entre eux par une liaison sans fil, par exemple par un protocole de communication 3G, 4G ou 5G, ou par le rĂ©seau Internet, ou Wifi par exemple. [111] The display device 30 is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and processing devices data being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
[112] Le dispositif dâaffichage 30, et Ă©galement le dispositif de traitement de donnĂ©es 3, sont ici agencĂ©es pour ĂȘtre embarquĂ©s sur un vĂ©hicule automobile. [112] The display device 30, and also the data processing device 3, are here arranged to be embedded in a motor vehicle.
[113] En variante, le dispositif dâaffichage 30, et Ă©ventuellement Ă©galement le dispositif de traitement de donnĂ©es 3, sont agencĂ©s pour ĂȘtre placĂ©s de maniĂšre fixe, dans un bĂątiment ou une cour extĂ©rieure par exemple. [113] As a variant, the display device 30, and possibly also the data processing device 3, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
[114] Le dispositif de traitement 3 est agencé pour faire le diagnostic de maniÚre automatique, sans une intervention humaine. [114] The processing device 3 is arranged to make the diagnosis automatically, without human intervention.
[115] Le dispositif dâacquisition 7 de donnĂ©es dâexamen est agencĂ© pour permettre des mesures sans contact et Ă distance de sĂ©curitĂ©, de signaux vitaux et d'imagerie thermique et visible sur la personne Ă examiner. [115] The examination data acquisition device 7 is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to be examined.
[116] Le systĂšme selon lâinvention utilise ainsi avantageusement la fusion de mesures sans contact et Ă distance de sĂ©curitĂ©, de signaux vitaux et d'imagerie thermique et visible. [116] The system according to the invention thus advantageously uses the fusion of measurements without contact and at a safe distance, vital signals and thermal and visible imaging.
[117] LâunitĂ© dâintelligence artificielle est agencĂ©e pour utiliser un modĂšle de diagnostic basĂ© sur l'intelligence artificielle et nourri par un nombre raisonnable de mesures cliniques. [117] The artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measures.
[118] Lâinvention permet de rĂ©alisation des diagnostics de maniĂšre mobile. Sa mise en place, par exemple Ă lâaide dâune camĂ©ra thermique, un capteur de
mesure physiologique tel quâun radar et un ordinateur personnel portable, est facile. [118] The invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a sensor of physiological measurement such as a radar and a portable personal computer, is easy.
[119] Le dispositif dâacquisition 7 comprend un radar pour acquĂ©rir des donnĂ©es relatives aux signes vitaux de la personne, une camĂ©ra thermique pour les mesures de tempĂ©rature fournissant des donnĂ©es de tempĂ©rature, et une camĂ©ra fonctionnant dans le spectre visible pour la caractĂ©risation de la personne testĂ©e fournissant des donnĂ©es caractĂ©risation de la personne. [119] The acquisition device 7 comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person being tested providing data characterizing the person.
[120] Le dispositif de traitement de données 3 est agencé pour faire tourner un algorithme de diagnostic basé sur une fusion des données vitales, notamment un rythme respiratoire, une amplitude de respiration, un temps d'inspiration et d'expiration, un rythme et arythmie cardiaque, une oxymétrie. [120] The data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a breathing rhythm, a breathing amplitude, an inspiration and expiration time, a rhythm and cardiac arrhythmia, oximetry.
[121] Lâalgorithme utilise des tempĂ©ratures mesurĂ©es sur des zones remarquables, localisĂ©es par traitement de l'image. [121] The algorithm uses temperatures measured on remarkable areas, localized by image processing.
[122] De prĂ©fĂ©rence, ces zones remarquables de mesure de tempĂ©rature sont localisĂ©es Ă lâintĂ©rieur de la bouche, sur le bout du nez, sur les pommettes et la paume de la main. [122] Preferably, these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
[123] Lâalgorithme de diagnostic utilise une caractĂ©risation de la personne, telles que des donnĂ©es dâĂąge, de genre, dâhabillage, de taille, dâindice de masse corporelle. [123] The diagnostic algorithm uses a characterization of the person, such as data on age, gender, dress, height, body mass index.
[124] Le systĂšme est agencĂ© pour rĂ©aliser lâacquisition de donnĂ©es dâexamen jusquâĂ la mise Ă disposition de lâinformation de diagnostic dans un laps de temps compris notamment entre 30 et 120 secondes. [124] The system is designed to carry out the acquisition of examination data until the provision of diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
[125] Lâinvention permet ainsi un diagnostic rapide sans dĂ©lai dâacheminement additionnel vers un mĂ©decin par exemple. Les informations de diagnostic peuvent, le cas Ă©chĂ©ant, ĂȘtre envoyĂ©s automatiquement Ă un mĂ©decin et peuvent ĂȘtre conservĂ©s sur un systĂšme de stockage de donnĂ©es 40 de type Cloud. [125] The invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. The diagnostic information can, if necessary, be sent automatically to a doctor and can be kept on a data storage system 40 of Cloud type.
[126] Le dispositif de traitement de donnĂ©es 3 utilise un algorithme dâanalyse des donnĂ©es dâexamen acquises et, le cas Ă©chĂ©ant, de tri des personnes dans le but de dĂ©tecter les cas de personnes malades, en se basant sur l'ensemble des donnĂ©es collectĂ©es et une intelligence artificielle dont le premier niveau d'apprentissage est rĂ©alisĂ© sur un Ă©chantillon en milieu hospitalier.
[127] Les mesures rĂ©alisĂ©es par le dispositif dâacquisition peuvent servir pour affiner ultĂ©rieurement le diagnostic fait par lâintelligence artificielle. [126] The data processing device 3 uses an algorithm for analyzing the acquired examination data and, if necessary, sorting people with the aim of detecting cases of sick people, based on the set collected data and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment. [127] The measurements taken by the acquisition device can be used to later refine the diagnosis made by the artificial intelligence.
[128] GrĂące Ă lâinvention, la pose dâun diagnostic peut se faire sans contact avec la personne, ce qui limite les risques de contamination, ce qui est particuliĂšrement avantageux par exemple dans le cas dâune pandĂ©mie telle que celle liĂ©e au COVID 19. [128] Thanks to the invention, a diagnosis can be made without contact with the person, which limits the risks of contamination, which is particularly advantageous, for example, in the case of a pandemic such as that linked to COVID 19.
[129] Selon lâun des aspects de lâinvention, les donnĂ©es dâexamen mesurĂ©es comprennent au moins lâune des donnĂ©es suivantes : des tempĂ©ratures mesurĂ©es en diffĂ©rents points du corps de la personne Ă examiner, une caractĂ©ristique respiratoire ou cardiaque. [129] According to one of the aspects of the invention, the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
[130] Le dispositif dâacquisition 7 est agencĂ© pour acquĂ©rir des donnĂ©es dâexamen comprenant une tempĂ©rature extĂ©rieure, une tempĂ©rature mesurĂ©e sur une pommette de la personne, une tempĂ©rature mesurĂ©e sur le bout du nez de la personne, et Ă©galement le cas Ă©chĂ©ant, une tempĂ©rature maximale du visage et une tempĂ©rature dâun vĂȘtement ou dâune surface Ă tempĂ©rature contrĂŽlĂ©e de rĂ©fĂ©rence. [130] The acquisition device 7 is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, if necessary , a peak face temperature, and a reference temperature-controlled clothing or surface temperature.
[131] Les points remarquables de mesure sont localisĂ©s par une intelligence artificielle au moyen dâun organigramme dâidentification dâobjet. [131] The remarkable points of measurement are located by an artificial intelligence by means of an object identification flowchart.
[132] Lâidentification des caractĂ©risations personnelles se fait au moyen des camĂ©ras Rouge Vert Bleu (ou camĂ©ra RGB) ou Infrarouge lointain (camĂ©ra FIR) en complĂ©ment dâune lecture dâidentitĂ© de la personne, grĂące Ă un systĂšme de classification dont lâapprentissage peut ĂȘtre rĂ©alisĂ© sur des images RGB (Rouge Vert Bleu) ou Infrarouge. Lâutilisation dâun plus grand nombre de paramĂštres, notamment lâĂąge, le genre, la taille, lâindice de masse corporelle, le phĂ©notype par exemple, sert Ă amĂ©liorer les modĂšles de diagnostic. [132] The identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to a reading of the person's identity, thanks to a classification system whose learning can be performed on RGB (Red Green Blue) or Infrared images. The use of more parameters, including age, gender, height, body mass index, phenotype for example, serves to improve diagnostic models.
[133] Le modĂšle de diagnostic, ou algorithme de diagnostic, qui est nourri de plus de donnĂ©es telles que des tempĂ©ratures remarquables du corps, une tempĂ©rature ambiante, une classe de caractĂ©ristiques personnelles, une heure du jour, peut ĂȘtre agencĂ© pour en plus utiliser des donnĂ©es de parcours de la personne examinĂ©e pour vĂ©rifier si elle a croisĂ© une personne malade ou est passĂ©e par une rĂ©gion Ă risque.
[134] La tempĂ©rature relative Ă un point remarquable peut ĂȘtre obtenue par moyenne temporelle et par moyenne des tempĂ©ratures dâune surface dĂ©finie par des pixels issu dâune image de camĂ©ra Ă proximitĂ© du point remarquable. Le point remarquable est par exemple dĂ©fini gĂ©omĂ©triquement au moyen dâune zone dâimage appelĂ©e Building box, qui lâentoure. Cette zone dâimage est une surface dĂ©limitĂ©e par une sĂ©rie de points qui est construite par un algorithme dâidentification dâobjets. [133] The diagnostic model, or diagnostic algorithm, which is fed with more data such as remarkable body temperatures, ambient temperature, class of personal characteristics, time of day, can be arranged to additionally use journey data of the person examined to check whether they have crossed paths with a sick person or passed through a region at risk. [134] The temperature relative to a remarkable point can be obtained by temporal average and by average of the temperatures of a surface defined by pixels resulting from a camera image near the remarkable point. The remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
[135] Lâinformation de diagnostic est comporte une classe choisie parmi trois classes prĂ©dĂ©terminĂ©es qui sont « Personne saine », « Personne avec une suspicion de maladie », « Personne avec une forte probabilitĂ© de maladie ». [135] The diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy person", "Person with a suspicion of disease", "Person with a high probability of disease".
[136] Lâinvention met ainsi en oeuvre les Ă©tapes suivantes: [136] The invention thus implements the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne Ă lâaide du dispositif dâacquisition 7, qui sont les Ă©tapes 20 Ă 25 de la figure 2, - acquiring examination data on the person using the acquisition device 7, which are steps 20 to 25 in Figure 2,
- recevoir ces donnĂ©es dâexamen obtenues par le dispositif dâacquisition,- receive this examination data obtained by the acquisition device,
- traiter ces donnĂ©es dâexamen pour obtenir une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, Ă lâaide du dispositif de traitement de donnĂ©es 3 (Ă©tape 28), - processing these examination data to obtain diagnostic information for the disease based on an analysis of said examination data, using the data processing device 3 (step 28),
- afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es dâexamen, cette information de diagnostic pouvant ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie (Ă©tape 29). - displaying diagnostic information for the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease (step 29).
[137] Les Ă©tapes 20 Ă 25 sont les suivantes : [137] Steps 20 to 25 are as follows:
- lâidentification des caractĂ©risations personnelles se fait au moyen des camĂ©ras Rouge Vert Bleu (ou camĂ©ra RGB), câest lâĂ©tape 20, - the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera), this is step 20,
- acquisition de la tempĂ©rature de la personne Ă lâĂ©tape 21 avec une camĂ©ra thermique de type FIR, les dĂ©tails de cette acquisition de tempĂ©rature Ă©tant dĂ©jĂ dĂ©crite, - acquisition of the person's temperature in step 21 with an FIR type thermal camera, the details of this temperature acquisition being already described,
- acquisition du rythme respiratoire Ă©tape 22 Ă lâaide de la camĂ©ra FIR, - acquisition of the respiratory rate step 22 using the FIR camera,
- acquisition du rythme cardiaque Ă lâĂ©tape 23 Ă lâaide de la camĂ©ra dans le proche infrarouge, ou camĂ©ra NIR,
- acquisition de signes vitaux Ă lâaide du radar, Ă lâĂ©tape 24, - acquisition of the heart rate in step 23 using the near infrared camera, or NIR camera, - acquisition of vital signs using the radar, in step 24,
- acquisition de donnĂ©es personnelles Ă lâaide du lecteur de carte Ă lâĂ©tape 25,- acquisition of personal data using the card reader in step 25,
- potentiellement une oxymétrie par la caméra de proche infrarouge (NIR). - potentially near-infrared (NIR) camera oximetry.
[138] La présente permet également un suivi médical des personnes. [138] This also allows medical monitoring of individuals.
[139] Les donnĂ©es dâexamen peuvent, le cas Ă©chĂ©ant, comporter la taille des pupilles et de leur position. [139] Examination data may, where appropriate, include pupil size and position.
[140] Les informations de diagnostic sont envoyées automatiquement un systÚme de stockage de données distant de type Cloud. [140] Diagnostic information is automatically sent to a cloud-based remote data storage system.
[141 ] De mĂȘme les informations utiles au modĂšle de diagnostic, ou algorithme de diagnostic, peuvent ĂȘtre reçues du systĂšme distant de type Cloud. [141] Similarly, information useful for the diagnostic model, or diagnostic algorithm, can be received from the cloud-type remote system.
[142] Potentiellement deux caméras, NIR et FIR, sont utilisées. La caméra FIR pour les températures et les caractéristiques de la respiration et la caméra NIR pour l'oxymétrie et le rythme cardiaque. [142] Potentially two cameras, NIR and FIR, are used. The FIR camera for temperatures and respiration characteristics and the NIR camera for oximetry and heart rate.
[143] Le dispositif dâacquisition est notamment agencĂ© pour acquĂ©rir des donnĂ©es dâexamen comprenant une tempĂ©rature extĂ©rieure, une tempĂ©rature mesurĂ©e sur une pommette de la personne, une tempĂ©rature mesurĂ©e sur le bout du nez de la personne, et Ă©galement le cas Ă©chĂ©ant, une tempĂ©rature maximale du visage et une tempĂ©rature dâun vĂȘtement ou dâune surface Ă tempĂ©rature contrĂŽlĂ©e de rĂ©fĂ©rence, et le cas Ă©chĂ©ant un volume respiratoire, les tremblements, le taux d'oxygĂšne dans le sang. [143] The acquisition device is in particular arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate , a maximum facial temperature and a temperature of a garment or of a reference temperature-controlled surface, and if applicable a respiratory volume, tremors, the level of oxygen in the blood.
[144] On a reprĂ©sentĂ© sur la figure 3 un autre exemple de mise en oeuvre de lâinvention. [144] Figure 3 shows another example of implementation of the invention.
[145] Dans cet exemple, le systĂšme dâaide 1 comporte, Ă lâinstar de lâexemple dĂ©crit prĂ©cĂ©demment: [145] In this example, the help system 1 includes, like the example described above:
- un dispositif dâacquisition 7 de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant notamment au moins un capteur de mesure physiologique tel quâun radar, et une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, ce dispositif dâacquisition comportant une pluralitĂ© de capteurs 2 agencĂ©s pour fonctionner sans contact avec la personne, lâun au
moins des capteurs sans contact étant agencé pour acquérir une donnée réponse fournie par la personne, - a device 7 for acquiring examination data on the person, this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data, this device acquisition comprising a plurality of sensors 2 arranged to operate without contact with the person, one at the less contactless sensors being arranged to acquire a response data provided by the person,
- un dispositif de traitement de donnĂ©es 3 agencĂ© pour recevoir ces donnĂ©es obtenues par plusieurs capteurs du dispositif dâacquisition, - a data processing device 3 arranged to receive these data obtained by several sensors of the acquisition device,
- un dispositif dâaffichage 30 agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es par le dispositif de traitement de donnĂ©es, cette information de diagnostic pouvant notamment ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score. - a display device 30 arranged to display diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability possibly being in particular a score.
[146] Lâun des capteurs sans contact 2 agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne comporte un microphone agencĂ©e pour recevoir des rĂ©ponses fournies oralement par la personne. [146] One of the contactless sensors 2 arranged to acquire response data provided by the person includes a microphone arranged to receive responses provided orally by the person.
[147] Le systĂšme 1 est agencĂ© pour prĂ©senter un questionnaire, par exemple par affichage des questions du questionnaire sur un Ă©cran dâaffichage ou par exemple Ă lâaide dâun dispositif sonore qui prononce les questions du questionnaire, Ă la personne Ă examiner, et le dispositif dâacquisition est agencĂ© pour recevoir les rĂ©ponses fournies par la personne Ă ce questionnaire, ici le microphone 33 Ă©tant utilisĂ© pour enregistrer les rĂ©ponses de la personne. [147] The system 1 is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to examine, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, here the microphone 33 being used to record the person's answers.
[148] Le systĂšme 1 comporte une unitĂ© de stockage de donnĂ©es, par exemple faisant partie dâun ordinateur, agencĂ©e pour stocker les questions du questionnaire 34. [148] System 1 comprises a data storage unit, for example part of a computer, arranged to store the questions of questionnaire 34.
[149] Le dispositif de traitement de donnĂ©es 3 est agencĂ© pour recevoir des donnĂ©es du dispositif dâacquisition relatives aux rĂ©ponses fournies par la personne en rĂ©ponse au questionnaire, et ce dispositif de traitement de donnĂ©es est agencĂ© pour traiter ces donnĂ©es en combinaison avec des donnĂ©es provenant dâautres capteurs du dispositif dâacquisition, en vue de fournir lâinformation de diagnostic de la maladie. [149] The data processing device 3 is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process this data in combination with data coming from other sensors of the acquisition device, in order to provide the diagnostic information of the disease.
[150] En vue dâobtenir lâinformation de diagnostic, le dispositif de traitement de donnĂ©es 3 est agencĂ© pour faire tourner un algorithme de diagnostic basĂ© sur une fusion des donnĂ©es vitales de la personne, notamment un rythme respiratoire, une amplitude de respiration, un temps d'inspiration et d'expiration,
un rythme et arythmie cardiaque, avec également des données de réponse au questionnaire. [150] With a view to obtaining the diagnostic information, the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person, in particular a respiratory rate, an amplitude of respiration , a time of inspiration and expiration, cardiac rhythm and arrhythmia, also with questionnaire response data.
[151] Le systĂšme est agencĂ© de maniĂšre Ă sĂ©lectionner les questions Ă poser en fonction de la personne Ă examiner, notamment dâune ou plusieurs donnĂ©es disponibles sur la personne. [151] The system is set up in such a way as to select the questions to be asked depending on the person to be examined, in particular one or more data available on the person.
[152] Les questions à poser sont à caractÚre médical, utiles pour améliorer le diagnostic en combinaison avec les autres données. [152] The questions to be asked are of a medical nature, useful to improve the diagnosis in combination with the other data.
[153] Le systĂšme 1 est agencĂ© pour effectuer, Ă lâaide de lâun des capteurs 2 sans contact, une mesure dont les donnĂ©es de rĂ©sultat sont comparĂ©es Ă une rĂ©ponse fournie par la personne en rĂ©ponse Ă une question du questionnaire. [153] The system 1 is arranged to perform, using one of the contactless sensors 2, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
[154] On va maintenant dĂ©crire en rĂ©fĂ©rence Ă la figure 3 diffĂ©rentes Ă©tapes de mise en oeuvre de lâinvention. [154] We will now describe with reference to Figure 3 various stages of implementation of the invention.
[155] LâĂ©tape 50 correspond au commencement du procĂ©dĂ© de dĂ©tection dâune maladie sur une personne. [155] Step 50 corresponds to the beginning of the process of detecting a disease in a person.
[156] Suit une étape 51 de saisie de données par la personne à examiner. [156] There follows a step 51 of data entry by the person to be examined.
[157] Dans cette étape 51 , la personne saisit par exemple des données la concernant, par exemple son identité., puis éventuellement donne son accord ou consentement pour continuer le procédé de diagnostic. [157] In this step 51 , the person enters, for example, data concerning him, for example his identity, then possibly gives his agreement or consent to continue the diagnostic process.
[158] Cette Ă©tape 51 peut ĂȘtre rĂ©alisĂ©e par la personne via un Ă©cran tactile 35 couplĂ© Ă un dispositif 36 de dĂ©sinfection utilisant des UV. Un microphone 33 peut ĂȘtre utilisĂ© pour enregistrer des rĂ©ponses de la personne Ă des questions. Un dispositif de reconnaissance vocale 38 est coupĂ© au microphone 33 pour entrer des donnĂ©es prises par le microphone 33 dans lâunitĂ© de traitement de donnĂ©es 3. [158] This step 51 can be performed by the person via a touch screen 35 coupled to a disinfection device 36 using UV. A microphone 33 can be used to record the person's responses to questions. A voice recognition device 38 is muted at the microphone 33 to input data picked up by the microphone 33 into the data processing unit 3.
[159] Des donnĂ©es de contexte 37, par exemple une tempĂ©rature ambiante, peut ĂȘtre acquise par un capteur 2. [159] Context data 37, for example an ambient temperature, can be acquired by a sensor 2.
[160] A lâĂ©tape 52, des caractĂ©ristiques liĂ©es Ă la personne sont dĂ©terminĂ©es grĂące Ă un ou plusieurs capteurs 2 via un systĂšme 39 de reconnaissance dâimages objet, comme dĂ©crit dans lâexemple prĂ©cĂ©dent. [160] In step 52, characteristics related to the person are determined using one or more sensors 2 via an object image recognition system 39, as described in the previous example.
[161] Des questions supplĂ©mentaires sont posĂ©es Ă lâissue de lâĂ©tape 52 pour prĂ©ciser lâĂ©tat clinique de la personne.
[162] Pour cette étape 53 de questions / réponses, les questions sont choisies par exemple dans la liste suivante : Avez-vous mal à la poitrine? Avez-vous une toux sÚche? Avez-vous mal à la gorge? Avez-vous le nez qui coule? Avez-vous du mal à respirer ? [161] Additional questions are asked at the end of step 52 to clarify the person's clinical condition. [162] For this step 53 of questions/answers, the questions are chosen for example from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
[163] Les rĂ©ponses peuvent ĂȘtre apportĂ©es par la personne via le microphone 33. [163] Answers can be given by the person via the microphone 33.
[164] A lâĂ©tape 54 suivante, les capteurs 2 procĂšdent Ă lâacquisition de donnĂ©es relatives aux signes vitaux de la personne, comme dĂ©crit dans lâexemple prĂ©cĂšdent. [164] In the following step 54, the sensors 2 proceed to the acquisition of data relating to the vital signs of the person, as described in the preceding example.
[165] Puis Ă lâĂ©tape 55, lâintelligence artifice fournit un score prĂ©alable reprĂ©sentatif du diagnostic obtenu sur la base des donnĂ©es jusquâalors saisies. [165] Then in step 55, the artificial intelligence provides a preliminary score representative of the diagnosis obtained on the basis of the data entered until then.
[166] A lâĂ©tape 56, des questions additionnelles sont posĂ©es Ă la personne, et les rĂ©ponses obtenues sont utilisĂ©es pour affiner le score prĂ©alable obtenu Ă lâĂ©tape 55. [166] In step 56, additional questions are asked of the person, and the answers obtained are used to refine the preliminary score obtained in step 55.
[167] Un score final est donnĂ© Ă lâĂ©tape 57 par lâintelligence artificielle, qui est enregistrĂ© sur lâespace de stockage de donnĂ©es 40. [167] A final score is given in step 57 by the artificial intelligence, which is recorded on the data storage space 40.
[168] A lâĂ©tape 58, le score final est affichĂ© pour information Ă la personne. [168] At step 58, the final score is displayed for information to the person.
[169] On va maintenant prĂ©senter un autre mode de rĂ©alisation de lâinvention en rĂ©fĂ©rence Ă la figure 4. [169] We will now present another embodiment of the invention with reference to Figure 4.
[170] Dans cet exemple, le systĂšme 1 dâaide pour fournir une information de diagnostic, lĂ©gĂšrement diffĂšrent de celui dĂ©crit plus haut, comporte: [170] In this example, the aid system 1 for providing diagnostic information, slightly different from that described above, comprises:
- un dispositif dâacquisition 7 de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, ici un capteur de mesure physiologique qui est un radar pour acquĂ©rir ces donnĂ©es dâexamen, - a device 7 for acquiring examination data on the person, this acquisition device comprising at least a first sensor, here a physiological measurement sensor which is a radar for acquiring this examination data,
- un dispositif de traitement de donnĂ©es 3 agencĂ© pour recevoir ces donnĂ©es obtenues par le dispositif dâacquisition, - a data processing device 3 arranged to receive these data obtained by the acquisition device,
- un dispositif dâaffichage 30 agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es par le dispositif de traitement de donnĂ©es, cette information de diagnostic pouvant notamment
ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score - a display device 30 arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular be representative of a level of probability that the person is affected by the disease, this level of probability possibly being in particular a score
- le dispositif dâacquisition 7 comprenant en outre un capteur de correction 33 diffĂ©rent dudit premier capteur, Ă savoir le radar, et agencĂ© pour acquĂ©rir au moins une donnĂ©e sur la personne, cette donnĂ©e Ă©tant une donnĂ©e de correction diffĂ©rente de donnĂ©es acquises par le premier capteur, - the acquisition device 7 further comprising a correction sensor 33 different from said first sensor, namely the radar, and arranged to acquire at least one datum on the person, this datum being a different correction datum from data acquired by the first sensor,
- le dispositif de traitement de donnĂ©es Ă©tant agencĂ© pour utiliser cette donnĂ©e de correction pour corriger les donnĂ©es dâexamen fournies par le premier capteur. - the data processing device being arranged to use this correction data to correct the examination data provided by the first sensor.
[171] Ce capteur de correction 33 est agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [171] This correction sensor 33 is arranged to acquire data representative of a person's voice.
[172] Ce capteur de correction 33 agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne comporte un microphone 33, notamment un microphone directionnel ou une camĂ©ra. [172] This correction sensor 33 arranged to acquire data representative of a voice of the person comprises a microphone 33, in particular a directional microphone or a camera.
[173] On peut prĂ©voir que le dispositif dâacquisition 7 comporte Ă la fois un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne et un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [173] Provision may be made for the acquisition device 7 to comprise both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire data representative of a voice of the person.
[174] Ce capteur de correction pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne comporte une camĂ©ra, notamment de type 3D, pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne. [174] This correction sensor for acquiring data representative of a person's movement comprises a camera, in particular of the 3D type, for acquiring data representative of a person's movement.
[175] Cette caméra est notamment une caméra fonctionnant sur le principe du temps de vol (en anglais : Time of Flight, TOF) qui permet de mesurer en temps réel une scÚne en 3 dimensions (3D). Ce type de caméra est connu [175] This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D). This type of camera is known
[176] Le radar est agencĂ© notamment pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun rythme respiratoire de la personne, notamment en dĂ©tectant le mouvement de la peau de la personne. [176] The radar is arranged in particular to acquire data representative of the person's breathing rate, in particular by detecting the movement of the person's skin.
[177] Le radar est agencĂ© pour ĂȘtre placĂ© face Ă la personne ou dans le dos de la personne. [177] The radar is arranged to be placed in front of the person or behind the person.
[178] Bien entendu, des capteurs autres que le radar peuvent ĂȘtre utilisĂ©s, par exemple une camĂ©ra Proche Infrarouge.
[179] Le dispositif de traitement de donnĂ©es 3 est agencĂ© pour rĂ©aliser la correction des donnĂ©es dâexamen en fonction de la donnĂ©e de correction Ă lâaide dâune intelligence artificielle. [178] Of course, sensors other than radar can be used, for example a Near Infrared camera. [179] The data processing device 3 is arranged to carry out the correction of the examination data according to the correction data using an artificial intelligence.
[180] Le dispositif de traitement de données 3 est agencé pour obtenir un signal de correction basé sur les données de correction, ce signal de correction étant évolutif en fonction du temps. [180] The data processing device 3 is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
[181] Le dispositif de traitement de donnĂ©es 3 est agencĂ© pour fournir les donnĂ©es dâexamen, par exemple liĂ©es au rythme respiratoire, aprĂšs correction Ă lâaide du signal de correction. [181] The data processing device 3 is arranged to provide the examination data, for example related to the breathing rate, after correction using the correction signal.
[182] Lâinvention permet de prendre en compte le bruit liĂ© aux mouvements de la personne et/ou Ă sa voix, pour fournir des donnĂ©es dâexamen fiables et prĂ©cises. [182] The invention makes it possible to take into account the noise linked to the movements of the person and/or to his voice, in order to provide reliable and precise examination data.
[183] En effet les mouvements et les paroles de la personne sont susceptibles de crĂ©er des interfĂ©rences dans lâacquisition de donnĂ©es, notamment de type physiologiques telles que le rythme respiratoire. [183] Indeed, the movements and words of the person are likely to create interference in the acquisition of data, in particular of physiological type such as the respiratory rate.
[184] On peut le voir par exemple sur les courbes de la figures 4. [184] This can be seen for example on the curves in figure 4.
[185] La courbe 101 illustre lâamplitude de lâerreur, au fil du temps, sur une mesure de rythme respiratoire sur la personne, cette erreur Ă©tant induite par des mouvements de la personne lors de la mesure et par le fait quâelle parle pendant la mesure. [185] Curve 101 illustrates the magnitude of the error, over time, in a measurement of respiratory rate on the person, this error being induced by movements of the person during the measurement and by the fact that she speaks during the measurement.
[186] Cette amplitude dâerreur sur la courbe 101 est relativement grande. [186] This error amplitude on curve 101 is relatively large.
[187] La courbe 102 montre lâamplitude de lâerreur, au fil du temps, sur une mesure de rythme respiratoire sur la personne, lorsquâest prise en compte une correction tenant compte des mouvements de la personne dĂ©tectĂ©s par la camĂ©ra de mouvements. [187] Curve 102 shows the magnitude of the error, over time, in a breathing rate measurement on the person, when taking into account a correction taking into account the movements of the person detected by the camera of movements.
[188] Lâamplitude sur la courbe 102 est rĂ©duite par rapport Ă la courbe 101. [188] The amplitude on curve 102 is reduced compared to curve 101.
[189] Enfin la courbe 103 illustre lâamplitude de lâerreur, au fil du temps, sur une mesure de rythme respiratoire sur la personne, lorsque sont prises en compte les corrections liĂ©es Ă la fois aux mouvements et Ă la parole de la personne. [189] Finally, curve 103 illustrates the amplitude of the error, over time, on a measurement of respiratory rate on the person, when the corrections linked to both the movements and the speech of the patient are taken into account. nobody.
[190] Cette courbe 103 est proche de zéro grùce aux corrections réalisées.
[191] Le systĂšme de lâinvention permet ainsi de mettre en Ćuvre le procĂ©dĂ© comportant les Ă©tapes suivantes: [190] This curve 103 is close to zero thanks to the corrections made. [191] The system of the invention thus makes it possible to implement the method comprising the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne, Ă lâaide dâun dispositif dâacquisition de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, notamment un capteur de mesure physiologique tel quâun radar ou une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, notamment ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, notamment lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - acquiring examination data on the person, using a device for acquiring examination data on the person, this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- corriger ces donnĂ©es dâexamen Ă lâaide de donnĂ©es de correction, notamment acquises Ă lâaide dâun capteur de correction. )
- correcting this examination data using correction data, in particular acquired using a correction sensor. )
Claims
[Revendication 1 ] SystĂšme (1 ) dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce systĂšme de dĂ©tection comportant: [Claim 1] Aid system (1) for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- un dispositif dâacquisition (7) de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, notamment un capteur de mesure physiologique tel quâun radar ou une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, notamment ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, notamment lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - an acquisition device (7) for examination data on the person, this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such as a radar or a thermal camera for acquiring this data from examination, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- un dispositif de traitement de donnĂ©es (3) agencĂ© pour recevoir ces donnĂ©es obtenues par le dispositif dâacquisition, - a data processing device (3) arranged to receive these data obtained by the acquisition device,
- notamment un dispositif dâaffichage (30) agencĂ© pour afficher une information de diagnostic de la maladie basĂ©e sur une analyse desdites donnĂ©es par le dispositif de traitement de donnĂ©es, cette information de diagnostic pouvant notamment ĂȘtre reprĂ©sentative dâun niveau de probabilitĂ© que la personne soit atteinte de la maladie, ce niveau de probabilitĂ© pouvant notamment ĂȘtre un score - in particular a display device (30) arranged to display disease diagnostic information based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person has the disease, this level of probability being able in particular to be a score
- le dispositif dâacquisition comprenant en outre un capteur de correction diffĂ©rent dudit premier capteur et agencĂ© pour acquĂ©rir au moins une donnĂ©e sur la personne, cette donnĂ©e Ă©tant une donnĂ©e de correction diffĂ©rente de donnĂ©es acquises par le premier capteur, - the acquisition device further comprising a correction sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor,
- le dispositif de traitement de donnĂ©es Ă©tant agencĂ© pour utiliser cette donnĂ©e de correction pour corriger les donnĂ©es dâexamen fournies par le premier capteur. - the data processing device being arranged to use this correction data to correct the examination data supplied by the first sensor.
[Revendication 2] SystĂšme selon la revendication prĂ©cĂ©dente, selon lequel le capteur de correction est agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne.
[Claim 2] System according to the preceding claim, according to which the correction sensor is arranged to acquire data representative of a movement of the person.
[Revendication 3] SystĂšme selon la revendication prĂ©cĂ©dente, selon lequel ce capteur de correction comporte une camĂ©ra, notamment de type 3D, pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne. [Claim 3] System according to the preceding claim, according to which this correction sensor comprises a camera, in particular of the 3D type, for acquiring data representative of a movement of the person.
[Revendication 4] SystĂšme selon la revendication 1 , selon lequel le capteur de correction est agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [Claim 4] System according to claim 1, according to which the correction sensor is arranged to acquire data representative of a voice of the person.
[Revendication 5] SystĂšme selon la revendication prĂ©cĂ©dente, selon lequel ce capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne comporte un microphone (33), notamment un microphone directionnel ou une camĂ©ra. [Claim 5] System according to the preceding claim, according to which this correction sensor arranged to acquire data representative of a voice of the person comprises a microphone (33), in particular a directional microphone or a camera.
[Revendication 6] SystĂšme selon lâune des revendications prĂ©cĂ©dentes, selon lequel le dispositif dâacquisition comporte Ă la fois un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun mouvement de la personne et un capteur de correction agencĂ© pour acquĂ©rir une donnĂ©e reprĂ©sentative dâune voix de la personne. [Claim 6] System according to one of the preceding claims, according to which the acquisition device comprises both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire a data representative of a person's voice.
[Revendication 7] SystĂšme selon lâune des revendications prĂ©cĂ©dentes, selon lequel le premier capteur, notamment Ă©tant capteur de mesure physiologique, est un radar agencĂ© notamment pour acquĂ©rir une donnĂ©e reprĂ©sentative dâun rythme respiratoire de la personne, notamment en dĂ©tectant le mouvement de la peau de la personne. [Claim 7] System according to one of the preceding claims, according to which the first sensor, in particular being a sensor for physiological measurement, is a radar arranged in particular to acquire data representative of a breathing rate of the person, in particular by detecting the movement of the person's skin.
[Revendication 8] SystĂšme selon lâune des revendications prĂ©cĂ©dentes, selon lequel le dispositif de traitement de donnĂ©es est agencĂ© pour rĂ©aliser la correction des donnĂ©es dâexamen en fonction de la donnĂ©e de correction Ă lâaide dâune intelligence artificielle. [Claim 8] System according to one of the preceding claims, in which the data processing device is arranged to carry out the correction of the examination data as a function of the correction data with the aid of artificial intelligence.
[Revendication 9] SystĂšme selon lâune des revendications prĂ©cĂ©dentes, selon lequel le dispositif de traitement de donnĂ©es (3) est agencĂ© pour obtenir un signal de correction basĂ© sur les donnĂ©es de correction, ce signal de correction Ă©tant Ă©volutif en fonction du temps. [Claim 9] System according to one of the preceding claims, according to which the data processing device (3) is arranged to obtain a correction signal based on the correction data, this correction signal being evolutionary as a function of time.
[Revendication 10] SystĂšme selon lâune des revendications prĂ©cĂ©dentes, selon lequel le dispositif de traitement de donnĂ©es (3) est agencĂ© pour fournir les donnĂ©es dâexamen, par exemple liĂ©es au rythme respiratoire, aprĂšs correction Ă lâaide du signal de correction.
[Claim 10] System according to one of the preceding claims, in which the data processing device (3) is arranged to supply the examination data, for example relating to the respiratory rate, after correction using the correction.
[Revendication 11] ProcĂ©dĂ© dâaide pour fournir une information de diagnostic, notamment en vue de la dĂ©tection dâune maladie sur une personne, notamment une maladie contagieuse telle que le COVID 19, ce procĂ©dĂ© comportant les Ă©tapes suivantes: [Claim 11] Aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- acquĂ©rir des donnĂ©es dâexamen sur la personne, Ă lâaide dâun dispositif dâacquisition (7) de donnĂ©es dâexamen sur la personne, ce dispositif dâacquisition comportant au moins un premier capteur, notamment un capteur de mesure physiologique tel quâun radar ou une camĂ©ra thermique pour acquĂ©rir ces donnĂ©es dâexamen, notamment ce dispositif dâacquisition comportant une pluralitĂ© de capteurs agencĂ©s pour fonctionner sans contact avec la personne, notamment lâun au moins des capteurs sans contact Ă©tant agencĂ© pour acquĂ©rir une donnĂ©e rĂ©ponse fournie par la personne, - acquiring examination data on the person, using an acquisition device (7) for examination data on the person, this acquisition device comprising at least a first sensor, in particular a sensor of physiological measurement such as a radar or a thermal camera to acquire this examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
- corriger ces donnĂ©es dâexamen Ă lâaide de donnĂ©es de correction, notamment acquises Ă lâaide dâun capteur de correction- correcting this examination data using correction data, in particular acquired using a correction sensor
[Revendication 12] ProcĂ©dĂ© selon la revendication prĂ©cĂ©dente, dans le cas de lâĂ©valuation du rythme cardiaque au moyen dâun radar, cette Ă©valuation Ă©tant perturbĂ©e par la voix de la personne ou le mouvement de la personne, le procĂ©dĂ© ayant lâĂ©tape dâĂ©valuer cette perturbation grĂące Ă un microphone ou une camĂ©ra qui permet une lecture labiale ou encore au moyen d'une camĂ©ra 4D ou d'une balance inertielle, pour corriger le donnĂ©es dâexamen. )
[Claim 12] Method according to the preceding claim, in the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the method having the step to evaluate this disturbance thanks to a microphone or a camera that allows lip reading or even by means of a 4D camera or an inertial balance, to correct the examination data. )
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2106142A FR3123795A1 (en) | 2021-06-10 | 2021-06-10 | Help system to provide diagnostic information |
PCT/EP2022/065309 WO2022258560A1 (en) | 2021-06-10 | 2022-06-06 | System for assisting with provision of diagnostic information |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4351406A1 true EP4351406A1 (en) | 2024-04-17 |
Family
ID=76807856
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP22733557.7A Pending EP4351406A1 (en) | 2021-06-10 | 2022-06-06 | System for assisting with provision of diagnostic information |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP4351406A1 (en) |
CN (1) | CN117479877A (en) |
FR (1) | FR3123795A1 (en) |
WO (1) | WO2022258560A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11642085B2 (en) * | 2020-10-06 | 2023-05-09 | Nec Corporation Of America | Automated health check device and methods |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3639733B1 (en) * | 2012-05-30 | 2022-10-26 | ResMed Sensor Technologies Limited | Apparatus for monitoring cardio-pulmonary health |
CN116269262A (en) * | 2016-12-01 | 2023-06-23 | æŸäžç„èŻäș§æç»è„æ ȘćŒäŒç€Ÿ | Biological information detection device, biological information detection method, and storage medium |
GB201706449D0 (en) * | 2017-04-24 | 2017-06-07 | Oxehealth Ltd | Improvements in or realting to in vehicle monitoring |
-
2021
- 2021-06-10 FR FR2106142A patent/FR3123795A1/en active Pending
-
2022
- 2022-06-06 EP EP22733557.7A patent/EP4351406A1/en active Pending
- 2022-06-06 WO PCT/EP2022/065309 patent/WO2022258560A1/en active Application Filing
- 2022-06-06 CN CN202280041372.1A patent/CN117479877A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
CN117479877A (en) | 2024-01-30 |
FR3123795A1 (en) | 2022-12-16 |
WO2022258560A1 (en) | 2022-12-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220331028A1 (en) | System for Capturing Movement Patterns and/or Vital Signs of a Person | |
US20190216333A1 (en) | Thermal face image use for health estimation | |
US20150305662A1 (en) | Remote assessment of emotional status | |
US12039764B2 (en) | Multimodal diagnosis system, method and apparatus | |
CN108882853A (en) | Measurement physiological parameter is triggered in time using visual context | |
WO2020190648A1 (en) | Method and system for measuring pupillary light reflex with a mobile phone | |
EP4149345A1 (en) | Disease detection system | |
EP4351406A1 (en) | System for assisting with provision of diagnostic information | |
McGinnis et al. | Validation of smartphone based heart rate tracking for remote treatment of panic attacks | |
WO2023001549A1 (en) | System for assisting with provision of diagnostic information | |
CN109640819B (en) | Apparatus, system and method for detecting asthma attack or asthma in a subject | |
US20220189639A1 (en) | Healthcare device, system, and method | |
EP4333695A1 (en) | System for assisting with provision of diagnostic information | |
US11523742B2 (en) | System, method, and apparatus for temperature asymmetry measurement of body parts | |
RU188260U1 (en) | SYSTEM BASED ON THERMOELECTRIC RECEIVERS OF INFRARED RADIATION AND PHYSIOLOGICAL SENSORS FOR DETERMINING THE RELIABILITY OF HUMAN RESPONSES | |
WO2022096309A1 (en) | Disease detection system | |
KUSHWAH et al. | DATA STUDY OF SAFE ENTRY STATION (SES) TO ENSURE FIT FOR DUTY | |
US11475564B2 (en) | Non-invasive non-contact system and method for measuring health parameters | |
EP4244869A1 (en) | Clinical warning score system | |
TW202325221A (en) | Apparatus, method and a device for non-contact & non-invasive blood sugar monitoring to help monitor diabetic patients and hypercoagulation | |
IT202000016252A1 (en) | ASSESSMENT SYSTEM OF THE TERRITORIAL INCIDENCE OF SYMPTOMS | |
CN117218154A (en) | Patient attention degree judging method based on information entropy in meta-diagnosis room scene | |
CN116491939A (en) | Non-contact and non-invasive method for monitoring blood glucose levels of a user | |
EP3323098A1 (en) | Method of gathering and/or processing of neuromarketing data and system for realization thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20231205 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |