WO2022096309A1 - Système de détection d'une maladie - Google Patents
Système de détection d'une maladie Download PDFInfo
- Publication number
- WO2022096309A1 WO2022096309A1 PCT/EP2021/079597 EP2021079597W WO2022096309A1 WO 2022096309 A1 WO2022096309 A1 WO 2022096309A1 EP 2021079597 W EP2021079597 W EP 2021079597W WO 2022096309 A1 WO2022096309 A1 WO 2022096309A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- person
- processing device
- acquisition device
- camera
- Prior art date
Links
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 title claims abstract description 37
- 201000010099 disease Diseases 0.000 title claims abstract description 36
- 238000001514 detection method Methods 0.000 title claims abstract description 9
- 238000012545 processing Methods 0.000 claims abstract description 54
- 238000005259 measurement Methods 0.000 claims abstract description 36
- 238000012937 correction Methods 0.000 claims abstract description 23
- 208000025721 COVID-19 Diseases 0.000 claims abstract description 12
- 238000012512 characterization method Methods 0.000 claims description 14
- 230000004927 fusion Effects 0.000 claims description 11
- 230000000747 cardiac effect Effects 0.000 claims description 10
- 238000000034 method Methods 0.000 claims description 9
- 238000012774 diagnostic algorithm Methods 0.000 claims description 8
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 6
- 230000033764 rhythmic process Effects 0.000 claims description 6
- 206010003119 arrhythmia Diseases 0.000 claims description 5
- 230000002060 circadian Effects 0.000 claims description 5
- 230000006793 arrhythmia Effects 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 4
- 238000003745 diagnosis Methods 0.000 description 15
- 238000013473 artificial intelligence Methods 0.000 description 14
- 230000000241 respiratory effect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 7
- 210000000216 zygoma Anatomy 0.000 description 7
- 238000002496 oximetry Methods 0.000 description 6
- 206010037660 Pyrexia Diseases 0.000 description 5
- 238000009529 body temperature measurement Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 5
- 210000004369 blood Anatomy 0.000 description 4
- 239000008280 blood Substances 0.000 description 4
- 230000036760 body temperature Effects 0.000 description 3
- 238000011109 contamination Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 210000001061 forehead Anatomy 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000006213 oxygenation reaction Methods 0.000 description 3
- 230000036387 respiratory rate Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 2
- 210000004027 cell Anatomy 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 239000001301 oxygen Substances 0.000 description 2
- 230000035479 physiological effects, processes and functions Effects 0.000 description 2
- 230000004083 survival effect Effects 0.000 description 2
- 238000001429 visible spectrum Methods 0.000 description 2
- 206010038687 Respiratory distress Diseases 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 210000003743 erythrocyte Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004060 metabolic process Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000001441 oximetry spectrum Methods 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000005808 skin problem Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 210000000689 upper leg Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B5/02055—Simultaneously evaluating both cardiovascular condition and temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
- A61B5/1079—Measuring physical dimensions, e.g. size of the entire body or parts thereof using optical or photographic means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6893—Cars
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
- G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/02—Operational features
- A61B2560/0242—Operational features adapted to measure environmental factors, e.g. temperature, pollution
- A61B2560/0247—Operational features adapted to measure environmental factors, e.g. temperature, pollution for compensation or correction of the measured physiological value
- A61B2560/0252—Operational features adapted to measure environmental factors, e.g. temperature, pollution for compensation or correction of the measured physiological value using ambient temperature
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
- A61B5/02427—Details of sensor
- A61B5/02433—Details of sensor for infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
- A61B5/0816—Measuring devices for examining respiratory frequency
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Definitions
- the present invention relates to a system for detecting a disease on a person, in particular a contagious disease such as an acute respiratory distress disease such as COVID 19.
- a contagious disease such as an acute respiratory distress disease such as COVID 19.
- the subject of the invention is thus a system for detecting a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data,
- [7] - a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease .
- the data processing device comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device and to supply said diagnostic information.
- the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
- the display device is a laptop computer screen and the data processing device includes this computer's microprocessor.
- the display device is arranged to be visible to the examined person, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and data processing being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device and possibly also the data processing device, are arranged to be embedded in a motor vehicle.
- the display device and possibly also the data processing device, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device is arranged to make the diagnosis automatically, without human intervention.
- the invention allows rapid diagnosis and/or massive screening allowing a return to work or faster deconfinement.
- the examination data acquisition device is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to examine.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safety distance, of vital signals and of thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measurements.
- the invention due to relatively light equipment, notably allows easy deployment of field hospitals in support of populations.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy. The invention allows its rapid implementation throughout a territory.
- the acquisition device comprises a radar for acquiring data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person tested providing data characterization of the person.
- the data processing device is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a respiratory rate, an amplitude of respiration, a time of inspiration and expiration, heart rhythm and arrhythmia.
- the algorithm uses temperatures measured on remarkable areas, located by image processing, or even the oxygen level linked to the person examined.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as data on age, gender, clothing, height, body mass index , also called BMI.
- the system is arranged to carry out the acquisition of examination data until the provision of the diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the system is arranged to allow acquisition of examination data by taking measurements at a distance of 60 cm to 2 m between the acquisition device and the person. It is avoided that the person has to be in contact with the acquisition device.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. Diagnostic information can, if necessary, be automatically sent to a doctor and can be kept on a cloud-type data storage system.
- the data processing device uses an algorithm for analyzing the acquired examination data and, if necessary, for sorting people with the aim of detecting cases of sick people, based on all the data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
- This learning by artificial intelligence can be carried out by means of a set of measurements collected by the system but also by means of the medical follow-up of patients. This allows the improvement of the model over time.
- the measurements made by the acquisition device can be used to subsequently refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate, a maximum face temperature and a reference temperature-controlled garment or surface temperature.
- the remarkable measurement points are located by an artificial intelligence by means of an object identification flowchart.
- the temperature relative to a remarkable point is obtained by time average and by average of the temperatures of a surface defined by pixels taken from an infrared camera image near the remarkable point identified on the visible image by means of an object identification algorithm.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to an identity reading of the person, thanks to a classification system which can be learned on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, a class of personal characteristics, a time of day, can be arranged to additionally use route data of the examined person to check whether he has come across a sick person or has passed through a region at risk.
- the system is arranged to operate in the absence of a radar and using RGB cameras to estimate cardiac and respiratory parameters.
- the temperature relative to a remarkable point can be obtained by time average and by average of the temperatures of a surface defined by pixels taken from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image zone called Building box, which surrounds it, for example by means of the geometric mean of the sides of the image area.
- This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the system does not have an RGB camera and/or does not use the surface whose temperature is controlled.
- the system uses the external temperature and a heat transfer model on the covered areas or even only the temperature differences between the remarkable points.
- the system is arranged to use a fusion of non-contact measurements, in particular of vital signals and thermal and visible imaging.
- the diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
- Diagnostic information may also include an assessment of disease severity.
- the invention also relates to a method for providing diagnostic information for the detection of a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
- an acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera to acquire this examination data
- the present invention can allow controls in the public space in general, in particular on people's circulation routes, at entrances and exits of buildings, at airport gates, in schools.
- the object of the invention is also to detect a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data,
- this data processing device being arranged to generate a corrected value, or also called normalized value, obtained from at least one examination datum measured by the acquisition device and corrected by a corrective term from a patch table.
- the invention makes it possible to correct errors in context measurements and variations between individuals, variations linked to their bodily characteristics such as age, gender and/or body size.
- the normalized value can comprise a component encoded by default or be a value encoded by default.
- a first corrective term is linked to two effects, a first effect being the correction linked to the effect of the variation in the temperature of the room on the camera of the device. acquisition, in particular on the camera cell.
- a drift in the measurement when the camera temperature changes This is the case when the room temperature changes because, in general, the measurement is not absolute but differential.
- the second part of this correction depends on the impact of ambient temperature on the physiology of the person being tested. When the room temperature rises, that person's skin temperature changes slightly to keep the body in ideal survival conditions.
- a second corrective term corresponds to a change of reference of the zone of the person to be tested.
- the third term corresponds to a correction linked to the age of the person tested.
- the fourth corrective term corresponds to a correction linked to the gender of the person.
- the fifth corrective term corresponds to a clothing level of the person tested.
- the sixth corrective term corresponds to the observation that a person's temperature naturally fluctuates according to the time of day. This is the circadian cycle.
- the temperature of the person is normalized at a reference time, for example 6 o'clock in the morning.
- the processing device is arranged to process examination data obtained for example using a camera, thermocouples, radar, oximeter of the acquisition device, in order to normalize them with a view to obtaining said normalized value, and to make them comparable to one or more universal values.
- a universal value corresponds to a value obtained using synthetic characteristics of a fictitious reference person. These characteristics are preferably average values, measured in particular on a reference population, for example women aged 25 to 35. years old, BMI of 25, living in Northern Europe. Such a fictitious reference person is called a Persona.
- the acquisition device comprises a radar to acquire at least one data relating to a vital sign of a person, one or two thermal cameras to acquire temperature data and a camera operating in the visible light range to acquire characterization data of a tested person.
- the acquisition device further comprises an NIR camera, capable of operating in the near infrared, with an illuminator, this camera being arranged to acquire ambient temperature data , ambient light and time of day.
- the acquisition device further comprises an NIR camera, capable of operating in the near infrared, arranged to measure the person's oximetry and respiratory characteristics. tested.
- the examination data acquired by the acquisition device are chosen from: a characteristic of a temperature relating to a person tested, a cardiac, respiratory or circulatory characteristic of the blood of the person being tested.
- the processing device comprises a memory of universal values to which are compared the corrected values resulting from the examination data acquired by the acquisition device.
- the corrected values underwent a correction based on taking into account context measurement errors and/or variations between individuals, variations linked to their bodily characteristics such as age, gender and build.
- these cameras and radar are in particular embedded in a vehicle.
- the data processing device (3) is arranged to carry out a fusion of data resulting from the acquisition of data from the aforementioned cameras and radars, these data comprising in particular data relating to vital signs, temperature data and characterization data of the person tested, ambient temperature data, ambient light and time of day.
- the data processing device is arranged to carry out, using an algorithm, a diagnosis based on a fusion of vital data including in particular a respiratory rhythm, a respiratory amplitude, inspiration and expiration time, cardiac rhythm and arrhythmia.
- the fusion of data to perform the diagnosis also includes data from an indirect oximetry measurement, temperature data measured on remarkable areas of the person tested, areas located in particular by image processing, these areas being for example the inside of the mouth, the tip of the nose, the cheekbones and/or the palm of the hand of the person tested, characterization data of the person such as age, gender, dress, BMI body mass index, genotype, and environmental data such as ambient temperature.
- the system comprises a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information possibly being representative of a level of probability that the person has the disease.
- the oximetry data of the person tested is in particular a function of a relative variation of the values obtained for example by the two NIR and FIR cameras between two lighting states with the illuminator and identifying the predefined or learned remarkable points thanks to the camera operating in the visible light domain and an object identification model defined by learning.
- this involves placing a virtual mesh on the face of the person tested and following the nodes which define this mesh.
- the two NIR and FIR cameras produce different images which vary when the wavelengths of the incident light change and a fortiori when the illuminator emits different non-visible artificial lights.
- the comparison of the values read on the FIR and NIR cameras with and without illumination helps identify the oxygenation of the person being tested.
- illumination can be at multiple wavelengths because absorption and reflection from the test person's skin depends on the test person's oxygenation level or red blood cell components.
- the invention thus proposes in particular to compare the values between the different points of the face in order to complete this evaluation. This comparison also makes it possible to assess circulation problems and potentially skin problems.
- the resolution of the facial mesh can be large or finer depending on the expected accuracy or the diagnosis to be made.
- the invention thus proposes the addition of the evaluation of oxygenation in the blood for comparative measurement between thermal camera(s) in the presence or absence of one or more illuminations with different or centered spectra on different wavelengths, or by identification of the metabolism by studying the difference in behavior of several remarkable points (nose, cheekbone, hand, forehead, mouth, eye, etc.)
- the processing device is arranged to perform a correction taking into account the circadian cycle and the ambient temperature for the threshold values, optionally also to correct drifts in the measurements of the NIR and FIR cameras as well as a possible radar.
- FIG. 1 schematically illustrates a system according to a non-limiting embodiment of the invention.
- Figures 1 and 2 show a system 1 for detecting a disease on a person, in particular a contagious disease such as COVID 19, according to the invention.
- This system 1 comprises: a device 7 for acquiring examination data on the person, - a data processing device 3 arranged to receive these examination data obtained by the acquisition device 7,
- a display device 30 arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease.
- This system 1 includes in particular:
- this sensor being a camera operating in the near infrared
- a respiratory activity sensor in particular in frequency and/or respiratory amplitude, of at least one passenger, this sensor being a camera operating in the far infrared, or thermal camera,
- a radar arranged to measure the person's vital signs
- a sensor of the passenger's profile characteristics in particular his gender, weight, height and age, this sensor being here a Red Green Blue camera, also called RGB camera in English,
- - a card reader to read a person's identity card and obtain the person's personal data.
- sensors and cameras which are part of the acquisition device 7, are represented by reference 2 in Figure 1.
- Some sensors 2 are for example arranged on a ceiling of the vehicle.
- One of the other cameras 2 is arranged in a side upright 6 of the vehicle V.
- the heart rate and respiration sensor may be in the seat back or in the center console at the level of the passenger's thigh, this being non-limiting.
- the data processing device 3 comprises an artificial intelligence unit arranged to process the examination data obtained by the acquisition device 7 and supply said diagnostic information.
- the data processing device 3 and the display device 30 are part of the same device, for example a computer, in particular a laptop computer.
- the display device 30 is a screen of the laptop computer and the data processing device includes this computer's microprocessor.
- the display device 30 is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and processing devices data being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
- the display device 30, and also the data processing device 3, are here arranged to be embedded in a motor vehicle.
- the display device 30, and possibly also the data processing device 3 are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
- the processing device 3 is arranged to make the diagnosis automatically, without human intervention.
- the examination data acquisition device 7 is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to be examined.
- the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safe distance, vital signals and thermal and visible imaging.
- the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measures.
- the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy.
- the acquisition device 7 comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person being tested providing data characterizing the person.
- the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of vital data, including breathing rate, breathing amplitude, inspiration and expiration time, rhythm and cardiac arrhythmia, oximetry.
- these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
- the diagnostic algorithm uses a characterization of the person, such as age, gender, dress, height, body mass index data.
- the system is designed to carry out the acquisition of examination data until the provision of diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
- the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example.
- the diagnostic information can, if necessary, be sent automatically to a doctor and can be kept on a data storage system 40 of Cloud type.
- the data processing device 3 uses an algorithm for analyzing the acquired examination data and, if necessary, sorting people with the aim of detecting cases of sick people, based on the set from data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
- the measurements taken by the acquisition device can be used to later refine the diagnosis made by the artificial intelligence.
- the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
- the acquisition device 7 is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, if necessary , a peak face temperature, and a reference temperature-controlled clothing or surface temperature.
- the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to a reading of the person's identity, thanks to a classification system whose learning can be performed on RGB (Red Green Blue) or Infrared images.
- RGB Red Green Blue
- FIR camera Far Infrared
- the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, class of personal characteristics, time of day, can be arranged to additionally use person journey data examined to check whether it has crossed paths with a sick person or passed through a region at risk.
- the temperature relative to a remarkable point can be obtained by temporal average and by average of the temperatures of a surface defined by pixels resulting from a camera image near the remarkable point.
- the remarkable point is for example defined geometrically by means of an image area called Building box, which surrounds it. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
- the diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
- diagnostic information for the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease (step 29).
- Steps 20 to 25 are as follows:
- step 20 the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera), this is step 20,
- - acquisition of the respiratory rate step 22 using the FIR camera - acquisition of the heart rate in step 23 using the near infrared camera, or NIR camera, namely a camera capable of operating in the near infrared,
- NIR near-infrared
- Examination data may, where appropriate, include pupil size and position.
- Diagnostic information is automatically sent to a cloud-based remote data storage system.
- the acquisition device is in particular arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also the case where applicable, a maximum facial temperature and a temperature of a garment or of a reference temperature-controlled surface, and where applicable a respiratory volume, tremors, the level of oxygen in the blood.
- Detection system 1 includes:
- this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data
- a data processing device 3 arranged to receive these examination data obtained by the acquisition device, and this data processing device 3 is arranged to generate a corrected value, or also called normalized value, obtained from at least one examination datum measured by the acquisition device 7 and corrected by a corrective term from a correction table.
- This correction table may be a table stored by the processing device or, as a variant, an updated table of values, in particular thanks to an artificial intelligence unit.
- the processing device is arranged to process examination data obtained using a camera, thermocouples, radar, an oximeter of the acquisition device, in order to standardize them and make them comparable to one or more universal values.
- the acquisition device 7 comprises a radar to acquire at least one data relating to a vital sign of a person, two thermal cameras to acquire temperature data and a camera operating in the field visible light to acquire characterization data of a tested person.
- the acquisition device 7 further comprises an NIR camera, capable of operating in the near infrared, with an illuminator, this camera being arranged to acquire data on ambient temperature, ambient luminosity and the time of the day.
- the acquisition device 7 also includes an NIR camera, capable of operating in the near infrared, arranged to measure the oximetry and respiratory characteristics of the person tested.
- the examination data acquired by the acquisition device are chosen from: a characteristic of a temperature relating to a person tested, a cardiac, respiratory or circulatory characteristic of the blood of the person tested.
- the processing device comprises a memory of universal values with which the corrected values, or normalized values, resulting from the examination data acquired by the acquisition device are compared.
- the corrected values underwent a correction based on taking into account errors in context measurements and/or variations between individuals, variations linked to their bodily characteristics such as age, gender and diverence.
- the temperature taken on the head of the person tested using the acquisition device 7 is 37.8° which is a temperature usually considered as that of a person with a fever. This measurement corresponds to an examination data of 100.
- the invention here makes it possible to correct this conclusion "person with a fever” / "person without a fever” according to the corrective terms of the correction table.
- the first correction associated with a corrective term 101 , is linked to two effects.
- a first effect is the correction linked to the effect of the variation in the temperature of the room on the camera of the acquisition device 7, in particular on the cell of the camera.
- the second part of this correction depends on the impact of ambient temperature on the physiology of the person being tested. When the room temperature rises, the temperature of that person's skin changes slightly to keep the body in ideal survival conditions. In the example described here, the sum of the two correction effects gives a corrective term of -0.3°C because the reference temperature is 20° and the room temperature here is 23°C.
- a body temperature of the person tested of 37.5°C at 23°C ambient corresponds respectively to 37.2°C at 20°C.
- the second term, reference 102 has a value equal to 0.
- This term 102 is chosen to, in the context of a change of reference, bring the temperature measured at the level of the mouth to that of the forehead. For example 37.5°C in the mouth corresponds to 37.8°C on the forehead.
- the third term, reference 103 corresponds to a correction linked to the age of the person tested, here of value 0.
- a corrective term of 0.1°C is chosen for a patient of 50 years compared to a reference of 30 years.
- a measurement of 37.5°C at 50 years old corresponds to 37.6°C at 30 years old.
- the fourth corrective term, reference 104 corresponds to a gender-related correction. For example, women have a slightly higher average temperature than men. The normalized temperature is therefore calculated with respect to the female gender, and the corrective term 104 is applied for a male tested person.
- the fifth corrective term, reference 105 corresponds to a clothing level of the person tested.
- the sixth corrective term, reference 106 corresponds to the observation that a person's temperature fluctuates naturally depending on the time of day. This is the circadian cycle.
- the temperature of the person is normalized at a reference time, for example 6 o'clock in the morning.
- the seventh and eighth corrective terms 107 and 108 depend respectively on the body mass index BMI and the physical form of the person.
- the global correction represented by the global corrective term 110, is the sum of the corrective terms 101 to 108.
- This global corrective term 110 allows a standardization of the temperature measurement, which allows a comparison with one or more threshold values and therefore to define a risk of contamination.
- the corrected temperature 111 is 37.3°, which corresponds to a 0% risk of having a fever.
- the corrected temperature here 37.3°
- a stored universal temperature here a fever threshold value at 37.7°, for example.
- the data processing device 3 is arranged to carry out, using an algorithm, a diagnosis based on a fusion of vital data including in particular a respiratory rate, a respiratory amplitude, a inspiration and expiration time, cardiac rhythm and arrhythmia. All of this vital data can undergo normalization in the manner described above using corrective terms.
- the corrected values are compared to universal values, in particular threshold values to conclude on diagnostic information.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- Cardiology (AREA)
- Physiology (AREA)
- Artificial Intelligence (AREA)
- Epidemiology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Primary Health Care (AREA)
- Pulmonology (AREA)
- Evolutionary Computation (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Dentistry (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Signal Processing (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/252,269 US20230414114A1 (en) | 2020-11-09 | 2021-10-26 | Disease detection system |
EP21798042.4A EP4240230A1 (fr) | 2020-11-09 | 2021-10-26 | Système de détection d'une maladie |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2011469A FR3115974A1 (fr) | 2020-11-09 | 2020-11-09 | Système de détection d’une maladie |
FR2011469 | 2020-11-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022096309A1 true WO2022096309A1 (fr) | 2022-05-12 |
Family
ID=75539381
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2021/079597 WO2022096309A1 (fr) | 2020-11-09 | 2021-10-26 | Système de détection d'une maladie |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230414114A1 (fr) |
EP (1) | EP4240230A1 (fr) |
FR (1) | FR3115974A1 (fr) |
WO (1) | WO2022096309A1 (fr) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140172310A1 (en) * | 2012-12-19 | 2014-06-19 | Elwha Llc | Systems and methods for controlling acquisition of sensor information |
US20180186234A1 (en) * | 2017-01-03 | 2018-07-05 | General Electric Company | Control system and method |
US10502629B2 (en) * | 2016-08-12 | 2019-12-10 | Infrared Medical Technologies, LLC | Temperature measurement by infrared analysis |
US20200269848A1 (en) * | 2019-02-27 | 2020-08-27 | Denso International America, Inc. | System for adjusting and activating vehicle dynamics features associated with a mood of an occupant |
-
2020
- 2020-11-09 FR FR2011469A patent/FR3115974A1/fr active Pending
-
2021
- 2021-10-26 EP EP21798042.4A patent/EP4240230A1/fr active Pending
- 2021-10-26 US US18/252,269 patent/US20230414114A1/en active Pending
- 2021-10-26 WO PCT/EP2021/079597 patent/WO2022096309A1/fr active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140172310A1 (en) * | 2012-12-19 | 2014-06-19 | Elwha Llc | Systems and methods for controlling acquisition of sensor information |
US10502629B2 (en) * | 2016-08-12 | 2019-12-10 | Infrared Medical Technologies, LLC | Temperature measurement by infrared analysis |
US20180186234A1 (en) * | 2017-01-03 | 2018-07-05 | General Electric Company | Control system and method |
US20200269848A1 (en) * | 2019-02-27 | 2020-08-27 | Denso International America, Inc. | System for adjusting and activating vehicle dynamics features associated with a mood of an occupant |
Also Published As
Publication number | Publication date |
---|---|
US20230414114A1 (en) | 2023-12-28 |
FR3115974A1 (fr) | 2022-05-13 |
EP4240230A1 (fr) | 2023-09-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Dimauro et al. | A new method and a non-invasive device to estimate anemia based on digital images of the conjunctiva | |
Pieczynski et al. | The role of telemedicine, in-home testing and artificial intelligence to alleviate an increasingly burdened healthcare system: Diabetic retinopathy | |
WO2014186838A1 (fr) | Systeme et methode pour un diagnostic medical a distance | |
CA2679837A1 (fr) | Analyse quantitative sur des caracteristiques cutanees | |
US20220270344A1 (en) | Multimodal diagnosis system, method and apparatus | |
US8121863B2 (en) | Method for detecting abnormalities in medical screening | |
EP4149345A1 (fr) | Système de détection d'une maladie | |
US11452479B2 (en) | System and method for diagnosing soft tissue conditions | |
US10993625B1 (en) | System, method, and apparatus for temperature asymmetry measurement of body parts | |
WO2022258560A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
EP4240230A1 (fr) | Système de détection d'une maladie | |
WO2022233637A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
KR102248251B1 (ko) | 체열정보를 이용한 의료진단 보조장치 | |
WO2023001549A1 (fr) | Système d'aide pour fournir une information de diagnostic | |
WO2021176255A1 (fr) | Système, procédé et appareil de mesure d'asymétrie de température de parties de corps | |
Mansfield et al. | Evaluation of static thermal and near-infrared hyperspectral imaging for the diagnosis of acute maxillary rhinosinusitis | |
CN209847148U (zh) | 轮椅上具有红外热成像检测的装置 | |
US20220117524A1 (en) | Apparatus, method and device for non-contact and non-invasive blood sugar monitoring to help monitor diabetic patients and hypercoagulation | |
Escobedo-Gordillo et al. | A non-contact oxygen saturation estimation using Video Magnification and a Deep Learning method | |
Mohamed et al. | Measurement of haemoglobin using digital photographs of mucous membrane of eye. | |
JP2024019863A (ja) | 健康情報評価システム及び健康情報評価方法 | |
Tabassum et al. | A Non-Invasive Method for Detection of Thyroid and Thyroid Dysfunction Diagnosis in Human Blood | |
Kowshik et al. | Precise and Prompt Identification of Jaundice in Infants using AI | |
WO2022136190A1 (fr) | Procédé standardisé de détermination d'un indice d'apnées+hypopnées ou d'une labélisation fonction de cet indice | |
Francis et al. | A Preliminary Investigation on Ocular Thermal Image Patterns Using Clinical Case Studies |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21798042 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18252269 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2021798042 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021798042 Country of ref document: EP Effective date: 20230609 |