EP4373383A1 - Hilfssystem zur bereitstellung von diagnoseinformationen - Google Patents

Hilfssystem zur bereitstellung von diagnoseinformationen

Info

Publication number
EP4373383A1
EP4373383A1 EP22744446.0A EP22744446A EP4373383A1 EP 4373383 A1 EP4373383 A1 EP 4373383A1 EP 22744446 A EP22744446 A EP 22744446A EP 4373383 A1 EP4373383 A1 EP 4373383A1
Authority
EP
European Patent Office
Prior art keywords
person
data
sensors
acquisition device
disease
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP22744446.0A
Other languages
English (en)
French (fr)
Inventor
Georges De Pelsemaeker
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valeo Systemes Thermiques SAS
Original Assignee
Valeo Systemes Thermiques SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Valeo Systemes Thermiques SAS filed Critical Valeo Systemes Thermiques SAS
Publication of EP4373383A1 publication Critical patent/EP4373383A1/de
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6893Cars
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis
    • A61B5/7282Event detection, e.g. detecting unique waveforms indicative of a medical condition
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0015Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
    • A61B5/002Monitoring the patient using a local or closed circuit, e.g. in a room or building
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A61B5/02055Simultaneously evaluating both cardiovascular condition and temperature
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02416Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • A61B5/02427Details of sensor
    • A61B5/02433Details of sensor for infrared radiation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/026Measuring blood flow
    • A61B5/0261Measuring blood flow using optical means, e.g. infrared light
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/0507Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  using microwaves or terahertz waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/08Detecting, measuring or recording devices for evaluating the respiratory organs
    • A61B5/0816Measuring devices for examining respiratory frequency
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/746Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0872Driver physiology
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408Radar; Laser, e.g. lidar
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/221Physiology, e.g. weight, heartbeat, health or special needs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2556/00Input parameters relating to data
    • B60W2556/20Data confidence level
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention

Definitions

  • the present invention relates to an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19.
  • the subject of the invention is thus a system for detecting a disease on a person, in particular a contagious disease such as COVID 19, this detection system comprising:
  • this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data,
  • [7] - a display device arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person is suffering from the disease .
  • the data processing device comprises an artificial intelligence unit arranged to process the data examination data obtained by the acquisition device and providing said diagnostic information.
  • the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
  • the display device is a laptop computer screen and the data processing device includes this computer's microprocessor.
  • the display device is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display device and data processing being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
  • a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
  • the display device and possibly also the data processing device, are arranged to be embedded in a motor vehicle.
  • the display device and possibly also the data processing device, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
  • the processing device is arranged to make the diagnosis automatically, without human intervention.
  • the invention allows rapid diagnosis and/or massive screening allowing a return to work or faster deconfinement.
  • the examination data acquisition device is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to examine.
  • the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safety distance, of vital signals and of thermal and visible imaging.
  • the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measurements.
  • the invention due to relatively light equipment, notably allows easy deployment of field hospitals in support of populations.
  • the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy. The invention allows its rapid implementation throughout a territory.
  • the acquisition device comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person tested providing data characterization of the person.
  • the data processing device is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a respiratory rate, an amplitude of respiration, a time of inspiration and expiration, heart rhythm and arrhythmia.
  • the algorithm uses temperatures measured on remarkable areas, located by image processing, or even the oxygen level linked to the person examined.
  • these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
  • the diagnostic algorithm uses a characterization of the person, such as data on age, gender, clothing, height, body mass index , also called BMI.
  • the system is arranged to carry out the acquisition of examination data until the provision of the diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
  • the system is arranged to allow acquisition of examination data by taking measurements at a distance of 60 cm to 2 m between the acquisition device and the person. It is avoided that the person has to be in contact with the acquisition device.
  • the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example. Diagnostic information can, if necessary, be automatically sent to a doctor and can be kept on a cloud-type data storage system.
  • the data processing device uses an algorithm for analyzing the acquired examination data and, if necessary, for sorting people with the aim of detecting cases of sick people, based on all the data collected and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
  • This learning by artificial intelligence can be carried out by means of a set of measurements collected by the system but also by means of the medical follow-up of patients. This allows the improvement of the model over time.
  • the measurements taken by the acquisition device can be used to subsequently refine the diagnosis made by the artificial intelligence.
  • the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
  • the acquisition device is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also if applicable, a maximum facial temperature and a temperature of a garment or a reference temperature-controlled surface.
  • the remarkable measurement points are located by an artificial intelligence by means of an object identification flowchart.
  • the temperature relative to a remarkable point is obtained by time average and by average of the temperatures of a surface defined by pixels taken from an infrared camera image near the remarkable point identified on the visible image by means of an object identification algorithm.
  • the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to an identity reading of the person, thanks to a classification system which can be learned on RGB (Red Green Blue) or Infrared images.
  • RGB Red Green Blue
  • FIR camera Far Infrared
  • the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, a class of personal characteristics, a time of day, can be arranged to additionally use route data of the examined person to check whether he has come across a sick person or has passed through a region at risk.
  • the system is arranged to operate in the absence of a radar and using RGB cameras to estimate cardiac and respiratory parameters.
  • the temperature relative to a remarkable point can be obtained by time average and by average of the temperatures of a surface defined by pixels taken from a camera image near the remarkable point.
  • the remarkable point is for example defined geometrically by means of an image area called Building box, which surrounds it, for example by means of the geometric mean of the sides of the image area.
  • This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
  • the system does not have an RGB camera and/or does not use the surface whose temperature is controlled.
  • the system uses the external temperature and a heat transfer model on the covered areas or even only the temperature differences between the remarkable points.
  • the system is arranged to use a fusion of non-contact measurements, in particular of vital signals and thermal and visible imaging.
  • the diagnostic information is comprised of a class chosen from among three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
  • Diagnostic information may also include an assessment of disease severity.
  • the invention also relates to a method for providing diagnostic information for the detection of a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
  • an acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera to acquire this examination data
  • diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease.
  • the present invention can allow controls in the public space in general, in particular on people's circulation routes, at entrances and exits of buildings, at airport gates, in schools.
  • a further subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system comprising:
  • this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data
  • this device for acquisition comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person,
  • a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information being able in particular to be representative of a level of probability that the person is suffering from the disease, this level of probability being able in particular to be a score.
  • the invention allows, thanks to the plurality of sensors that operate without contact with the person to be examined, to have enough data to establish a more reliable diagnosis.
  • the data processing device comprises an artificial intelligence unit arranged to process the data examination data obtained by the acquisition device and providing said diagnostic information.
  • the data processing device and the display device are part of the same device, for example a computer, in particular a laptop computer.
  • the display device and possibly also the data processing device, are arranged to be mounted on a motor vehicle.
  • the contactless sensor arranged to acquire response data provided by the person comprises a microphone arranged to receive responses provided orally by the person.
  • the contactless sensor can, as a variant of the microphone which works with voice recognition, include means for analyzing the person's face to, for example, recognize a YES or a NO, for example by nodding.
  • the contactless sensor may include means allowing the person to point to an answer on a screen with a finger, without contact with the screen.
  • the system is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to be examined, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, for example the microphone being used to record the person's answers.
  • the system comprises a data storage unit, for example forming part of a computer, arranged to store the questions of the questionnaire.
  • the data processing device is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this device data processing is arranged to process these data in combination with data from other sensors of the acquisition device, in order to provide the diagnostic information of the disease.
  • the data processing device in order to obtain the diagnostic information, is arranged to run a diagnostic algorithm based on a fusion of the vital data of the person , including respiratory rate, amplitude of respiration, time of inspiration and expiration, cardiac rhythm and arrhythmia, with also questionnaire response data.
  • the system is arranged in such a way as to select the questions to be asked according to the person to be examined, in particular one or more data available on the person.
  • the questions to be asked are of a medical nature, useful for improving the diagnosis in combination with the other data.
  • the questions are chosen from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
  • the system is arranged to perform, using one of the contactless sensors, a measurement whose result data is compared with an answer provided by the person in response to a question in the questionnaire.
  • the system is arranged to acquire data relating to a context, for example an ambient temperature.
  • the system is arranged to carry out a sorting based on a static model to give a score associated with the diagnosis.
  • the system is arranged to operate the following steps: receiving consent data from the person to be subjected to the examination, acquiring characterization data of the person such as gender, age, height, and data representative of the context, acquiring data in response to questions, in particular using a microphone, and measurements of vital signs, processing data to allow an evaluation of the level of reliability of the diagnostic information, to possibly ask additional questions if necessary to refine the diagnostic information, to carry out a sorting based on a static model to give a score associated with the diagnosis.
  • contactless sensors are arranged to allow measurement acquisition at a distance from the person to be examined, between 50 cm and 2 m.
  • Another object of the invention is a terminal that includes the help system as mentioned above.
  • This terminal can for example include a processing unit arranged to process data from the sensors and deliver diagnostic information.
  • This processing unit can be a computer, with or without a screen on the terminal.
  • This terminal notably includes the various sensors.
  • This terminal can be installed at the entrance of a building, for example.
  • Another subject of the invention is an aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
  • this acquisition device comprising in particular at least one sensor for physiological measurement such as a radar, and a thermal camera for acquiring this examination data, this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person, this sensor being in particular a microphone, - receive these data obtained by several sensors of the acquisition device,
  • diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is suffering from the disease, this level of probability which may in particular be a score.
  • Another subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
  • this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such as a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire a response datum provided by the person,
  • a display device arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability being able in particular to be a score
  • the acquisition device further comprising a correction sensor different from said first sensor and arranged to acquire at least one datum on the person, this datum being a correction datum different from data acquired by the first sensor, - the data processing device being arranged to use this correction datum to correct the examination data supplied by the first sensor.
  • the correction sensor is arranged to acquire data representative of a movement of the person.
  • this correction sensor comprises a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
  • This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
  • TOF Time of Flight
  • this camera is an RGB camera operating with, for example, a body segmentation tool or a platform equipped with a strain gauge on which the person is installed, which person can be standing, lying or sitting.
  • the correction sensor is arranged to acquire data representative of a voice of the person.
  • this correction sensor arranged to acquire data representative of a voice of the person comprises a microphone (33), in particular a directional microphone or a camera.
  • the acquisition device comprises both a correction sensor arranged to acquire data representative of a movement of the person and a correction sensor arranged to acquire data representative of a person's voice.
  • the first sensor in particular being a physiological measurement sensor, is a radar arranged in particular to acquire data representative of a breathing rate of the person, in particular by detecting the movement of the person's skin.
  • the radar is arranged to be placed in front of the person or behind the person's back.
  • the data processing device is arranged to carry out the correction of the examination data according to the correction data using an artificial intelligence.
  • the data processing device is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
  • the data processing device is arranged to provide the examination data, for example related to the respiratory rate, after correction using the correction signal.
  • the invention makes it possible to take into account the noise related to the movements of the person and/or to his voice, to provide reliable and precise examination data.
  • Another object of the invention is a method for providing assistance with diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this method comprising the following steps:
  • this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
  • the invention has the advantage of being able to cross-reference data in order to obtain a more reliable and/or more robust result.
  • the invention makes it possible to evaluate this disturbance thanks to a microphone or a camera that allows lip reading or even by means of a 4D camera or an inertial balance.
  • the method according to the invention includes the step of taking into account the weight of the evaluations of the parameters acquired to obtain the result.
  • the invention recommends giving more weight to the least disturbed parameters.
  • the method in the case of the evaluation of the heart rate by means of a radar, this evaluation being disturbed by the voice of the person or the movement of the person, the method presents the stage of evaluating this disturbance using a microphone or a camera that allows lip reading or even using a 4D camera or an inertial balance, to correct the examination data.
  • Another subject of the invention is an aid system for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
  • this acquisition device comprising at least two sensors for measuring the same physiological measurement, such as a radar and a thermal camera for acquiring this examination data, these sensors being in particular arranged to operate without contact with the person,
  • a data processing device (3) arranged to receive these data obtained by the sensors of the acquisition device, this processing device being further arranged to carry out a fusion of data coming from at least of the two sensors of the acquisition device, in particular with a view to increasing the robustness of the examination data acquired on the person,
  • a display device arranged to display disease diagnostic information based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person has the disease, this level of probability being able in particular to be a score.
  • the two sensors are arranged at different locations.
  • the two sensors can be arranged in the same box or in two different boxes.
  • the two sensors are arranged to pick up signals of different natures, for example signals of different wavelengths.
  • the two sensors comprising a radar and a thermal image camera are arranged to measure the respiratory rate or the heart rate of a person.
  • to measure respiratory rate may refer to measurements of respiratory characteristics such as rate, amplitude, time of inspiration, expiration, apnea ...
  • the invention makes it possible, thanks to the fusion of measurement data coming from two different sensors or more sensors, to have a more robust result on the diagnostic aid information.
  • one or more sensors are provided arranged to evaluate the noise of a signal and to attenuate this noise, in particular in addition to the evaluation of a level of reliability.
  • the processing unit is arranged to assign, for at least one of the sensors, a level of reliability, for example which can be 0 or 1, in one or more measurement windows, this reliability level and this window being used to perform the data fusion.
  • the acquisition device comprises one or more complementary sensors arranged to determine the level of reliability of the two physiological measurement sensors.
  • the sensors are a radar and an infrared camera which make it possible to assess the breathing rate of the person
  • additional sensors such as a microphone or a device for measuring the movements of the person's body makes it possible to evaluate the reliability of the measurement made by the camera or the radar. In fact, when the person is moving or talking, the measurement made by the radar is either impossible or of poor quality.
  • this correction sensor comprises a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
  • the infrared camera can be associated with an RGB camera to check whether the measurements by the infrared camera are possible or, when the person is moving or presents the head turned, for example, to conclude that the measurements by the infrared camera are impossible.
  • the processing unit is arranged to retain the measurement(s) of one or both sensors according to the reliability conditions of the measurement of the sensor(s).
  • the processing unit does not use the measurements made by the sensor, the reliability of which is not recognized as sufficient.
  • the processing unit does not use the measurements made by the sensor formed by a radar when the person is moving or turning his head. In this situation, the processing unit uses the other sensor which is an infrared imaging camera.
  • the processing unit is arranged to reconstitute a diagnostic information value on the basis of measurements obtained by the sensors and retained according to their quality and the reliability .
  • the curve of the signal representative of the diagnostic information can be formed by a signal measured by one of the sensors on a first time window and by a signal obtained by the other of the sensors over a second time window.
  • the processing unit comprises an artificial intelligence arranged to carry out the data fusion.
  • artificial intelligence is designed to assign a level of reliability to measurements made by the sensor(s).
  • the vital signals are evaluated by the artificial intelligence, and the uncertainty on the measurement evaluated by the artificial intelligence can be integrated statistically during the fusion of the data. .
  • artificial intelligence is designed to accept or reject a measurement made by one or other of the sensors depending on the reliability of this measurement.
  • Another subject of the invention is an aid method for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, this detection system including:
  • this acquisition device comprising at least two sensors for measuring the same physiological measurement such as a radar and a thermal camera for acquiring this examination data, these sensors being in particular arranged to operate without contact with the person,
  • this processing device being further arranged to carry out a fusion of data coming from at least the two sensors of the acquisition device, in particular with a view to increasing the robustness of the data examination acquired on the person
  • Figure 1 schematically illustrates a system according to a non-limiting embodiment of the invention.
  • Figure 2 shows a block diagram illustrating the steps implemented in the system of Figure 1,
  • Figure 3 illustrates a block diagram illustrating the steps implemented in a system according to another example of implementation of the invention
  • Figure 5 shows curves illustrating the effect of merging data obtained using the invention.
  • FIG. 1 and 2 There is shown in Figures 1 and 2 an aid system 1 for providing diagnostic information, in particular with a view to detecting a disease in a person, in particular a contagious disease such as COVID 19, according to the invention.
  • This system 1 includes:
  • a display device 30 arranged to display diagnostic information of the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease.
  • This system 1 includes in particular:
  • this sensor being a camera operating in the near infrared
  • a respiratory activity sensor in particular in frequency and/or respiratory amplitude, of at least one passenger, this sensor being a camera operating in the far infrared, or thermal camera,
  • a radar arranged to measure the person's vital signs, - a sensor of the passenger's profile characteristics, in particular his gender, weight, height and age, this sensor being here a Red Green Blue camera, also called RGB camera in English,
  • - a card reader to read a person's identity card and obtain the person's personal data.
  • sensors and cameras which are part of the acquisition device 7, are represented by the reference 2 in Figure 1.
  • Some sensors 2 are for example arranged on a ceiling of the vehicle.
  • One of the other cameras 2 is arranged in a side upright 6 of the vehicle V.
  • the heart rate and respiration sensor may be in the seat back or in the center console at the level of the passenger's thigh, this being non-limiting.
  • the data processing device 3 includes an artificial intelligence unit arranged to process the examination data obtained by the acquisition device 7 and provide said diagnostic information.
  • the data processing device 3 and the display device 30 are part of the same device, for example a computer, in particular a laptop computer.
  • the display device 30 is a screen of the laptop computer and the data processing device includes this computer's microprocessor.
  • the display device 30 is arranged to be visible to the person examined, and in particular the display device, which notably comprises a screen, is remote from the data processing device, these display and processing devices data being for example interconnected by a wireless link, for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
  • a wireless link for example by a 3G, 4G or 5G communication protocol, or by the Internet network, or Wifi for example.
  • the display device 30, and also the data processing device 3, are here arranged to be carried on a motor vehicle.
  • the display device 30, and optionally also the data processing device 3, are arranged to be placed in a fixed manner, in a building or an outdoor courtyard for example.
  • the processing device 3 is arranged to make the diagnosis automatically, without human intervention.
  • the examination data acquisition device 7 is arranged to allow non-contact and safety distance measurements of vital signals and thermal and visible imaging on the person to be examined.
  • the system according to the invention thus advantageously uses the fusion of measurements without contact and at a safe distance, vital signals and thermal and visible imaging.
  • the artificial intelligence unit is arranged to use a diagnostic model based on artificial intelligence and fed by a reasonable number of clinical measures.
  • the invention allows diagnostics to be carried out in a mobile manner. Its implementation, for example using a thermal camera, a physiological measurement sensor such as a radar and a portable personal computer, is easy.
  • the acquisition device 7 comprises a radar to acquire data relating to the vital signs of the person, a thermal camera for temperature measurements providing temperature data, and a camera operating in the visible spectrum for the characterization of the person being tested providing data characterizing the person.
  • the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of vital data, in particular a breathing rhythm, a breathing amplitude, an inspiration and expiration time, a rhythm and cardiac arrhythmia, oximetry.
  • the algorithm uses temperatures measured on remarkable areas, localized by image processing. [147] Preferably, these remarkable temperature measurement zones are located inside the mouth, on the tip of the nose, on the cheekbones and the palm of the hand.
  • the diagnostic algorithm uses a characterization of the person, such as data on age, gender, dress, height, body mass index.
  • the system is designed to carry out the acquisition of examination data until the provision of diagnostic information in a period of time comprised in particular between 30 and 120 seconds.
  • the invention thus allows rapid diagnosis without additional delay in getting to a doctor, for example.
  • the diagnostic information can, if necessary, be sent automatically to a doctor and can be kept on a data storage system 40 of Cloud type.
  • the data processing device 3 uses an algorithm for analyzing the acquired examination data and, if necessary, sorting people with the aim of detecting cases of sick people, based on the set collected data and an artificial intelligence whose first level of learning is carried out on a sample in a hospital environment.
  • the measurements made by the acquisition device can be used to later refine the diagnosis made by the artificial intelligence.
  • the measured examination data includes at least one of the following data: temperatures measured at different points of the body of the person to be examined, a respiratory or cardiac characteristic.
  • the acquisition device 7 is arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the nose of the person, and also if applicable, a maximum face temperature and a reference temperature-controlled garment or surface temperature.
  • the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera) or Far Infrared (FIR camera) in addition to a reading of the person's identity, thanks to a classification system whose learning can be performed on RGB (Red Green Blue) or Infrared images.
  • RGB Red Green Blue
  • FIR camera Far Infrared
  • the diagnostic model, or diagnostic algorithm which is fed with more data such as remarkable body temperatures, ambient temperature, class of personal characteristics, time of day, can be arranged to additionally use journey data of the person examined to check whether they have crossed paths with a sick person or passed through a region at risk.
  • the temperature relative to a remarkable point can be obtained by temporal average and by average of the temperatures of a surface defined by pixels resulting from a camera image near the remarkable point.
  • the remarkable point is for example defined geometrically by means of an image area called Building box, which surrounds it. This image area is a surface delimited by a series of points which is constructed by an object identification algorithm.
  • the diagnostic information is comprised of a class chosen from three predetermined classes which are "Healthy person”, “Person with a suspicion of disease”, “Person with a high probability of disease”.
  • diagnostic information for the disease based on an analysis of said examination data, this diagnostic information being able to be representative of a level of probability that the person has the disease (step 29).
  • Steps 20 to 25 are as follows:
  • step 20 the identification of personal characterizations is done by means of Red Green Blue cameras (or RGB camera), this is step 20,
  • step 23 acquisition of the heart rate in step 23 using the near infrared camera, or NIR camera,
  • NIR near-infrared
  • Examination data may, where appropriate, include pupil size and position.
  • Diagnostic information is automatically sent to a cloud-based remote data storage system.
  • the acquisition device is in particular arranged to acquire examination data comprising an outside temperature, a temperature measured on a cheekbone of the person, a temperature measured on the tip of the person's nose, and also, where appropriate , a maximum facial temperature and a temperature of a garment or of a reference temperature-controlled surface, and if applicable a respiratory volume, tremors, the level of oxygen in the blood.
  • Figure 3 shows another example of implementation of the invention.
  • the help system 1 includes, like the example described above:
  • this acquisition device comprising in particular at least one physiological measurement sensor such as a radar, and a thermal camera for acquiring this examination data, this device acquisition comprising a plurality of sensors 2 arranged to operate without contact with the person, at least one of the contactless sensors being arranged to acquire response data provided by the person,
  • a data processing device 3 arranged to receive these data obtained by several sensors of the acquisition device
  • a display device 30 arranged to display diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability possibly being in particular a score.
  • One of the contactless sensors 2 arranged to acquire response data provided by the person comprises a microphone arranged to receive responses provided orally by the person.
  • the system 1 is arranged to present a questionnaire, for example by displaying the questions of the questionnaire on a display screen or for example using a sound device which pronounces the questions of the questionnaire, to the person to examine, and the acquisition device is arranged to receive the answers provided by the person to this questionnaire, here the microphone 33 being used to record the person's answers.
  • System 1 comprises a data storage unit, for example part of a computer, arranged to store the questions of questionnaire 34.
  • the data processing device 3 is arranged to receive data from the acquisition device relating to the answers provided by the person in response to the questionnaire, and this data processing device is arranged to process this data in combination with data coming from other sensors of the acquisition device, in order to provide the diagnostic information of the disease.
  • the data processing device 3 is arranged to run a diagnostic algorithm based on a fusion of the person's vital data, in particular a respiratory rate, an amplitude of respiration , inspiration and expiration time, cardiac rhythm and arrhythmia, also with questionnaire response data.
  • the system is set up in such a way as to select the questions to be asked depending on the person to be examined, in particular one or more data available on the person.
  • the questions to be asked are of a medical nature, useful to improve the diagnosis in combination with the other data.
  • the system 1 is arranged to carry out, using one of the sensors 2 without contact, a measurement whose result data are compared with an answer provided by the person in response to a question of the questionnaire.
  • Step 50 corresponds to the beginning of the method for detecting a disease in a person.
  • step 51 the person enters for example data concerning him, for example his identity, then possibly gives his agreement or consent to continue the diagnostic process.
  • This step 51 can be performed by the person via a touch screen 35 coupled to a disinfection device 36 using UV.
  • a microphone 33 can be used to record the person's responses to questions.
  • a voice recognition device 38 is muted at the microphone 33 to input data picked up by the microphone 33 into the data processing unit 3.
  • Context data 37 for example an ambient temperature, can be acquired by a sensor 2.
  • step 52 characteristics related to the person are determined using one or more sensors 2 via an object image recognition system 39, as described in the previous example.
  • the questions are chosen for example from the following list: Do you have chest pain? Do you have a dry cough? Do you have a sore throat? Do you have a runny nose? Do you have trouble breathing?
  • step 54 the sensors 2 proceed to the acquisition of data relating to the vital signs of the person, as described in the preceding example.
  • step 55 the artificial intelligence provides a preliminary score representative of the diagnosis obtained on the basis of the data entered until then.
  • step 56 additional questions are asked of the person, and the answers obtained are used to refine the preliminary score obtained at step 55.
  • a final score is given in step 57 by the artificial intelligence, which is recorded on the data storage space 40.
  • step 58 the final score is displayed for information to the person.
  • the aid system 1 for providing diagnostic information slightly different from that described above, comprises:
  • this acquisition device comprising at least a first sensor, here a physiological measurement sensor which is a radar for acquiring this examination data,
  • a display device 30 arranged to display diagnostic information for the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability being able in particular to be a score
  • the acquisition device 7 further comprising a correction sensor 33 different from said first sensor, namely the radar, and arranged to acquire at least one datum on the person, this datum being a different correction datum from data acquired by the first sensor,
  • the data processing device being arranged to use this correction data to correct the examination data supplied by the first sensor.
  • This correction sensor 33 is arranged to acquire data representative of a person's voice.
  • This correction sensor 33 arranged to acquire data representative of a person's voice comprises a microphone 33, in particular a directional microphone or a camera.
  • This correction sensor for acquiring data representative of a person's movement comprises a camera, in particular of the 3D type, for acquiring data representative of a person's movement.
  • This camera is in particular a camera operating on the principle of time of flight (in English: Time of Flight, TOF) which makes it possible to measure a scene in real time in 3 dimensions (3D).
  • TOF Time of Flight
  • the radar is arranged in particular to acquire data representative of the person's breathing rate, in particular by detecting the movement of the person's skin.
  • the radar is arranged to be placed in front of the person or behind the person.
  • sensors other than radar can be used, for example a Near Infrared camera.
  • the data processing device 3 is arranged to carry out the correction of the examination data according to the correction data using artificial intelligence.
  • the data processing device 3 is arranged to obtain a correction signal based on the correction data, this correction signal being evolving as a function of time.
  • the data processing device 3 is arranged to provide the examination data, for example related to the respiratory rate, after correction using the correction signal.
  • the invention makes it possible to take into account the noise linked to the movements of the person and/or to his voice, in order to provide reliable and precise examination data.
  • the movements and words of the person are likely to create interference in the acquisition of data, in particular of physiological type such as the respiratory rate.
  • Curve 101 illustrates the magnitude of the error, over time, in a breathing rate measurement on the person, this error being induced by movements of the person during the measurement and by the fact that she speaks during the measurement.
  • the curve 102 shows the magnitude of the error, over time, on a measurement of the breathing rate on the person, when a correction is taken into account taking into account the movements of the person detected by the camera of movements.
  • curve 103 illustrates the amplitude of the error, over time, on a measurement of respiratory rate on the person, when the corrections linked to both the movements and the speech of the person are taken into account. no one.
  • this acquisition device comprising at least a first sensor, in particular a sensor for physiological measurement such a radar or a thermal camera to acquire these examination data, in particular this acquisition device comprising a plurality of sensors arranged to operate without contact with the person, in particular at least one of the contactless sensors being arranged to acquire response data provided by the person,
  • system 1 may comprise
  • this acquisition device 7 for acquiring examination data on the person, this acquisition device comprising at least two sensors for measuring the same physiological measurement such as a radar and a thermal camera for acquiring this examination data, these sensors being in particular arranged to operate without contact with the person, these sensors being already described above,
  • the data processing device 3 arranged to receive these data obtained by the sensors of the acquisition device, this processing device being further arranged to perform a fusion of data coming from at least the two sensors of the acquisition device in particular by with a view to increasing the robustness of the examination data acquired on the person,
  • the display device 30 arranged to display diagnostic information of the disease based on an analysis of said data by the data processing device, this diagnostic information possibly being representative of a level of probability that the person is affected of the disease, this level of probability possibly being in particular a score.
  • the two sensors are placed at different locations.
  • the two sensors comprising a radar and a thermal image camera are arranged to measure a person's breathing rate.
  • the processing unit 3 is arranged to assign, for at least one of the sensors, a level of reliability F, for example which can be 0 or 1, in several measurement windows T1, T2, T3 t T4 by example, this reliability level and these windows being used to perform the data fusion.
  • a level of reliability F for example which can be 0 or 1
  • T1, T2, T3 t T4 by example, this reliability level and these windows being used to perform the data fusion.
  • the acquisition device 7 comprises one or more complementary sensors arranged to determine the level of reliability of the two physiological measurement sensors.
  • the sensors are a radar and an infrared camera which make it possible to assess the breathing rate of the person
  • additional sensors such as a microphone or a device for measuring the movements of the person's body makes it possible to evaluate the reliability of the measurement made by the camera or the radar. In fact, when the person is moving or talking, the measurement made by the radar is either impossible or of poor quality.
  • This correction sensor includes a camera, in particular of the 3D type, to acquire data representative of a movement of the person.
  • the infrared camera can be associated with an RGB camera to check whether the measurements by the infrared camera are possible or, when the person is moving or has his head turned, for example, to conclude that the measurements by the infrared camera are impossible.
  • the processing unit 3 is arranged to retain the measurement(s) of one or both sensors depending on the reliability conditions of the measurement of the sensor(s).
  • the processing unit does not use the measurements made by the sensor, the reliability of which is not recognized as sufficient.
  • the processing unit does not use the measurements made by the sensor formed by a radar when the person is moving or turning his head.
  • the processing unit uses the other sensor which is an infrared imaging camera.
  • the processing unit 3 is arranged to reconstitute a diagnostic information value on the basis of measurements obtained by the sensors and retained according to their quality and reliability.
  • the curve of the signal representative of the diagnostic information can be formed by a signal measured by one of the sensors over a first time window T1 and by a signal obtained by the other of the sensors over a second time window T3, as in the example in Figure 5.
  • the measurements taken by the two sensors are of comparable satisfactory reliability and are merged.
  • the curve 110 represents the theoretical value of the information, for example the respiratory rate, which it is desired to obtain.
  • Curve 111 represents a signal measured by the camera which is one of the sensors used to measure the breathing rate on the person.
  • Curve 112 represents a signal measured by the radar which is the other of the sensors used to measure the breathing rate on the person.
  • Curve 113 represents the fusion of the data represented by curves 111 and 112.
  • the processing unit 3 includes an artificial intelligence designed to perform the data fusion.
  • artificial intelligence is designed to assign a level of reliability to measurements made by the sensor(s).
  • the artificial intelligence is set up to accept or reject a measurement made by one or other of the sensors depending on the reliability of this measurement.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Psychiatry (AREA)
  • Artificial Intelligence (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Physiology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
EP22744446.0A 2021-07-21 2022-07-05 Hilfssystem zur bereitstellung von diagnoseinformationen Pending EP4373383A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR2107859A FR3125405A1 (fr) 2021-07-21 2021-07-21 Système d’aide pour fournir une information de diagnostic
PCT/EP2022/068637 WO2023001549A1 (fr) 2021-07-21 2022-07-05 Système d'aide pour fournir une information de diagnostic

Publications (1)

Publication Number Publication Date
EP4373383A1 true EP4373383A1 (de) 2024-05-29

Family

ID=78820774

Family Applications (1)

Application Number Title Priority Date Filing Date
EP22744446.0A Pending EP4373383A1 (de) 2021-07-21 2022-07-05 Hilfssystem zur bereitstellung von diagnoseinformationen

Country Status (4)

Country Link
EP (1) EP4373383A1 (de)
CN (1) CN118055727A (de)
FR (1) FR3125405A1 (de)
WO (1) WO2023001549A1 (de)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140276090A1 (en) * 2011-03-14 2014-09-18 American Vehcular Sciences Llc Driver health and fatigue monitoring system and method using optics
US10426393B2 (en) * 2017-09-22 2019-10-01 Aurora Flight Sciences Corporation Systems and methods for monitoring pilot health
EP3820363A4 (de) * 2018-07-09 2021-08-04 Neteera Technologies Ltd. Sub-thz und thz-system für die detektion physiologischer parameter und verfahren dafür

Also Published As

Publication number Publication date
CN118055727A (zh) 2024-05-17
FR3125405A1 (fr) 2023-01-27
WO2023001549A1 (fr) 2023-01-26

Similar Documents

Publication Publication Date Title
US20150087926A1 (en) System and Method for Facilitating Remote Medical Diagnosis and Consultation
Kuru et al. Biomedical visual data analysis to build an intelligent diagnostic decision support system in medical genetics
JP6863563B2 (ja) ストレス評価システム
CN111307290A (zh) 应用虹膜识别的非接触式身份识别与体温监测的方法与装置
US20220270344A1 (en) Multimodal diagnosis system, method and apparatus
CN108882853A (zh) 使用视觉情境来及时触发测量生理参数
WO2021228690A1 (fr) Système de détection d'une maladie
EP4351406A1 (de) Hilfssystem zur bereitstellung von diagnoseinformationen
US20200175255A1 (en) Device for determining features of a person
KR102366251B1 (ko) 챗봇 문진을 이용한 신체 검진 방법 및 시스템
EP4373383A1 (de) Hilfssystem zur bereitstellung von diagnoseinformationen
McGinnis et al. Validation of smartphone based heart rate tracking for remote treatment of panic attacks
EP4333695A1 (de) Hilfssystem zur bereitstellung von diagnoseinformationen
US20220189639A1 (en) Healthcare device, system, and method
US11523742B2 (en) System, method, and apparatus for temperature asymmetry measurement of body parts
RU188260U1 (ru) Система на основе термоэлектрических приемников инфракрасного излучения и физиологических датчиков для определения достоверности ответов человека
US12039764B2 (en) Multimodal diagnosis system, method and apparatus
WO2022096309A1 (fr) Système de détection d'une maladie
US20240242790A1 (en) System for assisting with provision of diagnostic information
KUSHWAH et al. DATA STUDY OF SAFE ENTRY STATION (SES) TO ENSURE FIT FOR DUTY
KR102247712B1 (ko) 빅데이터를 이용한 피부 진단 방법 및 피부 진단 장치
KR102248251B1 (ko) 체열정보를 이용한 의료진단 보조장치
US11475564B2 (en) Non-invasive non-contact system and method for measuring health parameters
Singh et al. A Systematic Survey of Technology Driven Diagnosis for ASD
Naskar et al. An Efficient, Cost-effective and Reliable Non-invasive Anaemia Detection Method by Analysing Palm Pallor

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20240201

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR