WO2021159682A1 - 一种异常对象管理方法、系统、机器可读介质及设备 - Google Patents
一种异常对象管理方法、系统、机器可读介质及设备 Download PDFInfo
- Publication number
- WO2021159682A1 WO2021159682A1 PCT/CN2020/110454 CN2020110454W WO2021159682A1 WO 2021159682 A1 WO2021159682 A1 WO 2021159682A1 CN 2020110454 W CN2020110454 W CN 2020110454W WO 2021159682 A1 WO2021159682 A1 WO 2021159682A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detection
- area
- temperature
- target
- abnormal
- Prior art date
Links
- 230000002159 abnormal effect Effects 0.000 title claims abstract description 110
- 238000007726 management method Methods 0.000 title claims abstract description 42
- 238000001514 detection method Methods 0.000 claims abstract description 357
- 238000000034 method Methods 0.000 claims abstract description 38
- 230000006399 behavior Effects 0.000 claims description 36
- 230000000391 smoking effect Effects 0.000 claims description 31
- 150000007523 nucleic acids Chemical class 0.000 claims description 29
- 102000039446 nucleic acids Human genes 0.000 claims description 29
- 108020004707 nucleic acids Proteins 0.000 claims description 29
- 239000008280 blood Substances 0.000 claims description 20
- 210000004369 blood Anatomy 0.000 claims description 20
- 238000005516 engineering process Methods 0.000 claims description 17
- 230000005856 abnormality Effects 0.000 claims description 3
- 206010011409 Cross infection Diseases 0.000 abstract description 6
- 206010029803 Nosocomial infection Diseases 0.000 abstract description 6
- 230000009471 action Effects 0.000 abstract description 6
- 238000012545 processing Methods 0.000 description 16
- 238000009529 body temperature measurement Methods 0.000 description 14
- 238000004891 communication Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 9
- 230000036760 body temperature Effects 0.000 description 8
- 238000005259 measurement Methods 0.000 description 7
- 206010037660 Pyrexia Diseases 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 208000035473 Communicable disease Diseases 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 210000000887 face Anatomy 0.000 description 4
- 208000015181 infectious disease Diseases 0.000 description 4
- 230000037323 metabolic rate Effects 0.000 description 4
- 239000000523 sample Substances 0.000 description 4
- 238000012360 testing method Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 235000019504 cigarettes Nutrition 0.000 description 2
- 238000010924 continuous production Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 210000001061 forehead Anatomy 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 208000024891 symptom Diseases 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 208000031636 Body Temperature Changes Diseases 0.000 description 1
- 208000001490 Dengue Diseases 0.000 description 1
- 206010012310 Dengue fever Diseases 0.000 description 1
- 206010061192 Haemorrhagic fever Diseases 0.000 description 1
- 206010039587 Scarlet Fever Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 208000025729 dengue disease Diseases 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001717 pathogenic effect Effects 0.000 description 1
- 230000001991 pathophysiological effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 238000001931 thermography Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/01—Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/14546—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring analytes not otherwise provided for, e.g. ions, cytochromes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
Definitions
- the invention relates to the field of abnormal situation detection, in particular to an abnormal object management method, system, machine-readable medium and equipment.
- fever is a common manifestation of various infectious diseases. Many infectious diseases are even named after “heat”, such as hemorrhagic fever, dengue fever, and scarlet fever. It can be seen that fever is closely related to infectious diseases. Fever is usually a pathophysiological response of the human body to pathogenic factors. It is generally believed that when the oral temperature is higher than 37.3C or the daily body temperature change exceeds 1.2C, it is called "fever".
- the purpose of the present invention is to provide an abnormal object management method, system, machine-readable medium and equipment to solve the problems existing in the prior art.
- an abnormal object management method including:
- the multiple types of images include: visible light images, infrared images, and laser images.
- the detection indicators include temperature and blood nucleic acid characteristics.
- the image of the detection object includes a visible light image and an infrared image
- the image of the detection object includes a visible light image and a laser image
- the target part includes a face, a back of the hand, a neck, and a shoulder
- the target detection area includes a face area, a back of the hand area, a neck area, and a shoulder area.
- the detection index is temperature
- the temperature of the target detection area of the detection object exceeds a temperature threshold
- the detection object is an abnormal object
- the detection index is a blood nucleic acid feature
- the detection object is an abnormal object.
- the method further includes:
- the method further includes:
- the method further includes:
- the method further includes:
- the temperature of the target detection area is compensated based on the distance between the detection object and the image acquisition device.
- the method further includes:
- the temperature of the target detection area is compensated according to the ambient temperature.
- the method further includes:
- an abnormal object management system including:
- the image acquisition module is used to acquire multiple types of images of the detected object
- a detection area determination module which is used to determine the target detection area of the detection object
- An index detection module which is used to obtain the detection index of the target detection area
- the abnormality judgment module is used for judging whether the detection object is an abnormal object according to the detection index.
- the multiple types of images include: visible light images, infrared images, and laser images.
- the detection indicators include temperature and blood nucleic acid characteristics.
- the image of the detection object includes a visible light image and an infrared image
- the image of the detection object includes a visible light image and a laser image
- the target part includes a face, a back of the hand, a neck, and a shoulder
- the target detection area includes a face area, a back of the hand area, a neck area, and a shoulder area.
- the detection index is temperature
- the temperature of the target detection area of the detection object exceeds a temperature threshold
- the detection object is an abnormal object
- the detection index is a blood nucleic acid feature
- the detection object is an abnormal object.
- system further includes:
- the tracking module is used to track the abnormal object using face recognition technology or human body recognition technology.
- system further includes:
- the alarm module is used to send out an alarm when an abnormal object is detected.
- the system further includes:
- the age attribute acquisition module is used to acquire the age attribute of the detected object
- the temperature threshold setting module is used to set temperature thresholds corresponding to different age groups according to different age attributes.
- system further includes:
- the first temperature compensation module compensates the temperature of the target detection area based on the distance between the detection object and the image acquisition device.
- system further includes:
- the temperature acquisition module is used to acquire the ambient temperature
- the second temperature compensation module is used to compensate the temperature of the target detection area according to the ambient temperature.
- the system further includes:
- a smoking judging module for judging whether the detected object has smoking behavior
- the shielding module is used to shield the smoking area in the presence of smoking behavior.
- the present invention provides a device, including:
- One or more processors are One or more processors.
- the present invention provides one or more machine-readable media on which instructions are stored.
- the device executes one or more of the aforementioned method.
- the abnormal object management method, system, machine-readable medium, and equipment provided by the present invention have the following beneficial effects:
- the present invention obtains multiple types of images of the detection object; determines the target detection area of the detection object; obtains the detection index of the target detection area; and judges whether the detection object is an abnormal object according to the detection index.
- the invention adopts non-contact type to detect the detection index, and the detected person can complete the detection without stopping, standing or making any actions. At the same time, the staff stay away from the tested population, effectively avoiding cross-infection.
- FIG. 1 is a flowchart of an abnormal object management method provided by an embodiment of the present invention
- FIG. 2 is a flowchart of an abnormal object management method provided by another embodiment of the present invention.
- FIG. 3 is a flowchart of an abnormal object management method provided by another embodiment of the present invention.
- FIG. 4 is a schematic diagram of the hardware structure of an abnormal object management system provided by an embodiment of the present invention.
- FIG. 5 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the present invention.
- FIG. 6 is a schematic diagram of the hardware structure of a terminal device provided by another embodiment of the present invention.
- an abnormal object management method includes:
- S11 obtains multiple types of images of the detected object
- S14 Determine whether the detection object is an abnormal object according to the detection index.
- the present invention obtains multiple types of images of the detection object; determines the target detection area of the detection object; obtains the detection index of the target detection area; and judges whether the detection object is an abnormal object according to the detection index.
- the invention adopts non-contact type to detect the detection index, and the detected person can complete the detection without stopping, standing or making any actions. At the same time, the staff stay away from the tested population, effectively avoiding cross-infection.
- the multiple types of images may include: visible light images, infrared images, and laser images.
- the visible light image can be collected by the visible light image acquisition sensor
- the infrared image can be collected by the infrared image acquisition sensor.
- the image can also be collected by the RGB-IR image sensor (which can receive both the RGB component and the IR component).
- the IR processing unit separates the received RGB-IR image data to obtain synchronized RGB images (visible light images) and IR images (infrared images);
- the laser image can be acquired by the laser image acquisition sensor acquisition module.
- At least two of the images can be collected by one device, for example, an infrared temperature measuring probe that can collect visible light images and infrared images at the same time, or can collect laser images and infrared images at the same time.
- an infrared temperature measuring probe that can collect visible light images and infrared images at the same time, or can collect laser images and infrared images at the same time.
- a laser temperature measuring probe that collects images or other image collection devices with the same function; or an image collection device that can collect visible light images, infrared images, and laser images at the same time.
- the detection indicators of the target detection area include: temperature and blood nucleic acid characteristics.
- the detection index is temperature
- the detection object is an abnormal object.
- an alarm is issued.
- the user can set alarm parameters, such as preset temperature thresholds, alarm sensitivity, and so on. For example, when the temperature of the target detection area exceeds 37.3 degrees, an alarm is issued.
- alarm parameters such as preset temperature thresholds, alarm sensitivity, and so on.
- the temperature of the target detection area exceeds 37.3 degrees
- an alarm is issued.
- ways to alarm such as sound and light indication alarm, or voice alarm.
- the alarm level can be set. Different colors can be used to display different alarm levels, and different alarm levels send different alarm signals. For example, if the alarm level is low, only audible and visual alarms can be issued. If the alarm level is very high, verbal alarms can be issued. If the alarm level is high, audible and visual alarms and voice alarms can be issued at the same time.
- the detection index is a blood nucleic acid feature
- the detection object is an abnormal object.
- an abnormal nucleic acid feature library needs to be set up in advance, in which there are several nucleic acid features, which can reflect the abnormal state of the human body, and the corresponding abnormal symptoms can be determined through these nucleic acid features.
- the preset conditions are met, it can be considered that the blood nucleic acid feature of the test object is one of the abnormal nucleic acid feature libraries.
- an alarm is issued. For the reminder of issuing an alarm, refer to the foregoing embodiment, which will not be repeated here.
- the target detection area of the detection object can be determined based on multiple types of images, and then it is determined whether the detection object is an abnormal object according to the detection index of the target detection area. Take visible light images and infrared images as examples. As shown in Figure 2, the specific process includes:
- S21 Perform target part detection on the visible light image to obtain the target part position; determine the target detection area of the target part position in the infrared image of the detection object;
- S23 judges whether the detection object is an abnormal object according to the detection index of the target detection area.
- the target part includes the face, the back of the hand, the neck, and the shoulder
- the target detection area includes the face area, the back of the hand area, the neck area, and the shoulder area.
- the target part is the face
- the target detection area is the face area
- the detection index is the temperature
- infrared detection is a continuous process, multiple infrared images will be obtained continuously for a period of time. Therefore, when detecting the temperature of the face area, it is necessary to obtain the image at the same time, that is, the infrared image at the current time and the visible light image at the current time.
- the process of determining the face area first perform face detection on the visible light image at the current moment to obtain the position of the face, and then map the face position in the visible light image at the current moment to the infrared image of the detection object at the current moment , Get the face area of the detected object in the infrared image at the current moment.
- the temperature of the face area in the infrared image at the current moment can be measured to obtain the temperature of the face area.
- the image of the face area is an infrared image, and the corresponding relationship between color and temperature can be obtained in advance. According to the corresponding relationship between color and temperature, the temperature corresponding to the color in the face area can be determined. The temperature of the face area.
- This embodiment adopts a face detection technology, which can detect multiple faces in a video frame at the same time to obtain face data of a detection object. Furthermore, the best face can be obtained through the face data, and the face area at the best face temperature can be used as the temperature measurement object when the face temperature is measured.
- the best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.
- the target detection area of the detection object can be determined based on multiple types of images, and then it is determined whether the detection object is an abnormal object according to the detection index of the target detection area. Take the visible light image and the laser image as examples. As shown in Figure 3, the specific process includes:
- S31 Perform target part detection on the visible light image to obtain the target part position; determine the target detection area of the target part position in the laser image of the detection object;
- S33 judges whether the detection object is an abnormal object according to the detection index of the target detection area.
- the target part includes the face, the back of the hand, the neck, and the shoulder
- the target detection area includes the face area, the back of the hand area, the neck area, and the shoulder area.
- the target part is the face
- the target detection area is the face area
- the detection index is the temperature
- the temperature of the face area in the laser image at the current moment can be measured to obtain the temperature of the face area.
- This embodiment adopts a face detection technology, which can detect multiple faces in a video frame at the same time to obtain face data of a detection object. Furthermore, the best face can be obtained through the face data, and the face area at the best face temperature can be used as the temperature measurement object when the face temperature is measured.
- the best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.
- this method also includes:
- the corresponding temperature threshold for children can be set a little higher; for the elderly, the metabolic rate is lower, and the temperature can be slightly lower than that of young adults. Therefore, the corresponding threshold for the elderly can be set a little lower .
- face recognition technology or human body recognition technology may also be used to track the abnormal object.
- the detection index is used to detect the abnormal object, and after the abnormal object is judged, the abnormal object is tracked through the recognized face or human body characteristics.
- the detection object After capturing the face or human body of the detection object, it is compared with the face or human body in the abnormal object library, and if the comparison is successful, the detection object is tracked.
- the method further includes:
- the burning cigarette butts belong to an external heat source, which will interfere with the detection of the temperature of the face area. Therefore, if the detected object has smoking behavior, the smoking area will be shielded.
- the behavior identifier is a preset smoking behavior identifier, it is determined that the behavior of the detection object belongs to a smoking behavior.
- the temperature of the target detection area is related to the distance between the image acquisition device that acquires the image and the target detection area. Therefore, in one embodiment, the method further includes: The distance compensates for the temperature of the target detection area. The accuracy of the measurement is improved by compensating the temperature of the target detection area.
- the ambient temperature is acquired, and the temperature of the target detection area is compensated according to the ambient temperature. More specifically, in the case of low ambient temperature, the detected temperature value will be lower than the real body temperature. At this time, the infrared sensor measurement value should be appropriately increased according to the ambient temperature; in the case of high ambient temperature, the detected temperature value may be If the temperature is higher than the real body temperature, the infrared sensor measurement value should be appropriately lowered according to the ambient temperature.
- the invention uses infrared images, visible light images, and laser images, combined with artificial intelligence algorithms, to automatically track, measure, and warn heat-producing persons, achieving quick customs clearance for normal persons without feeling, and timely warning of heat-generating persons, reducing the risk of infection by inspectors.
- an abnormal object management system includes:
- the image acquisition module 41 is used to acquire multiple types of images of the detection object
- the detection area determining module 42 is configured to determine the target detection area of the detection object
- the index detection module 43 is configured to obtain the detection index of the target detection area
- the abnormality judgment module 44 is used for judging whether the detection object is an abnormal object according to the detection index.
- the present invention obtains multiple types of images of the detection object; determines the target detection area of the detection object; obtains the detection index of the target detection area; and judges whether the detection object is an abnormal object according to the detection index.
- the invention adopts non-contact type to detect the detection index, and the detected person can complete the detection without stopping, standing or making any actions. At the same time, the staff stay away from the tested population, effectively avoiding cross-infection.
- the multiple types of images may include: visible light images, infrared images, and laser images.
- the visible light image can be acquired by a visible light camera
- the infrared image can be acquired by an infrared image acquisition sensor
- the laser image can be acquired by a laser image acquisition module.
- at least two of the images can be collected by one device, for example, an infrared temperature measuring probe that can collect visible light images and infrared images at the same time, or can collect laser images and infrared images at the same time.
- Laser temperature measurement probe for image acquisition or other image acquisition equipment with the same function can also be collected by RGB-IR image sensor (which can receive both RGB component and IR component at the same time), and then the image will be received by the RGB-IR processing unit
- the received RGB-IR image data is separated to obtain synchronized RGB images (visible light images) and IR images (infrared images); image acquisition equipment that can also collect visible light images, infrared images, and laser images at the same time.
- the detection indicators of the target detection area include: temperature and blood nucleic acid characteristics.
- the detection index is temperature
- the temperature of the target detection area of the detection object exceeds the temperature threshold
- the detection object is an abnormal object.
- the user can set alarm parameters, such as preset temperature thresholds, alarm sensitivity, and so on. For example, when the temperature of the target detection area exceeds 37.3 degrees, an alarm is issued.
- alarm parameters such as preset temperature thresholds, alarm sensitivity, and so on.
- the temperature of the target detection area exceeds 37.3 degrees
- an alarm is issued.
- ways to alarm such as sound and light indication alarm, or voice alarm.
- display in eye-catching colors on the screen showing the infrared image and set the alarm level. Different colors can be used to display different alarm levels, and different alarm levels send different alarm signals. For example, if the alarm level is low, only audible and visual alarms can be issued. If the alarm level is very high, verbal alarms can be issued. If the alarm level is high, audible and visual alarms and voice alarms can be issued at the same time.
- the detection index is a blood nucleic acid feature
- the detection object is an abnormal object.
- a library of abnormal nucleic acid signatures needs to be set up in advance, in which there are several nucleic acid signatures, these nucleic acid signatures can reflect the abnormal state of the human body, and the corresponding abnormal symptoms can be determined by these nucleic acid signatures.
- the preset conditions are met, it can be considered that the blood nucleic acid feature of the test object is one of the abnormal nucleic acid feature libraries.
- an alarm is issued. For the reminder of issuing an alarm, refer to the foregoing embodiment, which will not be repeated here.
- the target detection area of the detection object can be determined based on multiple types of images, and then it is determined whether the detection object is an abnormal object according to the detection index of the target detection area. Take visible light images and infrared images as examples.
- the specific process includes:
- the target part includes the face, the back of the hand, the neck, and the shoulder
- the target detection area includes the face area, the back of the hand area, the neck area, and the shoulder area.
- the target part is the face and the target detection area is the face area.
- infrared detection is a continuous process, multiple infrared images will be obtained continuously for a period of time. Therefore, when detecting the temperature of the face area, it is necessary to obtain the image at the same time, that is, the infrared image at the current time and the visible light image at the current time.
- the process of determining the face area first perform face detection on the visible light image at the current moment to obtain the position of the face, and then map the face position in the visible light image at the current moment to the infrared image of the detection object at the current moment , Get the face area of the detected object in the infrared image at the current moment.
- the temperature of the face area in the infrared image at the current moment can be measured to obtain the temperature of the face area.
- the image of the face area is an infrared image, and the corresponding relationship between color and temperature can be obtained in advance. According to the corresponding relationship between color and temperature, the temperature corresponding to the color in the face area can be determined. The temperature of the face area.
- This embodiment adopts a face detection technology, which can detect multiple faces in a video frame at the same time to obtain face data of a detection object. Furthermore, the best face can be obtained through the face data, and the face area at the best face temperature can be used as the temperature measurement object when the face temperature is measured.
- the best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.
- the target detection area of the detection object can be determined based on multiple types of images, and then it is determined whether the detection object is an abnormal object according to the detection index of the target detection area. Take the visible light image and the laser image as examples.
- the specific process includes:
- the target part includes the face, the back of the hand, the neck, and the shoulder
- the target detection area includes the face area, the back of the hand area, the neck area, and the shoulder area.
- the target part is the face and the target detection area is the face area.
- the temperature of the face area in the laser image at the current moment can be measured to obtain the temperature of the face area.
- the image of the face area is a laser image.
- the corresponding relationship between color and temperature can be obtained in advance, and the temperature corresponding to the color in the face area can be determined according to the corresponding relationship between color and temperature.
- the temperature of the face area is a laser image.
- This embodiment adopts a face detection technology, which can detect multiple faces in a video frame at the same time to obtain face data of a detection object. Furthermore, the best face can be obtained through the face data, and the face area at the best face temperature can be used as the temperature measurement object when the face temperature is measured.
- the best face can be comprehensively selected through multiple dimensions such as face quality score, face size, face angle, and face occlusion rate.
- the system also includes:
- the age attribute acquisition module is used to acquire the age attribute of the detected object
- the temperature threshold setting module is used to set temperature thresholds corresponding to different age groups according to different age attributes.
- the corresponding temperature threshold for children can be set a little higher; for the elderly, the metabolic rate is lower, and the temperature can be slightly lower than that of young adults. Therefore, the corresponding threshold for the elderly can be set a little lower .
- system further includes:
- the tracking module is used to track the abnormal object using face recognition technology or human body recognition technology.
- the detection index is used to detect the abnormal object, and after the abnormal object is judged, the abnormal object is tracked through the recognized face or human body characteristics.
- the detected object is tracked.
- the system further includes:
- a smoking judging module for judging whether the detected object has smoking behavior
- the shielding module is used to shield the smoking area in the presence of smoking behavior.
- the burning cigarette butts belong to an external heat source, which will interfere with the detection of the temperature of the face area. Therefore, if the detected object has smoking behavior, the smoking area will be shielded.
- the behavior identifier is a preset smoking behavior identifier, it is determined that the behavior of the detection object belongs to a smoking behavior.
- the system further includes:
- the first temperature compensation module compensates the temperature of the target detection area based on the distance between the detection object and the image acquisition device. The accuracy of the measurement is improved by compensating the temperature of the target detection area.
- the system also includes:
- the temperature acquisition module is used to acquire the ambient temperature
- the second temperature compensation module is used to compensate the temperature of the target detection area according to the ambient temperature.
- the detected temperature value when the ambient temperature is low, the detected temperature value will be lower than the real body temperature. At this time, the infrared sensor measurement value should be appropriately increased according to the ambient temperature; when the ambient temperature is high, the detected temperature The value may be higher than the real body temperature. At this time, the infrared sensor measurement value should be appropriately reduced according to the ambient temperature.
- the invention uses infrared images, visible light images, and laser images, combined with artificial intelligence algorithms, to automatically track, measure, and warn heat-producing persons, achieving quick customs clearance for normal persons without feeling, and timely warning of heat-generating persons, reducing the risk of infection by inspectors.
- the invention adopts non-contact temperature measurement, and the detected person can complete body temperature detection without stopping, standing or making any actions. At the same time, the staff stay away from the tested population, effectively avoiding cross-infection.
- the image response speed is 0.04ms, and the temperature measurement response speed is fast. It can complete 16 target detections within 30 milliseconds, and can measure the temperature of 16 targets at the same time.
- thermometers it has the characteristics of non-contact fast, convenient, intuitive, and safe, which overcomes the traditional
- the clinical thermometers, forehead thermometers, spot thermometers and ear thermometers are only for individual measurement, (such as the use of traditional thermometers to test generally takes 3 minutes/person, ordinary spot thermometers, forehead thermometers, and ear thermometers are for individual human testing , The general detection time takes 4 to 5 seconds/person).
- the temperature measurement range of the invention is: 0°C ⁇ 60°C, the temperature measurement accuracy: 28°C ⁇ 45°C ⁇ 0.3°C, built-in automatic temperature measurement correction.
- Face quarantine and body temperature screening early warning avoids the deficiencies of time-consuming and easy cross-infection, and can effectively control the spread of the epidemic and reduce casualties. It is very suitable for heavy traffic in airports, docks, stations, banks, hospitals and shopping malls. Perform a quick temperature check on large occasions.
- the invention can carry out long-distance, large-area detection
- Visible light resolution 1920*1080, focal length 5mm;
- the embodiment of the present application also provides a device, which may include: one or more processors; and one or more machine-readable media on which instructions are stored, when executed by the one or more processors At this time, the device is caused to execute the method described in FIG. 1.
- the device can be used as a terminal device or a server.
- terminal devices include: smart phones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio) Layer III) Players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptops, car computers, desktop computers, set-top boxes, smart TVs, wearable devices, etc.
- the embodiments of the present application do not impose restrictions on specific devices.
- the embodiment of the present application also provides a non-volatile readable storage medium.
- the storage medium stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute Instructions for the steps included in the method in FIG. 1 of the embodiment of the present application.
- FIG. 5 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the application.
- the terminal device may include: an input device 1100, a first processor 1101, an output device 1102, a first memory 1103, and at least one communication bus 1104.
- the communication bus 1104 is used to implement communication connections between components.
- the first memory 1103 may include a high-speed RAM memory, or may also include a non-volatile storage NVM, such as at least one disk memory.
- the first memory 1103 may store various programs for completing various processing functions and implementing this embodiment. Method steps.
- the foregoing first processor 1101 may be, for example, a central processing unit (Central Processing Unit, CPU for short), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), and A programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components are implemented, and the first processor 1101 is coupled to the aforementioned input device 1100 and via a wired or wireless connection.
- the aforementioned input device 1100 may include multiple input devices, for example, it may include at least one of a user-oriented user interface, a device-oriented device interface, a software programmable interface, a camera, and a sensor.
- the device-oriented device interface may be a wired interface for data transmission between the device and the device, or a hardware plug-in interface for data transmission between the device and the device (such as a USB interface, a serial port, etc.) );
- the user-oriented user interface may be, for example, user-oriented control buttons, a voice input device for receiving voice input, and a touch sensing device for receiving user touch input (such as a touch screen with touch sensing function, touch Control board, etc.);
- the programmable interface of the above software may be, for example, an entry for the user to edit or modify the program, such as the input pin interface or input interface of the chip, etc.;
- the output device 1102 may include output devices such as a display and audio .
- the processor of the terminal device includes functions for executing each module in each device.
- functions for executing each module in each device please refer to the above-mentioned embodiment, which will not be repeated here.
- FIG. 6 is a schematic diagram of the hardware structure of a terminal device provided by an embodiment of the application.
- Fig. 6 is a specific embodiment of Fig. 5 in the implementation process.
- the terminal device of this embodiment may include a second processor 1201 and a second memory 1202.
- the second processor 1201 executes the computer program code stored in the second memory 1202 to implement the method described in FIG. 1 in the foregoing embodiment.
- the second memory 1202 is configured to store various types of data to support operations on the terminal device. Examples of these data include instructions for any application or method operating on the terminal device, such as messages, pictures, videos, and so on.
- the second memory 1202 may include a random access memory (random access memory, RAM for short), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
- the second processor 1201 is provided in the processing component 1200.
- the terminal device may also include: a communication component 1203, a power supply component 1204, a multimedia component 1205, a voice component 1206, an input/output interface 1207 and/or a sensor component 1208.
- the specific components included in the terminal device are set according to actual requirements, which is not limited in this embodiment.
- the processing component 1200 generally controls the overall operation of the terminal device.
- the processing component 1200 may include one or more second processors 1201 to execute instructions to complete all or part of the steps in the foregoing data processing method.
- the processing component 1200 may include one or more modules to facilitate the interaction between the processing component 1200 and other components.
- the processing component 1200 may include a multimedia module to facilitate the interaction between the multimedia component 1205 and the processing component 1200.
- the power supply component 1204 provides power for various components of the terminal device.
- the power supply component 1204 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for terminal devices.
- the multimedia component 1205 includes a display screen that provides an output interface between the terminal device and the user.
- the display screen may include a liquid crystal display (LCD) and a touch panel (TP). If the display screen includes a touch panel, the display screen may be implemented as a touch screen to receive input signals from the user.
- the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
- the voice component 1206 is configured to output and/or input voice signals.
- the voice component 1206 includes a microphone (MIC).
- the microphone When the terminal device is in an operating mode, such as a voice recognition mode, the microphone is configured to receive external voice signals.
- the received voice signal may be further stored in the second memory 1202 or transmitted via the communication component 1203.
- the voice component 1206 further includes a speaker for outputting voice signals.
- the input/output interface 1207 provides an interface between the processing component 1200 and a peripheral interface module.
- the peripheral interface module may be a click wheel, a button, or the like. These buttons may include, but are not limited to: volume buttons, start buttons, and lock buttons.
- the sensor component 1208 includes one or more sensors, which are used to provide various aspects of state evaluation for the terminal device.
- the sensor component 1208 can detect the open/close state of the terminal device, the relative positioning of the component, and the presence or absence of contact between the user and the terminal device.
- the sensor component 1208 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact, including detecting the distance between the user and the terminal device.
- the sensor component 1208 may also include a camera and the like.
- the communication component 1203 is configured to facilitate wired or wireless communication between the terminal device and other devices.
- Terminal devices can access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination of them.
- the terminal device may include a SIM card slot for inserting a SIM card so that the terminal device can log in to the GPRS network and establish communication with the server via the Internet.
- the communication component 1203, the voice component 1206, the input/output interface 1207, and the sensor component 1208 involved in the embodiment in FIG. 6 can all be used as implementations of the input device in the embodiment in FIG. 5.
Abstract
Description
Claims (30)
- 一种异常对象管理方法,其特征在于,包括:获取检测对象的多种类型图像;确定所述检测对象的目标检测区域;获取所述目标检测区域的检测指标;根据所述检测指标判断所述检测对象是否为异常对象。
- 根据权利要求1所述的异常对象管理方法,其特征在于,所述多种类型图像包括:可见光图像、红外图像、激光图像。
- 根据权利要求2所述的异常对象管理方法,其特征在于,所述检测指标包括:温度、血液核酸特征。
- 根据权利要求2所述的异常对象管理方法,其特征在于,若所述检测对象的图像包括可见光图像和红外图像;则对所述可见光图像进行目标部位检测,得到目标部位位置;确定所述目标部位位置在检测对象的红外图像中的目标检测区域;获取检测对象的所述目标检测区域的检测指标;根据所述目标检测区域的检测指标判断检测对象是否为异常对象。
- 根据权利要求2所述的异常对象管理方法,其特征在于,若所述检测对象的图像包括可见光图像和激光图像;则对所述可见光图像进行目标部位检测,得到目标部位位置;确定所述目标部位位置在检测对象的激光图像中的目标检测区域;获取检测对象的所述目标检测区域的检测指标;根据所述目标检测区域的检测指标判断检测对象是否为异常对象。
- 根据权利要求4或5所述的异常对象管理方法,其特征在于,所述目标部位包括人脸、手背、脖子、肩头,所述目标检测区域包括人脸区域、手背区域、脖子区域、肩头区域。
- 根据权利要求6所述的异常对象管理方法,其特征在于,若所述检测指标为温度,则当检 测对象的目标检测区域的温度超过温度阈值时,该检测对象为异常对象。
- 根据权利要求6所述的异常对象管理方法,其特征在于,若所述检测指标为血液核酸特征,则当检测对象的目标检测区域的血液核酸特征符合预设条件时,则该检测对象为异常对象。
- 根据权利要求1所述的异常对象管理方法,其特征在于,该方法还包括:采用人脸识别技术或人体识别技术对所述异常对象进行追踪。
- 根据权利要求1所述的异常对象管理方法,其特征在于,该方法还包括:当检测到异常对象时,发出报警提示。
- 根据权利要求7所述的异常对象管理方法,其特征在于,若所述检测指标为温度,则该方法还包括:获取检测对象的年龄属性;根据不同的年龄属性设定与不同年龄段对应的温度阈值。
- 根据权利要求7所述的异常对象管理方法,其特征在于,该方法还包括:基于检测对象与图像采集装置的距离对所述目标检测区域的温度进行补偿。
- 根据权利要求7所述的异常对象管理方法,其特征在于,该方法还包括:获取环境温度;根据所述环境温度对所述目标检测区域的温度进行补偿。
- 根据权利要求7所述的异常对象管理方法,其特征在于,若所述目标检测区域为人脸区域,该方法还包括:判断所述检测对象是否存在抽烟行为;若存在抽烟行为,则对抽烟区域进行屏蔽。
- 一种异常对象管理系统,其特征在于,包括:图像获取模块,用于获取检测对象的多种类型图像;检测区域确定模块,用于确定所述检测对象的目标检测区域;指标检测模块,用于获取所述目标检测区域的检测指标;异常判断模块,用于根据所述检测指标判断所述检测对象是否为异常对象。
- 根据权利要求15所述的异常对象管理系统,其特征在于,所述多种类型图像包括:可见光图像、红外图像、激光图像。
- 根据权利要求16所述的异常对象管理系统,其特征在于,所述检测指标包括:温度、血液核酸特征。
- 根据权利要求16所述的异常对象管理系统,其特征在于,若所述检测对象的图像包括可见光图像和红外图像;则对所述可见光图像进行目标部位检测,得到目标部位位置;确定所述目标部位位置在检测对象的红外图像中的目标检测区域;获取检测对象的所述目标检测区域的检测指标;根据所述目标检测区域的检测指标判断检测对象是否为异常对象。
- 根据权利要求16所述的异常对象管理系统,其特征在于,若所述检测对象的图像包括可见光图像和激光图像;则对所述可见光图像进行目标部位检测,得到目标部位位置;确定所述目标部位位置在检测对象的激光图像中的目标检测区域;获取检测对象的所述目标检测区域的检测指标;根据所述目标检测区域的检测指标判断检测对象是否为异常对象。
- 根据权利要求18或19所述的异常对象管理系统,其特征在于,所述目标部位包括人脸、手背、脖子、肩头,所述目标检测区域包括人脸区域、手背区域、脖子区域、肩头区域。
- 根据权利要求17所述的异常对象管理系统,其特征在于,若所述检测指标为温度,则当检测对象的目标检测区域的温度超过温度阈值时,该检测对象为异常对象。
- 根据权利要求17所述的异常对象管理系统,其特征在于,若所述检测指标为血液核酸特征,则当检测对象的目标检测区域的血液核酸特征符合预设条件时,则该检测对象为异常对象。
- 根据权利要求15所述的异常对象管理系统,其特征在于,该系统还包括:追踪模块,用于采用人脸识别技术或人体识别技术对所述异常对象进行追踪。
- 根据权利要求15所述的异常对象管理系统,其特征在于,该系统还包括:报警模块,用于在检测到异常对象时发出报警提示。
- 根据权利要求21所述的异常对象管理系统,其特征在于,若所述检测指标为温度,则该系统还包括:年龄属性获取模块,用于获取检测对象的年龄属性;温度阈值设定模块,用于根据不同的年龄属性设定与不同年龄段对应的温度阈值。
- 根据权利要求21所述的异常对象管理系统,其特征在于,该系统还包括:第一温度补偿模块,基于检测对象与图像采集装置的距离对所述目标检测区域的温度进行补偿。
- 根据权利要求21所述的异常对象管理系统,其特征在于,若所述目标检测区域为人脸区域,该系统还包括:温度获取模块,用于获取环境温度;第二温度补偿模块,用于根据所述环境温度对所述目标检测区域的温度进行补偿。
- 根据权利要求21所述的异常对象管理系统,其特征在于,该系统还包括:抽烟判断模块,用于判断所述检测对象是否存在抽烟行为;屏蔽模块,用于在存在抽烟行为对抽烟区域进行屏蔽。
- 一种设备,其特征在于,包括:一个或多个处理器;和其上存储有指令的一个或多个机器可读介质,当所述一个或多个处理器执行时,使得所述设备执行如权利要求1-14所述的一个或多个所述的方法。
- 一个或多个机器可读介质,其特征在于,其上存储有指令,当由一个或多个处理器执行时,使得设备执行如权利要求1-14所述的一个或多个所述的方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010089232.4A CN111202504A (zh) | 2020-02-12 | 2020-02-12 | 一种异常对象管理方法、系统、机器可读介质及设备 |
CN202010089232.4 | 2020-02-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021159682A1 true WO2021159682A1 (zh) | 2021-08-19 |
Family
ID=70781028
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/110454 WO2021159682A1 (zh) | 2020-02-12 | 2020-08-21 | 一种异常对象管理方法、系统、机器可读介质及设备 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111202504A (zh) |
WO (1) | WO2021159682A1 (zh) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111202504A (zh) * | 2020-02-12 | 2020-05-29 | 上海云从汇临人工智能科技有限公司 | 一种异常对象管理方法、系统、机器可读介质及设备 |
CN111310692B (zh) * | 2020-02-25 | 2021-04-02 | 云从科技集团股份有限公司 | 一种检测对象管理方法、系统、机器可读介质及设备 |
CN111458037A (zh) * | 2020-06-08 | 2020-07-28 | 深圳市迪米科技有限公司 | 一种体温筛查记录装置及体温筛查处理方法 |
CN111695509A (zh) * | 2020-06-12 | 2020-09-22 | 云从科技集团股份有限公司 | 一种身份验证方法、装置、机器可读介质及设备 |
CN111693147A (zh) * | 2020-06-12 | 2020-09-22 | 北京百度网讯科技有限公司 | 温度补偿的方法、装置、电子设备及计算机可读存储介质 |
CN111738132B (zh) * | 2020-06-17 | 2024-03-05 | 银河水滴科技(北京)有限公司 | 人体温度的测量方法、装置、电子设备及可读存储介质 |
CN113834571A (zh) * | 2020-06-24 | 2021-12-24 | 杭州海康威视数字技术股份有限公司 | 一种目标测温方法、装置及测温系统 |
CN113139413A (zh) * | 2020-08-07 | 2021-07-20 | 西安天和防务技术股份有限公司 | 人员管理方法、装置及电子设备 |
CN113343859A (zh) * | 2021-06-10 | 2021-09-03 | 浙江大华技术股份有限公司 | 吸烟行为检测方法、装置、存储介质及电子装置 |
CN113420629B (zh) * | 2021-06-17 | 2023-04-28 | 浙江大华技术股份有限公司 | 一种图像处理方法、装置、设备及介质 |
CN117373110A (zh) * | 2023-08-30 | 2024-01-09 | 武汉星巡智能科技有限公司 | 可见光-热红外成像的婴幼儿行为识别方法、装置及设备 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102147835A (zh) * | 2010-11-26 | 2011-08-10 | 中华人民共和国深圳出入境检验检疫局 | 用于口岸车道的司机体温自动测量系统及实现方法 |
CN108344525A (zh) * | 2018-02-09 | 2018-07-31 | 英华达(上海)科技有限公司 | 自适应体温监控方法及系统 |
CN110160670A (zh) * | 2019-05-05 | 2019-08-23 | 深圳中集智能科技有限公司 | 人体体温检测装置 |
CN110411570A (zh) * | 2019-06-28 | 2019-11-05 | 武汉高德智感科技有限公司 | 基于人体检测和人体跟踪技术的红外人体温度筛查方法 |
CN111202504A (zh) * | 2020-02-12 | 2020-05-29 | 上海云从汇临人工智能科技有限公司 | 一种异常对象管理方法、系统、机器可读介质及设备 |
CN111325127A (zh) * | 2020-02-12 | 2020-06-23 | 上海云从汇临人工智能科技有限公司 | 一种异常对象判断方法、系统、机器可读介质及设备 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105931254B (zh) * | 2016-05-17 | 2019-03-26 | 北京市检验检疫科学技术研究院 | 一种国境口岸出入境检验检疫低温查验方法及系统 |
-
2020
- 2020-02-12 CN CN202010089232.4A patent/CN111202504A/zh not_active Withdrawn
- 2020-08-21 WO PCT/CN2020/110454 patent/WO2021159682A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102147835A (zh) * | 2010-11-26 | 2011-08-10 | 中华人民共和国深圳出入境检验检疫局 | 用于口岸车道的司机体温自动测量系统及实现方法 |
CN108344525A (zh) * | 2018-02-09 | 2018-07-31 | 英华达(上海)科技有限公司 | 自适应体温监控方法及系统 |
CN110160670A (zh) * | 2019-05-05 | 2019-08-23 | 深圳中集智能科技有限公司 | 人体体温检测装置 |
CN110411570A (zh) * | 2019-06-28 | 2019-11-05 | 武汉高德智感科技有限公司 | 基于人体检测和人体跟踪技术的红外人体温度筛查方法 |
CN111202504A (zh) * | 2020-02-12 | 2020-05-29 | 上海云从汇临人工智能科技有限公司 | 一种异常对象管理方法、系统、机器可读介质及设备 |
CN111325127A (zh) * | 2020-02-12 | 2020-06-23 | 上海云从汇临人工智能科技有限公司 | 一种异常对象判断方法、系统、机器可读介质及设备 |
Also Published As
Publication number | Publication date |
---|---|
CN111202504A (zh) | 2020-05-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021159682A1 (zh) | 一种异常对象管理方法、系统、机器可读介质及设备 | |
WO2021159683A1 (zh) | 一种异常对象判断方法、系统、机器可读介质及设备 | |
CN111310692B (zh) | 一种检测对象管理方法、系统、机器可读介质及设备 | |
US10145980B2 (en) | Wrist-detection algorithm | |
CN103955272B (zh) | 一种终端设备用户姿态检测系统 | |
CN111223225A (zh) | 一套集成测温和人脸识别闸机伴侣的检测通行系统 | |
CN110196103A (zh) | 温度测量方法及相关设备 | |
US20120075463A1 (en) | User interface system and method using thermal imaging | |
US10959646B2 (en) | Image detection method and image detection device for determining position of user | |
CN111297337A (zh) | 一种检测对象判断方法、系统、机器可读介质及设备 | |
WO2021259365A1 (zh) | 一种目标测温方法、装置及测温系统 | |
TWM602631U (zh) | 人臉追蹤測溫系統 | |
CN112806962A (zh) | 基于tof及红外模组的小孩睡眠状态监测方法及装置 | |
Wu et al. | IoT-based wearable health monitoring device and its validation for potential critical and emergency applications | |
WO2022143384A1 (zh) | 智能手环及其控制方法 | |
WO2022007348A1 (zh) | 温度检测方法、装置、介质及电子设备 | |
CN107669282A (zh) | 基于面部识别的测谎仪 | |
CN105310697B (zh) | 测量血氧饱和度的方法及装置 | |
CN104754301A (zh) | 具近端看护功能及云端传送的自动监视系统 | |
CN108652621A (zh) | 一种吞咽实时监测方法及其系统 | |
TWI335181B (en) | Human behavior event detection system, method and device | |
CN204442550U (zh) | 具近端看护功能及云端传送的自动监视设备 | |
Rethnakumar et al. | Smartphone based application for body temperature and heart rate measurements | |
Wahyuni et al. | IoT-Based Pulse Oximetry Design as Early Detection of Covid-19 Symptoms. | |
US11087157B2 (en) | Image detection method and image detection device utilizing dual analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20918328 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20918328 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 28.02.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20918328 Country of ref document: EP Kind code of ref document: A1 |