CN111429652A

CN111429652A - Intelligent vending machine with respiratory disease screening function

Info

Publication number: CN111429652A
Application number: CN202010315488.2A
Authority: CN
Inventors: 王云路; 唐靖宇; 陈鑫汝; 胡孟晗; 翟广涛; 姚楠
Original assignee: East China Normal University
Current assignee: East China Normal University
Priority date: 2020-04-21
Filing date: 2020-04-21
Publication date: 2020-07-17

Abstract

The invention discloses an intelligent vending machine with a respiratory disease screening function, which is characterized in that a three-mode camera connected with an image/information processing module is adopted, and thermal imaging and depth image acquisition are completed during the use of vending by a user; the image/information processing module extracts the body temperature and the respiratory waveform of the user to screen respiratory diseases, and transmits a screening result to the server and the mobile phone of the user. Compared with the prior art, the method and the system have the advantages that the body temperature and the breath are detected and screened during the automatic vending period, the abnormal information is sent to the user and the related management department as soon as possible, the spread of infectious respiratory diseases in public places can be prevented to a certain extent, and the screening of the respiratory infectious diseases of people in the public places is realized while the user purchases commodities is not influenced.

Description

Intelligent vending machine with respiratory disease screening function

Technical Field

The invention relates to the technical field of vending machines, in particular to an intelligent vending machine with a respiratory disease screening function.

Background

A vending machine is a machine that automatically drops a specific article after a user selects and pays for the article. With the development of technology, vending machines are often equipped with a display screen and some sensors, and such vending machines are called smart vending machines. However, the existing smart vending machine often pays attention to the interactivity with the user, and the additional functions are mostly used for recommending commodities for the user. The intelligent vending machines proposed by patent publication numbers CN201710164289, CN201811248723 and CN201611199682 have limited interaction with people, cannot acquire human body information, and have no health monitoring function. An intelligent vending machine, as proposed in patent publication No. CN201610569639, recommends health-beneficial food for consumers by measuring human body temperature, blood sugar, and pulse, but has no health monitoring and disease screening functions. Vending machines are often installed in places with large human traffic, such as schools, stations, and commercial blocks, where infectious diseases, especially large-area spread of infectious respiratory diseases, are likely to occur. When a user uses the vending machine for shopping, the user needs to stand in front of the vending machine for selecting goods, paying and the like, and the time can be just used for screening the health condition, so that the spread of infectious diseases among people is prevented.

In summary, the smart vending machine of the prior art only provides a function of vending goods and does not play a role in screening respiratory diseases in public places. Most respiratory disease patients exhibit hyperthermia or respiratory abnormalities, such as the 2019 novel coronavirus (SARS-CoV-2).

Disclosure of Invention

The invention aims to design an intelligent vending machine with a respiratory disease screening function aiming at the defects of the prior art, a three-mode camera assembly is adopted, the acquired image is subjected to image/information processing module to extract face information and calculate the body temperature and the breathing rate of a user, so that whether the consumer breathes abnormally is judged, the body temperature and the breathing of the consumer are measured in a remote non-contact mode, if the consumer possibly suffers from infectious respiratory diseases, the information is sent to a management department, the user purchases commodities without being influenced, the people are screened for the respiratory infectious diseases in public places, the wide-range spreading of the respiratory infectious diseases can be prevented, the structure is simple, the use is convenient, and the application prospect is wide.

The purpose of the invention is realized as follows: an intelligent vending machine with a respiratory disease screening function comprises a touch screen display, a commodity display shelf, a goods taking device and a controller, and is characterized in that the intelligent vending machine is provided with a three-mode camera assembly and a communication device which are connected with an image/information processing module, and the three-mode camera assembly comprises a visible light camera, a far infrared thermal imaging camera and a depth camera; the touch screen display is respectively connected with the controller and the image/information processing module; the visible light camera extracts the face information of the user from the acquired image through the image/information processing module and outputs the face information to the touch screen display; the touch screen display displays the input face information and prompts a user to purchase goods; the infrared thermal imaging camera and the depth camera perform thermal imaging and depth picture shooting during the use of the vending by the user, and input the collected thermal imaging and chest and abdomen depth picture to the image/information processing module; the image/information processing module extracts forehead temperature and respiration waveform of the user from the input thermal imaging and chest and abdomen depth pictures, judges whether body temperature and respiration are normal or not, screens respiratory diseases and outputs a screening result to the communication device; the communication device transmits commodities selected by the user, face information, body temperature and breathing conditions to the server and the mobile phone of the user; the controller controls goods to fall from the goods display shelf to the goods taking device according to the goods information input by the touch screen display and the received goods money, and intelligent goods selling is completed.

The touch screen display is connected with the controller to form a functional module for commodity purchasing and payment.

The image/information processing module is connected with the far infrared thermal imaging camera and the depth camera to form a functional module for screening the respiratory diseases of the user.

Compared with the prior art, the invention has the advantages that the body temperature and the breath are detected and screened during the automatic vending period, the abnormal information is sent to the user and the related management department as soon as possible, the spread of infectious respiratory diseases in public places can be prevented to a certain extent, the people are screened for the respiratory infectious diseases in the public places while the user purchases commodities are not influenced, the large-range spread of the respiratory infectious diseases can be prevented, the structure is simple, the use is convenient, and the application prospect is wide.

Drawings

FIG. 1 is a schematic structural view of the present invention;

FIG. 2 is a schematic external view of the present invention;

FIG. 3 is a schematic diagram of an embodiment of the present invention;

FIG. 4 is a flow chart of a specific use of the present invention.

Detailed Description

Referring to fig. 1 to 2, the present invention relates to an intelligent vending machine 1 composed of a touch screen display 4, an image/information processing module 6, a goods display shelf 7, a goods taking device 8, a controller 9, a three-mode camera assembly 10 and a communication device 12, wherein the three-mode camera assembly 10 is composed of a visible light camera 2, a far-infrared thermal imaging camera 3 and a depth camera 5; the touch screen display 4 is respectively connected with the controller 9 and the image/information processing module 6; the visible light camera 2 extracts the face information of the user from the acquired image through the image/information processing module 6 and then outputs the face information to the touch screen display 4; the touch screen display 4 displays the face information acquired by the visible light camera 2 and prompts a user to purchase goods; the infrared thermal imaging camera 3 and the depth camera 5 perform thermal imaging and depth picture photographing during the use of the vending by the user and output the acquired thermal imaging and thoracoabdominal depth picture to the image/information processing module 6; the image/information processing module 6 extracts the forehead temperature and the respiratory waveform of the user from the input thermal imaging and the chest and abdomen depth picture, judges whether the body temperature and the respiration are normal or not, screens respiratory diseases, and inputs the screening result into the communication device 12; the communication device 12 transmits the commodities selected by the user, the face information and the user health information to the server 13 and the user mobile phone 14; the controller 9 controls goods to fall off the goods taking device 8 from the goods display shelf 7 according to the goods information input by the touch screen display 4 and the received goods money to finish intelligent goods selling; the touch screen display 4 is connected with the controller 9 to form a functional module for commodity purchasing and payment; the image/information processing module 6 is connected with the far infrared thermal imaging camera 3 and the depth camera 5 to form a functional module for screening the respiratory diseases of the user.

With reference to fig. 3 to 4, the invention is used as follows: after the intelligent vending machine 1 is powered on, the visible light camera 2 is started to collect face information, the pictures shot by the intelligent vending machine are transmitted to the image/information processing module 6, and the face information is extracted by the image/information processing module; if the face information can not be extracted, transmitting a signal to the touch display screen 4 to prompt the user to try again the camera; if the face information can be extracted, a signal is transmitted to the touch display screen 4 to prompt the user to purchase the commodity. After the user selects the commodities and pays, the touch display screen 4 transmits signals to the controller 9 to control the corresponding commodities on the commodity display shelf 7 to roll down the commodity taking device 8, and then the user takes the commodities out of the commodity taking device 8. When the user selects commodities, pays and takes goods, the image/information processing module 6 starts the thermal imaging camera 3 and the depth camera 5 to perform thermal imaging of the user and shoot a chest and abdomen depth picture, and transmits the thermal imaging and the chest and abdomen depth picture to the image/information processing module 6 to extract the body temperature and the respiratory waveform of the user, the image processor 6 extracts the forehead temperature of the user from the thermal imaging picture as the body temperature, extracts the respiratory waveform from the chest and abdomen depth picture according to the chest and abdomen movement, and judges whether the body temperature and the respiration are normal or not. If the body temperature and the breath of the user are normal, the information is sent to the mobile phone 14 of the user through the communication device 12; if the body temperature and the breath of the user are abnormal, the abnormal information is sent to the mobile phone 14 of the user through the communication device 12, and meanwhile, the communication device 12 sends the abnormal information and the position of the vending machine to the server 13 of the management department so as to carry out effective management and control.

The invention can enable a consumer to measure the body temperature and the breath of the consumer in a remote non-contact mode in the period of selecting, paying and waiting for taking the commodity, thereby judging whether the consumer breathes abnormally or not, and finally informing the body temperature and the breath state to the consumer through a mobile phone. The invention has been described in further detail in order to avoid limiting the scope of the invention, and it is intended that all such equivalent embodiments be included within the scope of the following claims.

Claims

1. An intelligent vending machine with a respiratory disease screening function comprises a touch screen display, a commodity display shelf, a goods taking device and a controller, and is characterized in that a three-mode camera assembly and a communication device which are connected with an image/information processing module are arranged on the intelligent vending machine, and the three-mode camera assembly comprises a visible light camera, a far infrared thermal imaging camera and a depth camera; the touch screen display is respectively connected with the controller and the image/information processing module; the visible light camera extracts the face information of the user from the acquired image through the image/information processing module and then outputs the face information to the touch screen display; the touch screen display displays the face information acquired by the visible light camera and prompts a user to purchase goods; the infrared thermal imaging camera and the depth camera perform thermal imaging and depth picture shooting during the use of the vending by the user, and input the collected thermal imaging and chest and abdomen depth picture to the image/information processing module; the image/information processing module extracts forehead temperature and respiration waveform of the user from the input thermal imaging and chest and abdomen depth pictures so as to judge whether body temperature and respiration are normal or not and input health information of the body temperature and respiration into the communication device; the communication device transmits commodities selected by the user, the face information and the health information to the server and the mobile phone of the user; the controller controls goods to roll off the goods taking device from the goods display shelf according to the goods information input by the touch screen display and the received goods money, and intelligent goods selling is completed.

2. The intelligent vending machine with respiratory disease screening function of claim 1, wherein the touch screen display is connected with the controller to form a functional module for goods purchasing and payment.

3. The intelligent vending machine with the respiratory disease screening function as claimed in claim 1, wherein the image/information processing module is connected with the far infrared thermal imaging camera and the depth camera to form a functional module for screening respiratory disease of the user.