KR102241569B1 - Pedestrian monitoring system using gate apparatus - Google Patents

Abstract

The present invention relates to a pedestrian monitoring system using a gate apparatus. By including at least one gate device and a pedestrian management server, the pedestrian monitoring system has the effect of efficiently monitoring skin temperature status information along with status information such as a heart rate, hyperventilation, and tachypnea of each pedestrian passing through an entrance gate in real time.

Description

Pedestrian monitoring system using gate device {PEDESTRIAN MONITORING SYSTEM USING GATE APPARATUS}

The present invention relates to a passenger monitoring system using a gate device.

In general, if a patient or an infected person with an infectious disease freely passes in a public place or large building where a large number of people gather, the disease can be transmitted to other people, and in particular, the disease can be widely spread. Therefore, these infected individuals should be quarantined with the public at an early stage to prevent the possibility of transmission to multiple people.

In recent years, a new outbreak of respiratory infectious diseases occurs, and dangerous situations that can infect people in a wide range are frequently encountered. For example, new infectious diseases such as SARS (severe acute respiratory syndrome), swine flu, Ebola, MERS, and COVID-19 are frequently occurring.

However, since these infectious diseases exhibit symptoms similar to common diseases such as a cold, it is difficult for the infected person to know the infection itself until the infectious disease is confirmed. Therefore, it is necessary to quickly check whether these infected people pass in public places where many people gather, and take additional tests or quarantine measures.

Most of these infectious diseases are accompanied by fever, so people with severe fever can be primarily judged as suspicious of the disease, and infection can be determined through a close examination. That is, it is possible to determine the primary suspected fever by measuring body temperature.

Body temperature refers to the temperature inside the body. Body temperature is very different depending on the part of the body, but the normal body temperature of humans is said to be 36.9℃ as the armpit temperature, and children tend to be slightly higher than adults and the elderly tend to be lower. The high temperature state of the body causes a more serious situation than the low temperature state.

Body temperature is about 37℃ normal body temperature in adults, but at about 41℃ it causes convulsions and pain, and 43.3℃ is the maximum limit of life support. In addition, life cannot be maintained even at a body temperature of 27℃ or lower.

The most accurate way to measure body temperature is to measure the temperature of the rectum, measured at about 6cm or more in the anus. However, since the measurement method is too complex, the attributable temperature is generally measured. However, in public places such as airports, since a large number of unspecified people go through it, it takes a lot of manpower to check the body temperature by measuring the temperature attributable to all passers-by, causing inconvenience to passers-by. have.

On the other hand, biometric signals such as respiration rate are one of the most convenient factors for diagnosing a human body's health status and abnormalities. That is, there are many cases where it is necessary to check the breathing status of not only patients who are hospitalized or undergoing surgery, but also those who live outside the hospital. For example, current respiratory infectious diseases such as COVID-19 have a fever and an unstable breathing pattern, so it is necessary to measure this.

However, in the related art, it was difficult to obtain data by accurately measuring the user's respiration rate and respiration volume without a respiration measuring device such as that provided in a hospital, and to accurately transfer the acquired data to an external measurer.

In particular, the conventional method of measuring the respiration rate by attaching a simple sensor to the body and using the primary signal obtained from the sensor is much insufficient in accuracy compared to the method of measuring the respiration rate through hospital equipment. .

In order to solve this problem, in Korean Patent Registration No. 10-1654914 (a breathing measuring device and a breathing measuring method using the same), a pad attachable to the user's body, installed on the pad, and the user's breathing Three or more sensors for measuring signals generated according to the user's body movement, and a determination unit for measuring the user's respiration rate using signals measured by at least two or more of the three or more sensors, The sensor includes a first sensor and a second sensor, and the determination unit compares the first signal measured by the first sensor and the second signal measured by the second sensor, and within a time difference of a preset range. By counting the number of times the peak values of the first signal and the second signal appear and counting the number of respirations, a respiration measurement device capable of accurately and simply measuring the user's respiration rate is disclosed.

In this prior art, it is possible to remotely check the user's health status in real time by transmitting the user's breathing data during daily life outside the hospital to a system such as a hospital, and the user's respiratory rate without attaching equipment such as an oxygen mask to the user. By measuring, there is an advantage of being able to monitor the patient's breathing state in real time in parallel with surgery and various treatments.

However, in the conventional respiration measuring device and respiration measuring method, as a contact type device attached to the user's body, it has a limitation that it cannot measure respiration unless the user wears it.

Domestic Registration Patent No. 10-1420200 (announced on July 21, 2014) Domestic registered patent No. 10-1654914 (announced on October 10, 2016) Korean Patent Publication No. 10-2006-0005092 (published on January 17, 2006)

The present invention has been conceived to solve the above-described problem, and an object of the present invention is to use a radar to non-contact heart rate and/or for passers-by who pass through the entrance/exit gates of buildings or airport facilities, etc. By measuring the breathing status and at the same time using a thermal imaging camera to measure the skin temperature status, the gate enables efficient real-time monitoring of skin temperature status information along with status information such as heart rate, hyperventilation, and tachypnea of each passer-by. It is to provide a passenger monitoring system using a device.

In order to achieve the above object, an aspect of the present invention is installed at the entrance/exit of a gate provided in a building or airport facility, and the respiratory rate of at least one passerby existing at the entrance/exit of the gate through a radar and At least one gate device for non-contact detection of a signal related to biometric information on a heart rate, acquiring temperature data around the entrance/exit of the corresponding gate through a thermal imaging camera, and extracting measured temperature data of each passenger; And receiving signals related to biometric information on the respiratory rate and heart rate of each passer-by detected from each gate device, detecting a change in the chest displacement of each passer-by based on this, and detecting the detected chest displacement of each passer-by. After analyzing the heart rate, hyperventilation, or tachypnea of each passer according to the change in the database, at least one of the heart rate, respiration rate, hyperventilation, and tachypnea status of each passer-by analyzed for each gate device is databased. In addition to storage and management, a service is provided so that the manager can visually monitor at least one of the heart rate, respiration rate, hyperventilation, and tachypnea status of each passer-by in real time, and the corresponding passage extracted from each gate device After receiving the measured temperature data of the person and analyzing the measured temperature data pattern of the person region extracted during the preset temperature extraction time based on this, the skin temperature status information of each passer-by is obtained, and then the corresponding pass obtained for each gate device A passenger monitoring system using a gate device including a passenger management server that provides a service that enables the administrator to visually monitor the skin temperature status of each passenger in real time while storing and managing the skin temperature status information of the person into a database. Is to provide.

Here, each gate device includes: an entrance gate module installed at the entrance/exit of a gate provided in a building or airport facility and provided to allow at least one passer-by to pass through; Passer's heart rate/respiration measurement that is installed at the entrance/exit of the entrance gate module and uses a radar to detect signals related to biometric information about the respiratory rate and heart rate of each passer-by at the gate in/out in a non-contact manner. module; And a passenger temperature measurement module installed at the entrance/exit of the entrance/exit gate module, and obtaining temperature data around the entrance/exit of the corresponding gate through a thermal imaging camera and extracting the measured temperature data of each passenger. This is desirable.

Preferably, the passenger's heart rate/breathing measurement module is a radar transmitter that transmits a first signal having a radar pulse for each of the passengers present at the entrance/exit of the gate provided in the entrance gate module. ; A radar receiving unit configured to receive a second signal related to the first signal by reflecting a first signal transmitted from the radar transmitting unit from each corresponding passer-by; And, based on the first and second signals transmitted and received from the radar transmitter and the radar receiver, extracts a frequency including motion information on the breathing and heartbeat of each passer-by, and according to the phase change of the extracted frequency It may include a signal processing unit for processing a signal related to the biometric information on the respiratory rate and heart rate of the passerby.

Preferably, the signal processor converts the data of the second signal, which is a reflected electromagnetic wave, into a frequency domain through Fast Fourier Transform (FFT), and a frequency domain corresponding to a preset frequency range among the converted frequency domains. The peak value of the frequency at is detected, and a phase value of the frequency over time may be obtained using the detected peak value of the frequency.

Preferably, the signal processing unit, when the electromagnetic wave of the first signal transmitted from the radar transmitting unit is reflected and returned, collects data on the second signal, which is a plurality of reflected electromagnetic waves reflected and returned through the radar receiving unit, and the Only data of the same frequency band may be acquired among the collected second signals, which are a plurality of reflected electromagnetic waves.

Preferably, the signal processor may convert the obtained data of the same frequency band into a frequency domain through Fast Fourier Transform (FFT), and extract frequencies related to the respiratory rate and heart rate from the converted frequency domain.

Preferably, the signal processor may detect a peak value by converting the converted frequency domain into a time domain, and measure a distance between the detected peak values to calculate a correlation coefficient for the heart rate of each passerby.

Preferably, the signal processor may process a phase unwrapping operation by adding or subtracting 2π from the phase when the phase difference between the continuous values with respect to the extracted frequency is greater than or less than ±π.

Preferably, the signal processing unit may process a phase difference operation of subtracting a continuous phase value from the phase unwrapped phase.

Preferably, the signal processing unit may determine the respiratory rate and heart rate of each passerby by performing spectrum estimation on the phase unwrapped and phase-difference-processed frequencies.

Preferably, the signal processing unit generates a correlation equation of the respiration rate with respect to the frequency peak using the frequency related to the extracted respiration rate, and included in a preset respiration rate frequency range at the frequency related to the extracted respiration rate. Based on the data of the frequency, it is possible to determine the respiratory rate of each passer-by.

Preferably, the signal processing unit generates a correlation equation of the heart rate with respect to the frequency peak by using the frequency related to the extracted heart rate, and in the frequency data included in the preset heart rate frequency domain in the frequency related to the extracted heart rate. Based on this, you can determine the heart rate of each person in question.

Preferably, the passenger heart rate/respiration measurement module tracks a plurality of passengers using a beam steering technology capable of giving a phase change at a preset angle for each of a plurality of transmission antennas provided in the radar transmitter. A passer-by tracking unit may be further included.

Preferably, the signal processing unit extracts a frequency including movement information on the respiration and heartbeat of the corresponding person tracked from the person tracking unit, and the number of respirations of each person according to the phase change of the extracted frequency And it is possible to process a signal related to the biometric information on the heart rate.

Preferably, each gate device includes: a display module for visually displaying information on heart rate/breathing status and skin temperature status of each passer-by; And receiving signals related to biometric information on the respiratory rate and heart rate of each passenger measured from the passenger heart rate/respiration measurement module, and detecting a change in the chest displacement of each passenger based on this, and the detected corresponding After analyzing the heart rate, hyperventilation, or tachypnea of each passer according to each passer's chest displacement, the user can visually check the analyzed heart rate, hyperventilation, or tachypnea status information of each passer so that it is displayed on the display screen. Controls the operation of the display module, receives the measured temperature data of each passenger extracted from the passenger temperature measurement module, analyzes the measured temperature data pattern of the person region extracted during a preset temperature extraction time based on this After acquiring the skin temperature status information of each passerby, a gate control module for controlling the operation of the display module may be further included so that the acquired skin temperature status information of each passer is displayed on a display screen so that the obtained skin temperature status information can be visually confirmed. .

Preferably, the gate control module receives signals related to biometric information on the respiratory rate and heart rate of each passenger measured from the passenger's heart rate/respiration measurement module, and changes in the chest displacement of each passenger based on this. A chest displacement detection unit that detects; A heart rate/breathing state acquisition unit that analyzes the heart rate, hyperventilation, or tachypnea state of each passer-by according to the change in the chest displacement of each passer-by detected by the chest displacement detection unit and obtains breathing status information of each passer-by; By receiving the measured temperature data of each passer-by extracted from the passer-by temperature measurement module and analyzing the measured temperature data pattern of the person area extracted for a preset temperature extraction time based on this, obtains skin temperature status information of each passer-by. A skin temperature state acquisition unit; And the heart rate/respiration status information of each passer-by acquired from the heart rate/breathing status acquisition unit and the skin temperature status information of each passer-by acquired from the skin temperature status acquisition unit are displayed on the display screen so that the user can visually check it. It may include a gate controller that controls the operation of the display module as possible.

Preferably, the gate control module acquires the interval between breaths along with the cycle of inhalation or exhalation in the breathing process based on the change in the chest displacement of the corresponding passenger detected from the chest displacement detection unit, and A respiratory quality analysis unit that analyzes the state information of the breathing quality of the child may be further included.

Preferably, the gate control unit may control the operation of the display module to be displayed on the display screen so that the user can visually check the respiratory quality status information for each passerby analyzed by the respiration quality analysis unit. .

Preferably, the gate control module includes change state information on the displacement of the chest of each passer-by, heart rate of each passer-by, hyperventilation or tachypnea status information, and intervals between breaths along with a cycle of inhalation/exhalation for each passer-by. A storage unit for storing at least one of status information, breathing quality status information for each passer-by, and skin temperature status information of each passer-by may be further included.

Preferably, the gate control unit, the detected change state information on the chest displacement of each passenger, the heart rate of each passenger, hyperventilation or tachypnea status information, breathing together with a cycle of inhalation/exhalation for each corresponding passenger At least one of the state information of the inter-gap state, the state of the breathing quality for each passer-by, and the state information of the skin temperature of each passer-by is received, and based on this, the change status information on the chest displacement for each passer-by. , Heart rate, hyperventilation or tachypnea status information, interval between breathing status information, breathing quality status information, and skin temperature status information along with periods of inhalation/exhalation are databaseized and stored in the storage unit. Can be controlled.

Preferably, the gate control unit, the detected change state information on the chest displacement of each passenger, the heart rate of each passenger, hyperventilation or tachypnea status information, breathing together with a cycle of inhalation/exhalation for each corresponding passenger The user receives at least one of the state information of the inter-interval gap, the state of the breathing quality for each passer-by, and the state information of the skin temperature of the corresponding passer-by, and the user receives the change status information on the chest displacement for each passer-by, the heart rate. , Hyperventilation or tachypnea status information, breathing interval status information, breathing quality status information, and skin temperature status information along with periods of inhalation/exhalation are displayed on the display screen so that at least one status information can be visually confirmed. You can control the operation of the display module.

Preferably, the gate control module includes change state information on the displacement of the chest of each passer-by, heart rate of each passer-by, hyperventilation or tachypnea status information, and intervals between breaths along with a cycle of inhalation/exhalation for each passer-by. The communication unit may further include a communication unit that transmits at least one of status information, breathing quality status information for each passer-by, and skin temperature status information of each passer-by through a wired or wireless communication method.

Preferably, the gate control unit, the detected change state information on the chest displacement of each passenger, the heart rate of each passenger, hyperventilation or tachypnea status information, breathing together with a cycle of inhalation/exhalation for each corresponding passenger At least one of the state information of the inter-gap state, the state of the breathing quality for each passenger, and the state of the skin temperature of each passenger is received, and based on this information, the change state information on the chest displacement for each passenger, At least one of heart rate, hyperventilation or tachypnea status information, interval between breathing status information, breathing quality status information, and skin temperature status information along with inhalation/exhalation cycles is sent to an external terminal or It is possible to control the operation of the communication unit to be transmitted to the server.

Preferably, the external terminal or server, the change state information for the chest displacement for each passer-by transmitted from the communication unit through a pre-installed passenger condition measurement-related application, heart rate, hyperventilation or tachypnea status information, inhalation/exhalation Along with the cycle of, at least one of the state information of the interval between breaths, the state of the breathing quality, and the state of the skin temperature is provided, and based on this, at least one graph of a line, a circle, and a bar graph is generated according to the user's request. Using hourly/daily/day of the week/weekly/monthly, change status information on the chest displacement of each passer-by, heart rate, hyperventilation or tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, breathing quality status A service may be provided so that at least one of the information and the skin temperature state information is displayed on the display screen.

Preferably, each of the gate devices includes an image acquisition module installed at the entrance/exit of the entrance/exit gate module, and acquiring image data about the entrance/exit of the entrance/exit of the entrance/exit through a real image camera; And the image data obtained from the image acquisition module and the measured temperature data extracted from the passenger temperature measurement module, and based on this, image compression data, face detection location, and size data, as well as temperature data for the face detection location, are provided. A heat detection module that extracts and transmits may be further included.

Preferably, the gate control module receives the image compression data, the face detection position and size data transmitted from the heat detection module, as well as the temperature data for the corresponding face detection position, and converts the compressed image data into the original image based on the received image compression data, the face detection position, and the size data. It restores, acquires a face image from the restored image according to the face detection position and size information, extracts a facial image feature using the reference information extracted from the acquired face image, and extracts a face for the previously stored facial image feature. The operation of the display module may be controlled so that classification and face ID information are extracted, and the extracted face ID information and temperature information are synthesized on the reconstructed image and output on a display screen.

Preferably, the heat detection module comprises: an image compression unit for compressing the image data obtained from the image acquisition module and outputting the image compressed data; The image data obtained from the image acquisition module and the measured temperature data extracted from the passenger temperature measurement module are each provided, and the corresponding face detection location along with the face detection location and size data through artificial intelligence machine learning-based image and data processing A heat detection unit for extracting temperature data for; And a data processing unit that transmits the image compression data output from the image compression unit as well as the face detection location and size data extracted from the heat detection unit and temperature data for the corresponding face detection location to the gate control unit. have.

Preferably, the gate control module includes: a data receiving unit receiving temperature data for a corresponding face sensing position along with image compression data, face sensing position and size data transmitted from the heat sensing module; A real image restoration unit for restoring the compressed image data received from the data receiving unit into an original image; A face detection processing unit for acquiring a face image from an image restored from the real image restoration unit according to the face detection position and size information received from the data receiving unit; A face information storage unit for storing and managing face classification and face ID information into a database for each face image feature; By receiving the face image obtained from the face detection processing unit, extracting reference information from the face image obtained through image and data processing based on artificial intelligence machine learning, and extracting facial image features using the extracted reference information. In addition, a face recognition processing unit for searching and extracting face classification and face ID information for a corresponding facial image feature extracted through the face information storage unit; An image synthesizing unit for synthesizing the image restored from the real image restoration unit with face ID information extracted from the face recognition processing unit and temperature information for a corresponding face detection position; And a gate controller for controlling an operation of the display module so that the image data synthesized by the image synthesizing unit is displayed on a display screen so that the image data synthesized by the user can be visually viewed.

Preferably, the gate control module includes image compression data received from the data receiving unit according to the control of the gate control unit, temperature information on a corresponding face detection position, and size information, and temperature information on a corresponding face detection position, extracted from the face recognition processing unit. A data storage unit for storing and managing at least one of facial image feature information, face classification and face ID information for the corresponding facial image feature, and image information synthesized from the image synthesizing unit may be further included.

Preferably, the gate control module comprises image compression data received from the data receiving unit under control of the gate control unit, facial image feature information extracted from the face recognition processing unit, face classification and face ID information for the corresponding facial image feature. And a communication unit that transmits at least one of the image information synthesized by the image synthesizing unit to an external terminal or server through a communication network.

Preferably, the communication unit, when there is no face classification and face ID information for the facial image feature extracted from a separate face information storage unit through the face recognition processing unit, the face is Facial image feature information for a face classification that does not exist in the face information storage unit may be received from the recognition processing unit and transmitted to the external terminal or server through the communication network.

Preferably, the external terminal or server receives facial image feature information for face classification that does not exist in the face information storage unit from the face recognition processing unit through the communication unit, and based on this, through a separate face classification DB. Face ID information for a face classification that does not exist in the face information storage unit may be extracted, and face ID information and temperature information extracted from the reconstructed image may be synthesized and displayed on a display screen.

Preferably, the external terminal or server uses face ID information and temperature information input through a separate user input module to search for temperature information corresponding to the face ID information and retrieve the restored image corresponding to the corresponding temperature. Services can be provided to enable search or playback.

Preferably, the gate control unit performs a search for temperature information corresponding to the corresponding face ID information and a search or replay of a restored image corresponding to the corresponding temperature using face ID information and temperature information input through a separate user input unit. You can control it to be possible.

Preferably, the passer-by management server acquires the interval between breaths along with the cycle of inhalation or exhalation in the breathing process based on the change in the chest displacement of the corresponding passer-by detected from each gate device, and You can analyze the quality of your breathing.

Preferably, the passer-by management server includes change state information on the chest displacement of each passer-by, heart rate of each passer-by, hyperventilation or tachypnea status information, and periods of inhalation/exhalation for each passer-by. Based on at least one of interval status information or breathing quality status information for each passer-by, change status information for chest displacement for each gate device and for each passer-by, heart rate, hyperventilation or tachypnea status A service may be provided to store and manage at least one state information among information, inhalation/exhalation cycles, inter-breathing interval state information, and breathing quality state information into a database.

Preferably, the passer-by management server, the manager changes state information for the chest displacement for each passer-by, heart rate, hyperventilation or tachybreathing status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality. A service may be provided to be displayed on a display screen so that at least one of the state information can be visually confirmed.

Preferably, the passer-by management server includes change state information for chest displacement for each corresponding passer-by, heart rate, hyperventilation or tachypnea status information, interval between breaths along with inhalation/exhalation period status information, and breathing quality status information A service may be provided so that at least one of the status information is transmitted to an external terminal through a wired or wireless communication method through a communication network.

Preferably, the external terminal is transmitted from the passenger management server through a pre-installed passenger condition measurement-related application, the change status information for the chest displacement for each passenger, heart rate, hyperventilation or tachypnea status information, inhalation/ By receiving at least one status information among breathing interval status information and breathing quality status information along with the period of exhalation, based on this, by using at least one of a line, a circle, and a bar graph according to the user's request, by time/ Daily/day of the week/weekly/monthly change status information on the chest displacement of each passer-by, heart rate, hyperventilation or tachypnea status information, interval between breaths with inhalation/exhalation period status information, and breath quality status information at least. A service can be provided so that one status information is displayed on the display screen.

Preferably, the passenger management server receives a signal related to biometric information on the respiratory rate and heart rate of each passenger detected from each gate device, extracts the respiratory rate of each passenger based on this, and the extracted If the breathing rate continues for more than the preset breathing reference duration and is below the preset minimum standard breathing rate or above the preset maximum standard breathing rate, a preset breathing rate bio-abnormality notification message is generated and the administrator sends a breathing rate bio-abnormality notification message. Provides a monitoring service to be displayed on the display screen in real time for visual viewing, or provides a database (DB) of respiratory rate and bio-abnormality notification messages for each passer by hour/day/day/week/month and stored in a separate storage device. Services can be provided to be stored and managed.

Preferably, the passenger management server receives signals related to biometric information on the respiratory rate and heart rate of each passenger detected from each gate device, extracts the heart rate of each passenger based on this, and extracts the extracted heart rate. If the heart rate is below the preset minimum standard heart rate or higher than the preset maximum standard heart rate while continuing for more than the preset heart rate reference duration, a preset heart rate bio-abnormality notification message is generated, and the administrator visually displays the heart rate bio-abnormality notification message. Provides a monitoring service to be displayed on the display screen in real time for viewing, or provides a service to store and manage heart rate bio-abnormality notification messages for each passer by hourly/daily/day of the week/weekly/monthly database to be stored and managed in a separate storage device. Can provide.

Preferably, the passenger management server may provide a cloud computing service in response to a request from an external client terminal.

Preferably, the client terminal, using the client member log-in cloud web service of the passenger management server, the change state information on the chest displacement for each passenger analyzed from the passenger management server, heart rate, hyperventilation or tachypnea At least one of status information, interval between breathing status information, and quality of breathing status information along with periods of inhalation/exhalation may be searched in real time and displayed on the display screen.

Preferably, the passer-by management server includes change state information for chest displacement for each corresponding passer-by, heart rate, hyperventilation or tachypnea status information, interval between breaths along with inhalation/exhalation period status information, and breathing quality status information In the case of storing at least one of the status information in a database, using a symmetrical or asymmetric encryption method, the change status information for the chest displacement for each passenger, heart rate, hyperventilation or tachypnea status information, breathing with the cycle of inhalation/exhalation At least one of the inter-interval status information and the breathing quality status information is encrypted and stored, as well as the encrypted change status information on the chest displacement for each passer-by, heart rate, hyperventilation or tachypnea status information, inhalation/exhalation It is possible to provide a service such that a decryption key capable of decrypting at least one of state information between breathing intervals and state information of breathing quality together with a period of is transmitted to the client terminal.

Preferably, the client terminal is encrypted and stored in the passer-by-passenger management server using the decryption key transmitted from the passer-by-passenger management server along with the corresponding client member log-in information, and changes state information on the chest displacement for each passer-by, heart rate. , Hyperventilation or tachybreathing status information, breathing interval status information, and breathing quality status information along with periods of inhalation/exhalation can be decoded and displayed in real time on a search and display screen.

Preferably, the passer-by management server, through the client terminal, change state information for the chest displacement for each passer-by, heart rate, hyperventilation or tachypnea status information, inhalation/exhalation cycles, and inter-breathing interval status information, and It is possible to provide a cloud web service so that at least one of the state information of the quality of breath can be downloaded.

Preferably, the client terminal is stored in the passer-by-passenger management server through a passer-by-passer condition measurement-related application downloaded from the passer-by-passenger management server, and the change status information on the chest displacement for each passer-by, heart rate, hyperventilation or tachypnea status At least one of status information, breathing interval status information, and breathing quality status information along with the period of inhalation/exhalation may be searched in real time and displayed on the display screen.

According to the passenger monitoring system using the gate device of the present invention as described above, the heart rate and/or non-contact type using a radar for the passengers passing through the entrance/exit installed at the entrance/exit of a building or an airport facility, etc. By measuring the breathing status and at the same time using a thermal imaging camera to measure the skin temperature, it is possible to efficiently monitor the skin temperature status information in real time along with status information such as heart rate, hyperventilation, and tachypnea of each passenger. have.

1 is an overall block diagram for explaining a passenger monitoring system using a gate device according to an embodiment of the present invention.
2 is a detailed block diagram illustrating an applied gate device according to an embodiment of the present invention.
3 is a perspective view illustrating an entrance gate module applied to an embodiment of the present invention.
4 is a detailed block diagram for explaining a passenger heart rate/respiration measurement module applied to an embodiment of the present invention.
5 is a detailed block diagram illustrating a gate control module applied to an embodiment of the present invention.
6 is a detailed block diagram illustrating a heat detection module applied to an embodiment of the present invention.
7 is a detailed block diagram illustrating an external terminal applied to an embodiment of the present invention.

The above-described objects, features, and advantages will be described later in detail with reference to the accompanying drawings, and accordingly, one of ordinary skill in the art to which the present invention pertains will be able to easily implement the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of a known technology related to the present invention may unnecessarily obscure the subject matter of the present invention, a detailed description will be omitted.

Terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

Terms used in the present invention have selected general terms that are currently widely used as possible while taking functions of the present invention into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, and the like. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall contents of the present invention, not a simple name of the term.

When a part of the specification is said to "include" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the embodiments of the present invention exemplified below may be modified in various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to more completely describe the present invention to those of ordinary skill in the art.

Combinations of each block in the attached block diagram and each step in the flowchart may be executed by computer program instructions (execution engine), and these computer program instructions are on a processor of a general purpose computer, special purpose computer or other programmable data processing equipment. As can be mounted, the instructions executed by the processor of a computer or other programmable data processing equipment generate means for performing the functions described in each block of the block diagram or each step of the flowchart. These computer program instructions may also be stored in a computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory. It is also possible to produce an article of manufacture in which the instructions stored in the block diagram contain instruction means for performing the functions described in each block of the block diagram or each step of the flowchart.

In addition, since computer program instructions can be mounted on a computer or other programmable data processing equipment, a series of operation steps are performed on a computer or other programmable data processing equipment to create a process that is executed by a computer, It is also possible for the instructions to perform possible data processing equipment to provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

In addition, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing specified logical functions, and in some alternative embodiments mentioned in the blocks or steps. It should be noted that it is also possible for functions to occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially simultaneously, and the blocks or steps may be performed in the reverse order of a corresponding function as necessary.

FIG. 1 is an overall block diagram for explaining a traffic monitoring system using a gate device according to an embodiment of the present invention, and FIG. 2 is a specific block configuration for explaining an applied gate device according to an embodiment of the present invention. FIG. 3 is a perspective view for explaining an entrance gate module applied to an embodiment of the present invention, and FIG. 4 is a detailed block diagram for explaining a passenger heart rate/respiration measurement module applied to an embodiment of the present invention 5 is a detailed block diagram for explaining a gate control module applied to an embodiment of the present invention, and FIG. 6 is a specific block diagram for explaining a heat detection module applied to an embodiment of the present invention, 7 is a detailed block diagram illustrating an external terminal applied to an embodiment of the present invention.

1 to 7, the passenger monitoring system using a gate device according to an embodiment of the present invention includes at least one gate device (1000-1 to 1000-N), and a passenger management server (2000). ), etc. In addition, the passenger monitoring system using the gate device according to an embodiment of the present invention may further include an external terminal 20 and the like. Meanwhile, since the components shown in FIGS. 1 to 7 are not essential, the passenger monitoring system using the gate device according to an embodiment of the present invention may have more components or fewer components. .

Hereinafter, components of a passenger monitoring system using a gate device according to an embodiment of the present invention will be described in detail.

Each gate device (1000-1 to 1000-N) is installed at the entrance and/or exit of a gate provided in buildings and/or airport facilities, and at least one existing at the entrance and/or exit of the gate through radar In addition to non-contact detection of signals related to biometric information on the respiration rate and/or heart rate of the passenger, the temperature data around the entrance and/or exit of the corresponding gate is acquired through a thermal imaging camera to measure temperature data of each passenger. It performs the function of extracting.

Each of these gate devices (1000-1 to 1000-N), as shown in Figure 2, largely the entrance gate module 100, the passenger heart rate / respiration measurement module 200, the passenger temperature measurement module 300, And a power supply module 400 and the like. In addition, each of the gate devices 1000-1 to 1000-N applied to an embodiment of the present invention includes a display module 500, a gate control module 600, an image acquisition module 700, and/or a heat detection module ( 800) and the like may be further included. Meanwhile, since the components shown in FIG. 2 are not essential, each gate device 1000-1 to 1000-N applied to an embodiment of the present invention may have more components or fewer components. have.

Hereinafter, components of each of the gate devices 1000-1 to 1000-N applied to an embodiment of the present invention will be described in detail.

The entrance gate module 100 is installed at an entrance and/or exit of a building and/or an airport facility, and is provided so that at least one passer-by can pass.

As shown in FIG. 3, the entrance gate module 100 is preferably formed in the form of an arch of a certain height so that people can pass, but is not limited thereto, for example, an automatic door, a revolving door, or It can be implemented with various types of entrance gates, such as a barrier. In addition, the entrance gate module 100 may include an access restriction device capable of restricting the access of a person by determining the opening and closing of the gate according to a specific control signal.

Passer's heart rate/breathing measurement module 200 is installed at the entrance and/or exit side of the entrance gate module 100, and is present at the entrance and/or exit side of the entrance gate module 100 using a radar. It performs a function of non-contact detection of signals related to biometric information on the respiratory rate and/or heart rate of each passenger.

That is, the passenger heart rate/respiration measurement module 200 is a device that non-contactly detects a signal related to the biometric information of each passenger passing through the entrance gate module 100 using a radar sensor, and the radar sensor Is a sensor that transmits electromagnetic waves in a specific direction, and may include, for example, a mmWave Radar Sensor. The millimeter wave radar sensor is a sensor using a frequency between 30GHz and 300GHz.

The millimeter wave frequency has a directivity capable of concentrating an electromagnetic wave in a specific direction, and since an electromagnetic wave composed of a frequency having such a directivity characteristic is not affected by other external motions, it is possible to detect multiple human bodies. .

For example, if the electromagnetic wave output from the millimeter wave radar sensor compares the data (RSS value) of the reflected electromagnetic wave reflected by the person and the object, the object and the person have different amounts according to the dielectric constants of the object and the person. It is possible to observe the reflection of the amount of the reflected electromagnetic wave, and it is possible to distinguish whether the object that reflected the electromagnetic wave is an object or a person through a regression analysis of the reflected electromagnetic wave compared to the output electromagnetic wave.

As shown in FIG. 4, the passenger heart rate/respiration measurement module 200 includes a radar transmitter 210, a radar receiver 220, a signal processing unit 230, and a power supply unit 240. . In addition, the passenger heart rate/respiration measurement module 200 applied to an embodiment of the present invention may further include a passenger tracking unit 250 and the like. Meanwhile, since the components shown in FIG. 4 are not essential, the passenger heart rate/respiration measurement module 200 applied to an embodiment of the present invention may have more components or fewer components.

Hereinafter, the components of the passenger heart rate/respiration measurement module 200 applied to an embodiment of the present invention will be described in detail.

The radar transmitter 210 performs a function of transmitting a first signal having a radar pulse with respect to each passer-by existing at the entrance and/or exit of the entrance gate module 100.

That is, the radar transmission unit 210 transmits a first signal having a radar pulse to each passer-by existing at the entrance and/or exit of the entrance and exit gate module 100, and transmits an impulse signal for detecting each passer-by. It is a component that radiates to the outside, and although not shown in the drawing, it may generally include an impulse generator, a transmit antenna, and a transmission controller.

Here, the transmission control unit may provide data for impulse generation to the impulse generator, and the impulse generator may generate an impulse according to the control of the transmission control unit.

The radar receiving unit 220 performs a function of receiving a second signal related to the first signal by reflecting the first signal transmitted from the radar transmitting unit 210 from each corresponding passenger.

Although not shown in the drawing, the radar receiver 220 may generally include a receive antenna and a receive controller.

Here, the receiving antenna may receive a reflected signal of a pulse radiated by the radar transmitter 210, and an ultra-wideband antenna having high directivity may be used.

The reception control unit may analyze a signal received by the reception antenna. The signal received through the reception antenna includes not only the reflected signal of the corresponding pedestrian to be detected, but also the reflected signal of the surrounding object, and signals other than the object must be removed for accurate measurement of the corresponding pedestrian.

In addition, the reception control unit may include conventional components such as an amplification unit, an A/D conversion unit, a D/A conversion unit, a sampling unit, a demodulation unit, a filter unit, etc. Since it is the same as, a detailed description thereof will be omitted.

The signal processing unit 230 extracts a frequency including motion information on the breathing and/or heartbeat of each of the corresponding users based on the first and second signals transmitted and received from the radar transmitting unit 210 and the radar receiving unit 220, According to the phase change of the extracted frequency, a signal related to biometric information on the respiratory rate and/or heart rate of each passer-by is processed.

That is, the signal processing unit 230 may extract a frequency from the data of the reflected electromagnetic wave and pre-process the phase of the extracted frequency. Here, the reflected electromagnetic wave data may include a frequency domain including motion information on the breathing and/or heartbeat of each passer-by. A dominant frequency peak is generated in the frequency extracted from the reflected electromagnetic wave data, and the frequency of the corresponding frequency peak may be related to the respiratory rate and/or heart rate of each passenger.

In addition, the signal processing unit 230 converts the data of the second signal, which is a reflected electromagnetic wave, into a frequency domain through Fast Fourier Transform (FFT), and a frequency domain corresponding to a preset frequency range among the converted frequency domains. A function of detecting a peak value of a frequency at and obtaining a phase value of a frequency over time using the detected peak value of the frequency may be performed.

In addition, when the electromagnetic wave of the first signal transmitted from the radar transmission unit 210 is reflected and returned, the signal processing unit 230 includes a plurality of reflected electromagnetic waves (e.g., directly received reflected electromagnetic waves, A function of collecting data on a second signal, which is reflected electromagnetic wave reflected N times, and so on, and obtaining only data of the same frequency band among the collected second signal, which is a plurality of reflected electromagnetic waves, may be performed.

In addition, the signal processing unit 230 converts the acquired data of the same frequency band into a frequency domain through Fast Fourier Transform (FFT), and extracts a frequency related to the respiratory rate and/or heart rate from the converted frequency domain. You can do it.

In addition, the signal processing unit 230 performs a function of converting the converted frequency domain into a time domain to detect a peak value, measuring a distance between the detected peak values, and calculating a correlation coefficient for the heart rate of each passerby. can do.

In addition, the signal processing unit 230 performs a function of processing a phase unwrapping operation by adding or subtracting 2π from the phase when the phase difference between the continuous values with respect to the extracted frequency is greater or less than ±π. I can.

That is, the signal processing unit 230 may perform a phase unwrapping operation on the extracted frequency. For example, since the phase value is between [-π, π], the signal processing unit 230 can process the phase unwrapping by adding or subtracting 2π from the phase when the phase difference between successive values is greater than or less than ±π. have.

In addition, the signal processing unit 230 may perform a function of processing a phase difference operation of subtracting a continuous phase value from the phase unwrapped. Through the processing of the phase difference, it is possible to improve the accuracy of the heart rate data of each passenger, and it may be helpful to remove the phase deviation.

In addition, the signal processing unit 230 may perform a function of determining the respiratory rate and/or heart rate of each passerby by performing spectrum estimation on the phase-unwrapped and phase-difference-processed frequencies.

In addition, the signal processing unit 230 generates a correlation equation of the respiratory rate with respect to the frequency peak by using the frequency related to the extracted respiratory rate, and a preset respiratory rate frequency range (e.g., It can perform the function of determining the respiratory rate of each passerby based on the data of the frequency included in the range of 0.1Hz to 0.5Hz).

In addition, the signal processing unit 230 generates a correlation equation of the heart rate with respect to the frequency peak using the frequency related to the extracted heart rate, and a preset heart rate frequency range (e.g., 4.0 at 0.8 Hz) in the frequency related to the extracted heart rate. Hz) can perform a function of determining the heart rate of each passenger based on the data of the frequency included.

In addition, the signal processing unit 230 extracts a frequency including movement information on the breathing and/or heartbeat of each passer-by tracked from the passer-by-passenger tracking unit 250, and according to the phase change of the extracted frequency. It is possible to perform a function of processing signals related to biometric information on the respiratory rate and/or heart rate of a passerby.

In addition, the power supply unit 240 has a function of supplying necessary power to each of the above-described units, that is, the radar transmission unit 210, the radar receiving unit 220, the signal processing unit 230, and/or the passenger tracking unit 250. As it is performed, it is desirable to implement a commercial alternating current (AC) power source (eg, AC 220V) to a direct current (DC) and/or alternating current (AC) power source for continuous power supply, but is not limited thereto. It can also be implemented by including a portable battery (Battery).

In addition, the power supply unit 240 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electronic components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and to transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal of the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

Additionally, the passenger tracking unit 250 tracks a plurality of measuring patients using a beam steering technology capable of giving a phase change at a preset angle for each of a plurality of transmission antennas provided in the radar transmission unit 210. Performs a function.

That is, when the beam steering technology is used, although there are two transmission antennas, for example, three or more persons can be measured. If the wavelength resolution is set at 5 mm and 20 degrees, which is about 60 GHz, eight persons can be measured at the same time.

The passenger temperature measurement module 300 is installed at the entrance and/or exit side of the entrance gate module 100, and the temperature around the entrance and/or exit of the entrance gate module 100 through the thermal imaging camera 350 It performs the function of acquiring data and extracting the measured temperature data of each passenger.

Here, the thermal imaging camera 350 visually shows the thermal energy radiated from the surface of the subject, not the real object, and detects the thermal energy in the form of an infrared wavelength, which is a kind of electromagnetic wave, and differs according to the intensity of radiant heat on the subject surface. Express with color.

Meanwhile, the thermal imaging camera 350 may be an infrared (IR) camera, but the present invention is not necessarily limited thereto. In addition, various sensors capable of appropriately generating a thermal image according to a specific ambient temperature are provided. It can also be used.

In addition, the power supply module 400 includes each of the above-described modules, that is, the entrance gate module 100, the passenger heart rate/respiration measurement module 200, the passenger temperature measurement module 300, the display module 500, and the gate. The control module 600, the image acquisition module 700, and / or performs a function of supplying the necessary power to the heat detection module 800, etc., for continuous power supply, commercial alternating current (AC) power (e.g., AC 220V) is preferably implemented to convert into direct current (DC) and/or alternating current (AC) power, but is not limited thereto, and may be implemented including a conventional portable battery.

In addition, the power supply module 400 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electronic components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and to transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal from the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

Additionally, the display module 500 visually displays information on the heart rate/breathing status and/or skin temperature status of each passer-by.

Such a display module 500 is, for example, a liquid crystal display (LCD), a light emitting diode display (LED), a thin film transistor liquid crystal display (TFT LCD), and an organic light emitting diode. (Organic Light Emitting Diode, OLED), Flexible Display, Plasma Display Panel (PDP), Surface Alternate Lighting (ALiS), Digital Light Source Treatment (DLP), Silicon Liquid Crystal (LCoS), Surface Conduction Electron-emitting device display (SED), field emission display (FED), laser TV (quantum dot laser, liquid crystal laser), optoelectric liquid display (FLD), interferometric modulator display (iMoD), thick film dielectric electricity (TDEL), It may include at least one of a quantum dot display (QD-LED), a telescopic pixel display (TPD), an organic light emitting transistor (OLET), a laser fluorescent display (LPD), and a 3D display, but is not limited thereto. Any module may be included as long as it is capable of displaying related information data on the heart rate/breathing state and/or skin temperature state of each of the passengers.

The gate control module 600 receives signals related to biometric information on the respiratory rate and/or heart rate of each passenger measured from the passenger's heart rate/respiration measurement module 200, and based on this, the chest displacement of each passenger is determined. It detects the change of the traffic, and performs a function of analyzing the heart rate, hyperventilation, and/or tachypnea of each passerby according to the detected chest displacement of each passerby.

In addition, the gate control module 600 has a function of controlling the operation of the display module 500 so that the analyzed heart rate, hyperventilation and/or tachypnea status information of each passer-by is displayed on the display screen so that the user can visually check it. Perform.

In addition, the gate control module 600 receives the measurement temperature data of each passenger extracted from the passenger temperature measurement module 300 and analyzes the measurement temperature data pattern of the person region extracted during a preset temperature extraction time based on this. Thus, it performs the function of acquiring the skin temperature status information of each passenger.

In addition, the gate control module 600 performs a function of controlling the operation of the display module 500 to be displayed on the display screen so that the user can visually check the obtained skin temperature status information of each passenger.

In addition, the gate control module 600 receives the image compression data, the face detection position and size data transmitted from the heat detection module 800, and the temperature data for the corresponding face detection position, and converts the original image compression data based on the image compression data, the face detection position, and the size data. It restores to an image, acquires a face image from the restored image according to the face detection position and size information, extracts facial image features using the reference information extracted from the acquired face image, and extracts the facial image features stored in advance. A function of controlling the operation of the display module 500 may be performed to extract face classification and face ID information for, and synthesize the extracted face ID information and temperature information on the reconstructed image to be output on a display screen.

As shown in FIG. 5, the gate control module 600 includes a chest displacement detection unit 605, a heart rate/breathing status acquisition unit 610, a skin temperature status acquisition unit 615, a gate control unit 620, and It includes a power supply unit 625 and the like. In addition, the gate control module 600 applied to an embodiment of the present invention includes a respiratory quality analysis unit 630, a storage unit 635, a communication unit 640, a data receiving unit 645, a real image restoration unit 650, A face detection processing unit 655, a face information storage unit 660, a face recognition processing unit 665, an image synthesis unit 670, and/or a data storage unit 675 may be further included. Meanwhile, since the components shown in FIG. 5 are not essential, the gate control module 600 applied to an embodiment of the present invention may have more components or fewer components.

Hereinafter, components of the gate control module 600 applied to an embodiment of the present invention will be described in detail.

The chest displacement detection unit 605 receives a signal related to biometric information on the respiratory rate and/or heart rate of each passenger measured from the passenger's heart rate/respiration measurement module 200, and based on this, the chest displacement of the corresponding passenger is determined. It performs the function of detecting the change of the product.

The heart rate/breathing state acquisition unit 610 analyzes the heart rate, hyperventilation and/or tachypnea state of each passer-by according to the change in the chest displacement of each passer-by detected from the chest displacement detection unit 605, It performs the function of acquiring heart rate/breathing status information.

That is, the chest displacement detection unit 605 and the heart rate/breathing state acquisition unit 610 extract the parts in which the phase has changed from the reflected signal so that about 1 to 12 mm change in the chest enters and exits during the breathing process is extracted. It is possible to determine the time of entry and exit, and by measuring the time when the chest displacement remains unchanged when inhaling and the time when the chest displacement remains unchanged while exhaling, the heart rate, hyperventilation, and/or tachypnea can be determined.

The skin temperature state acquisition unit 615 receives the measured temperature data of each passer-by extracted from the passer-by temperature measurement module 300 and analyzes the measured temperature data pattern of the human region extracted during a preset temperature extraction time based on this. Thus, it performs the function of acquiring the skin temperature status information of each passenger.

The gate control unit 620 performs overall control of the gate control module 600 applied to the embodiment of the present invention. Each of the above-described units, that is, the chest displacement detection unit 605, and the heart rate/breathing state acquisition unit 610 , Skin temperature status acquisition unit 615, power supply unit 625, respiratory quality analysis unit 630, storage unit 635, communication unit 640, data receiving unit 645, real image restoration unit 650, face A function of controlling the operation of the detection processing unit 655, the face information storage unit 660, the face recognition processing unit 665, the image synthesis unit 670, and/or the data storage unit 675 is performed.

That is, the gate control unit 620 is the heart rate/breathing status information of each passer-by acquired from the heart rate/breathing status acquisition unit 610 and/or the skin temperature status of each passer-by acquired from the skin temperature status acquisition unit 615 A function of controlling the operation of the display module 500 may be performed so that information is displayed on the display screen so that the user can visually check the information.

In addition, the gate control unit 620 performs the operation of the display module 500 to be displayed on the display screen so that the user can visually check the respiratory quality status information for each passerby analyzed by the respiratory quality analysis unit 630. Can perform the function to control.

In addition, the gate control unit 620 is the change state information on the chest displacement of each passerby detected from the chest displacement detection unit 605, the heart rate of each passer, hyperventilation and/or tachypnea status information, and Along with the period of inhalation/exhalation, at least one of status information between breathing intervals, breathing quality status information for each passer-by, and/or skin temperature status information of each passer-by is provided and based on this At least one of the status information of changes in chest displacement for each passenger, heart rate, hyperventilation and/or tachypnea status information, inhalation/exhalation period and interbreathing interval status information, breathing quality status information, and/or skin temperature status information A function of controlling one state information to be converted into a database (DB) and stored in the storage unit 635 may be performed.

In addition, the gate control unit 620 is the change state information on the chest displacement of each passerby detected from the chest displacement detection unit 605, the heart rate of each passer, hyperventilation and/or tachypnea status information, and Along with the inhalation/exhalation cycle, the user is provided with at least one of the status information of the interval between breaths, the status information of the quality of the breath for each passer-by, and/or the status information of the skin temperature of each passer-by, and the user passes each pass. At least one of state information of changes in chest displacement per person, heart rate, hyperventilation and/or tachypnea status information, interval between breaths with inhalation/exhalation cycle status information, breath quality status information, and/or skin temperature status information. A function of controlling the operation of the display module 500 may be performed to be displayed on the display screen so that the status information can be visually confirmed.

In addition, the gate control unit 620 is the change state information on the chest displacement of each passerby detected from the chest displacement detection unit 605, the heart rate of each passer, hyperventilation and/or tachypnea status information, and Along with the period of inhalation/exhalation, at least one of status information between breathing intervals, breathing quality status information for each passer-by, and/or skin temperature status information of each passer-by is provided and based on this At least one of status information of changes in chest displacement for each passenger, heart rate, hyperventilation and/or tachypnea status information, interval between breaths with inhalation/exhalation cycle status information, breathing quality status information, and/or skin temperature status information It is possible to perform a function of controlling the operation of the communication unit 640 so that the state information of is transmitted to the external terminal 20 and/or the server in a wired and/or wireless communication method.

In addition, the gate controller 620 may perform a function of controlling the operation of the display module 500 so that the image data synthesized by the image synthesizing unit 670 is displayed on the display screen so that the image data synthesized by the user can be visually viewed.

In addition, the gate control unit 620 searches for temperature information corresponding to the face ID information using face ID information and temperature information input through a separate user input unit (eg, keyboard, mouse, remote control, etc.) (not shown). And a function of controlling the restored image corresponding to the corresponding temperature to be searched or reproduced.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , Processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions may be used. In some cases, such embodiments may be implemented by the gate control unit 620.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. In addition, the software code may be stored in the storage unit 635 and executed by the gate control unit 620.

And, the power supply unit 625 is each of the above-described parts, that is, chest displacement detection unit 605, heart rate / breathing state acquisition unit 610, skin temperature state acquisition unit 615, gate control unit 620, respiratory quality analysis unit 630, storage unit 635, communication unit 640, data receiving unit 645, real image restoration unit 650, face detection processing unit 655, face information storage unit 660, face recognition processing unit 665 , The image synthesizing unit 670, and/or the data storage unit 675, and the like, performing a function of supplying necessary power. For continuous power supply, commercial alternating current (AC) power (eg, AC 220V) is applied to a direct current ( It is preferable to implement it to be converted to DC) and/or alternating current (AC) power, but is not limited thereto, and may be implemented including a conventional portable battery.

In addition, the power supply unit 625 may include a power management unit (not shown) that protects components from external power shock and outputs a constant voltage. The power management unit may include an Electro Static Damage (ESD) protector, a power detector, a rectifier, and a power circuit breaker.

Here, the ESD protector is configured to protect electronic components from static electricity or sudden power shock. The power detector is configured to transmit a cutoff signal to the power circuit breaker when a voltage outside the allowable voltage range is introduced, and to transmit a boost or step down signal to the rectifier according to a voltage change within the allowable voltage range. The rectifier is configured to perform a step-up or step-down rectification operation according to a signal from the power detector so that a constant voltage is supplied by minimizing a fluctuation of the input voltage. The power circuit breaker is configured to cut off power supplied from the battery according to the blocking signal transmitted from the power detector.

Additionally, the respiratory quality analysis unit 630 acquires the interval between breaths together with the cycle of inhalation or exhalation in the breathing process based on the change in the chest displacement of each passerby detected from the chest displacement detection unit 605. It performs the function of analyzing the state information of the quality of breath for each of the passengers.

That is, the respiratory quality analysis unit 630 may observe the cycle of inhalation or exhalation during the breathing process, and measure the interval between breaths, so that the quality of breathing is deteriorated. In addition to measuring the prolonged exhalation time, it is also possible to analyze the quality of sleep by measuring the time at which the chest displacement does not change.

According to the control of the gate control unit 620, the storage unit 635 is the change state information for the chest displacement of each passer-by, the heart rate of each passer-by, hyperventilation and/or tachypnea status information, and inhalation/inhalation for each passer-by. It performs a function of storing at least one of the state information of the interval between breaths, the state information of the breathing quality for each passenger, and/or the state information of the skin temperature of each passenger along with the cycle of exhalation.

Such a storage unit 635 is, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory). Etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), It may include at least one type of storage medium among magnetic memory, magnetic disk, and optical disk.

According to the control of the gate control unit 620, the communication unit 640 includes change state information on the chest displacement of each passer-by, heart rate of each passer-by, hyperventilation and/or tachypnea status information, and inhalation/exhalation for each passer-by. Transmitting at least one of the status information between breathing intervals, breathing quality status information for each passer-by, and/or skin temperature status information of each passer-by with the cycle of Performs a function.

In addition, the communication unit 640 includes image compression data received from the data receiving unit 645 under the control of the gate control unit 620, facial image feature information extracted from the face recognition processing unit 665, and face classification for the corresponding facial image feature. And face ID information and/or image information synthesized from the image synthesizing unit 670 through the communication network 10 to an external terminal 20 and/or a server (e.g., passenger management It can perform a function of transmitting to the server (2000), etc.).

In addition, the communication unit 640 is a separate face information storage unit 660 through the face recognition processing unit 665, the face classification and face ID information for the facial image feature extracted from the face recognition processing unit 665 does not exist. In this case, face image feature information for face classification that does not exist in the face information storage unit 660 is received from the face recognition processing unit 665 under the control of the gate control unit 620, and an external terminal ( 20) and/or a server (eg, a passenger management server 2000, etc.).

The communication unit 640 is preferably implemented to be wired and/or wireless communication through the communication network 10, but is not limited thereto, and the wireless communication method is, for example, Bluetooth communication, ZigBee communication, UWB (Ultra Wideband) communication, RFID (Radio Frequency Identification) communication, or infrared (IR) communication may be implemented to any one of short-range wireless communication.

On the other hand, the communication network 10 is a communication network, which is a high-speed backbone network of a large communication network capable of large-capacity, long-distance voice and data services, and Wi-Fi, WiGig, for providing Internet or high-speed multimedia services. It may be a next-generation wireless communication network including Wibro (Wireless Broadband Internet, Wibro), Wimax (World Interoperability for Microwave Access, Wimax), and the like.

The Internet is a TCP/IP protocol and various services that exist in the upper layer, namely HTTP (Hyper Text Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), It refers to a global open computer network structure that provides Simple Network Management Protocol (SNMP), Network File Service (NFS), Network Information Service (NIS), etc., and the communication unit 640 is an external terminal 20 and/or server Provides an environment that allows access to (Server) (for example, a passenger management server 2000, etc.). Meanwhile, the Internet may be a wired or wireless Internet, or may be a core network integrated with a wired public network, a wireless mobile communication network, or a portable Internet.

If the communication network 10 is a mobile communication network, it may be a synchronous mobile communication network or an asynchronous mobile communication network. As an embodiment of the asynchronous mobile communication network, a wideband code division multiple access (WCDMA) communication network may be used. In this case, although not shown in the drawing, the mobile communication network may include, for example, a Radio Network Controller (RNC). Meanwhile, although the WCDMA network was exemplified, it may be a next-generation communication network such as a cellular 3G network, an LTE network, a 4G network, and a 5G network, and other IP-based IP networks. The communication network 10 serves to mutually transmit signals and data of the communication unit 640 and the external terminal 20 and/or a server (eg, a passenger management server 2000).

The data receiving unit 645 performs a function of receiving temperature data for a corresponding face detection location along with image compression data, face detection location and size data transmitted from the heat detection module 800 under the control of the gate control unit 620 do.

The real image restoration unit 650 performs a function of restoring the compressed image data received from the data receiving unit 645 into an original image under the control of the gate controller 620.

The face detection processing unit 655 is a function of acquiring a face image from an image restored from the real image restoration unit 650 according to the face detection position and size information received from the data receiving unit 645 under the control of the gate control unit 620 Perform.

The face information storage unit 660 performs a function of storing and managing face classification and face ID information into a database (DB) for each face image feature under the control of the gate control unit 620.

The face recognition processing unit 665 receives the face image obtained from the face detection processing unit 655 under the control of the gate controller 620, and receives reference information from the face image acquired through image and data processing based on artificial intelligence machine learning. For example, a landmark, etc.) is extracted, facial image features are extracted using the extracted reference information, and face classification and face ID information for the corresponding facial image features extracted through the face information storage unit 660 are stored. It performs the function of searching and extracting.

Here, the artificial intelligence (AI) machine learning is, for example, at least one artificial intelligence learning method among a neural network, a support vector machine (SVM), a multi-layer perception (MLP), and/or deep learning. It is preferably made of.

The image synthesizing unit 670 converts the face ID information extracted from the face recognition processing unit 665 and temperature information on the corresponding face detection position to the image restored from the real image restoration unit 650 under the control of the gate control unit 620. It performs the function of synthesizing.

The data storage unit 675 includes image compression data received from the data receiving unit 645 under the control of the gate control unit 620, face detection location and size information, and temperature information on the corresponding face detection location, and a face recognition processing unit 665. ) Extracted from the facial image feature information, face classification and face ID information for the corresponding facial image feature, and/or image information synthesized from the image synthesizing unit 670 into a database (DB) and store and It performs the function to manage.

Additionally, the image acquisition module 700 is installed at the entrance and/or exit side of the entrance gate module 100, and Performs a function of acquiring image data.

The real image camera 750 of the image acquisition module 700 preferably includes an infrared (IR) camera or a charge coupled device (CCD) camera capable of photographing in a dark place, but is not limited thereto. In addition, as a type of normal PC camera, the most commonly used USB (Universal Serial Bus) camera, a general video camera capable of shooting continuous video, a camera or device capable of shooting images of a specific place Anything is possible (eg, IP camera, CCTV camera, etc.).

At this time, the solid-state imaging device (CCD) camera is composed of an optical unit, a solid-state imaging device (CCD), and a driving unit that drives the same, and acquires bitmap data input to the solid-state imaging device (CCD) through the optical unit. The bitmap data may include both image data of a still image and moving image data.

In addition, the USB camera is basically composed of a camera, an interface unit, a USB host, and the like, and a plurality of endpoints are configured between the camera and the interface unit, one of which is a snapshot dedicated endpoint. And the other is used as a video-only endpoint.

The USB camera processes the input image as digital data and outputs it to the interface unit, the interface unit converts the digital data input through the endpoint according to USB standard specifications and transmits it to the USB host. It displays digital data on its own monitor or transmits it to the other's USB host for image communication.

Meanwhile, although not shown in the drawing, the image acquisition module 700 typically includes a real image sensor, that is, an image sensor, an image signal processor (ISP), and a back-end chip. Includes.

The image sensor outputs an image signal formed by light incident from the lens as unprocessed Bayer RGB format data. The image signal processor (ISP) converts the Bayer RGB format data into RGB format data, converts it into YUV format data required for screen output of a display device, and outputs the converted data.

The back-end chip is in charge of controlling a camera module including processing the YUV format data output from the image signal processor (ISP) and outputting a photographed image through the screen of the display device. A mobile switching modem (MSM) or a digital signal processor (DSP) may be used.

That is, when photographing using the image acquisition module 700, the image sensor unprocessed Bayer RGB format data is communicated in an IIC (Inter Integrated Circuit) method according to the image pickup signal formed by the light incident from the lens. The image signal processor (ISP) that outputs and receives it converts it into actual RGB format data, and converts the RGB format data to the YUV format required for display screen output, that is, required by the back-end chip for image processing. Converts to data and outputs it using IIC (Inter Integrated Circuit) communication. Then, the back-end chip processes the received YUV format data and outputs a captured image through the screen of the display device.

The heat detection module 800 receives the image data acquired from the image acquisition module 700 and the measured temperature data extracted from the passenger temperature measurement module 300, based on the image compression data, the face detection position and size data, and Together, it extracts and transmits temperature data for the corresponding face detection location.

As shown in FIG. 6, the heat detection module 800 compresses the image data acquired from the image acquisition module 700 to output the image compressed data, and the image acquisition module 700 Each of the image data obtained from and measured temperature data extracted from the passenger temperature measurement module 300 is provided, and through artificial intelligence machine learning-based image and data processing, the face detection position and size data as well as the corresponding face detection position are The heat detection unit 820 for extracting temperature data, the image compression data output from the image compression unit 810, and the face detection location and size data extracted from the heat detection unit 820 together with the corresponding face detection location. It is preferable to include a data processing unit 830 that transmits temperature data to the gate control unit 520 or the like.

In addition, the passenger management server 2000 is connected to each gate device 1000-1 to 1000-N and/or an external terminal 20 through the communication network 10, and each gate device 1000-1 to 1000-N) is provided with a signal related to biometric information on the respiratory rate and/or heart rate of each passer-by, based on this, detects a change in the chest displacement of each passer-by, and detects a change in the chest displacement of each passer-by. It performs the function of analyzing the heart rate, hyperventilation, and/or tachypnea of each passenger according to the change in chest displacement.

In addition, the passer-by management server 2000 stores and manages at least one of the heart rate, respiration rate, hyperventilation, and/or tachypnea status of each passer analyzed for each gate device in a database (DB). In addition, it performs a function of providing a service so that the manager can visually monitor at least one of the heart rate, respiration rate, hyperventilation, and/or tachypnea status of each passer-by in real time.

In addition, the passer-by management server 2000 receives measurement temperature data of each passer-by extracted from each gate device (1000-1 to 1000-N) and measures the extracted person area for a preset temperature extraction time based on this. By analyzing the temperature data pattern, it performs a function of acquiring skin temperature status information of each passenger.

In addition, the passer-by management server 2000 stores and manages the skin temperature status information of each passer-by acquired by each gate device into a database (DB), while the administrator visually monitors the skin temperature status of each passer-by in real time. It performs the function of providing a service so that it can be done.

In addition, the passenger management server 2000 is based on the change in the chest displacement of each passenger detected from each gate device (1000-1 to 1000-N), along with a cycle of inhalation or exhalation in the breathing process. By acquiring the interval between breaths, it is possible to perform the function of analyzing the quality of breathing for each passenger.

That is, the passer-by management server 2000 observes the cycle of inhalation or exhalation during the breathing process and measures the interval between breaths, so that the quality of breathing is deteriorated. In addition to measuring the prolonged exhalation time, it is also possible to analyze the quality of sleep by measuring the time at which the chest displacement does not change.

In addition, the passer-by management server 2000 includes change state information on the chest displacement of each passer-by, heart rate of each passer-by, hyperventilation and/or tachypnea status information, and inhalation/exhalation cycles for each passer-by. Change status information on chest displacement for each gate device and/or for each passer-by based on at least one of the status information of the interval between breaths and/or the quality of breathing for each passer-by, heart rate , Hyperventilation and/or tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and/or breathing quality status information into a database (DB) to convert at least one status information into a separate storage device (2500 ) Can perform the function of providing services to be stored and managed.

In addition, the passer-by-passer management server 2000 allows the administrator to change state information for the chest displacement for each passer-by, heart rate, hyperventilation and/or tachypnea status information, inhalation/exhalation cycles, and inter-breathing interval status information, and/ Alternatively, it may perform a function of providing a service to be displayed on a display screen so that at least one of the state information of the quality of breath can be visually confirmed.

In addition, the passer-by management server (2000) is the change status information for the chest displacement for each passer-by, heart rate, hyperventilation and/or tachypnea status information, inhalation/exhalation cycles and inter-breathing interval status information, and/or breathing. A service can be provided so that at least one of the quality status information is transmitted to the external terminal 20 through the communication network 10 in a wired and/or wireless communication method.

In addition, the passer-by management server 2000 receives signals related to biometric information on the respiratory rate and/or heart rate of each passage detected from each gate device (1000-1 to 1000-N), and When the respiratory rate of the passerby is extracted, and the extracted respiratory rate is less than the preset minimum standard breathing rate and/or more than the preset maximum standard breathing rate while continuing for more than a preset breathing reference duration, a preset breathing rate bio-abnormality notification message is displayed. In addition to the creation, a monitoring service is provided so that the administrator can visually view the respiratory rate bio-abnormality notification message on the display screen, or provide a respiratory rate bio-abnormality notification message for each passer by hourly and/or daily and/or It is possible to perform a function of providing a service to be stored and managed in a separate storage device 2500 by converting into a database (DB) for each day of the week and/or weekly and/or monthly.

In addition, the passer-by management server 2000 receives signals related to biometric information on the respiratory rate and/or heart rate of each passer-by detected from each gate device (1000-1 to 1000-N). Extracts the patient's heart rate, and generates a preset heart rate bio-abnormality notification message when the extracted heart rate is less than a preset minimum reference heart rate and/or more than a preset maximum reference heart rate while continuing more than a preset heart rate reference duration. In addition, it provides a monitoring service to be displayed on the display screen in real time so that the administrator can visually see the heart rate bio-abnormality notification message, or the heart rate bio-abnormality notification message for each passer-by by hour and/or by day and/or by day of the week and/ Alternatively, a function of providing a service to be stored and managed in a separate storage device 2500 by making a database (DB) weekly and/or monthly may be performed.

In addition, the passenger management server 2000 may perform a function of providing a cloud computing service in response to a request from an external terminal 20 (preferably, a client terminal).

That is, the passenger management server 2000 is connected to a plurality of terminals 20 possessed by the administrator on the network through the communication network 10 and provides system resources (such as OS, CPU, memory, storage device) to the plurality of terminals 20. It is a physical device that provides), and in a cloud service environment, a plurality of servers are connected to a plurality of terminals 20 on a network, and at this time, the passenger management server 2000 includes a plurality of servers. It is illustrated as a concept, and for example, a plurality of terminals 20 are distributed so that system resources can be used through a guest machine in a virtual space created through a virtualization technology. These matters can be understood as well-known general concepts.

In this case, the cloud service environment means Internet-based (cloud) computing technology. This cloud computing is a computer network diagram that expresses the Internet as a cloud, has a hidden complex infrastructure structure, and has a computing style in which IT-related functions are provided in the form of a service. Users can use the Internet to access services provided by cloud computing.

In addition, the cloud computing is applied by mixing various computing concepts and communication technologies such as virtualization computing, utility computing, on-demand computing, etc. It refers to a technology that implements a single virtual computer or service by integrating with it, and provides various software, security solutions, and computing capabilities in an on-demand manner by accessing the user.

That is, the cloud computing is'on-demand outsourcing service of IT resources through the Internet', and stores programs or documents that were individually stored on personal computers or corporate servers in an Internet-based virtual server or storage. And, by running a cloud application such as a web browser using various terminals including a personal computer, a user can perform a desired task.

At this time, users can select and use computing resources such as cloud applications, storage, OS, and security as much as they want at a desired time and pay a price based on usage.

The passenger management server 2000 as described above may perform a function of providing a cloud computing service in response to a request from at least one external terminal 20.

That is, the passenger management server 2000 is a server that provides a cloud computing service to at least one external terminal 20, and provides a computing resource requested by the at least one external terminal 20 through the communication network 10. Provides. The passenger management server 2000 may provide a computing service for using a device requested by at least one external terminal 20.

The passenger management server 2000 includes, for example, an application program file, a game program file, a text data file, a document file, a picture file, a music file, a video file, a barcode file, etc. from a provider (content provider) that provides large-capacity data. It includes a plurality of storage devices that store provided files, that is, storage.

In addition, the passer-by management server (2000) is the change status information for the chest displacement for each passer-by, heart rate, hyperventilation and/or tachypnea status information, inhalation/exhalation cycles and inter-breathing interval status information, and/or breathing. When at least one of the health status information is stored in a database (DB), change status information on the chest displacement for each passenger, heart rate, hyperventilation and/or tachypnea status information by using a symmetrical or asymmetric encryption method , At least one of the state information of the interval between breaths, and/or the quality of breathing, along with the period of inhalation/exhalation, is encrypted and stored, as well as the encrypted state information on the change of chest displacement for each passer-by, heart rate. , Hyperventilation and/or tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and/or breathing quality status information. ) (Preferably, the client terminal) can perform a function of providing a service to be transmitted.

In addition, the passer-by-passenger management server 2000 includes the change state information for the chest displacement for each passer-by through the terminal 20 (preferably, a client terminal) of the wah-bu, heart rate, hyperventilation and/or tachypnea status information, inhalation/ It is possible to perform a function of providing a cloud web service so that at least one of state information between breathing intervals and/or quality of breathing may be downloaded along with the period of exhalation.

In addition, the passer-by management server 2000 includes change state information on the chest displacement for each passer-by transmitted from the communication unit 640 through a pre-installed passer-by-passer condition measurement-related application, heart rate, hyperventilation and/or tachypnea status information, Along with the cycle of inhalation/exhalation, at least one of status information between breathing intervals, breathing quality status information, and/or skin temperature status information is received and based on this, a line, circle, and/or bar according to the user's request. Using at least one of the graphs hourly and/or daily and/or weekly and/or weekly and/or monthly change state information on the chest displacement of each passenger, heart rate, hyperventilation and/or tachypnea state information, It is possible to perform a function of providing a service so that at least one of status information between breathing intervals, breathing quality status information, and/or skin temperature status information is displayed on the display screen along with the inhalation/exhalation cycle.

In addition, the passenger management server 2000 receives facial image feature information for face classification that does not exist in the face information storage unit 660 from the face recognition processing unit 665 through the communication unit 640, Face ID information for face classification that does not exist in the face information storage unit 660 is extracted through a face classification DB (not shown), and the extracted face ID information and temperature information are synthesized in the restored image, and displayed on the display screen. You can perform the function of printing.

In addition, the passenger management server 2000 uses face ID information and temperature information input through a separate user input module (not shown) to search for temperature information corresponding to the face ID information and restore corresponding to the temperature. It may perform a function of providing a service so that the searched or reproduced video can be performed.

In addition, the external terminal 20 is transmitted from the communication unit 640 and/or the passer-by-passenger management server 2000 through a pre-installed passer-by-passenger condition measurement-related application. User's request based on at least one status information among hyperventilation and/or tachypnea status information, interval between breathing status information, breath quality status information, and/or skin temperature status information along with inhalation/exhalation cycles According to at least one graph of line, circle and/or bar graph according to hourly and/or daily and/or weekly and/or weekly and/or monthly, change state information for the chest displacement of each passer-by, heart rate, Provides a service to display at least one of hyperventilation and/or tachypnea status information, breathing interval status information, breathing quality status information, and/or skin temperature status information along with inhalation/exhalation cycles on the display screen. You can perform the function that you do.

In addition, the external terminal 20 receives facial image feature information for face classification that does not exist in the face information storage unit 660 from the face recognition processing unit 665 through the communication unit 640, and Face ID information for face classification that does not exist in the face information storage unit 660 is extracted through the classification DB (not shown), and the extracted face ID information and temperature information are synthesized in the restored image and output on the display screen. You can perform the function that you do.

In addition, the external terminal 20 uses face ID information and temperature information input through a separate user input module (not shown) to search for temperature information corresponding to the face ID information and restore the temperature information corresponding to the corresponding temperature. It may perform a function of providing a service so that an image can be searched or reproduced.

In addition, the external terminal 20 (preferably, the client terminal) uses the client member login cloud web service of the passenger management server 2000, and the chest displacement for each corresponding passenger analyzed from the passenger management server 2000 Retrieval and display of at least one status information of change status information, heart rate, hyperventilation and/or tachypnea status information, interval between breathing status information with inhalation/exhalation cycle, and/or quality of breath status information in real time You can perform the function to display on the screen.

In addition, the external terminal 20 (preferably, the client terminal) is encrypted and stored in the passenger management server 2000 using the decryption key transmitted from the passenger management server 2000 together with the corresponding client member login information. At least one of state information of change in chest displacement for each passer-by, heart rate, hyperventilation and/or tachypnea state information, inhalation/exhalation period and interbreathing interval state information, and/or breathing quality state information. It can perform a function of decoding, searching it in real time, and displaying it on the display screen.

In addition, the external terminal 20 (preferably, the client terminal) is stored in the passenger management server 2000 through the passenger condition measurement related application downloaded from the passenger management server 2000. At least one of status information of change status, heart rate, hyperventilation and/or tachypnea status information, interval between breaths with inhalation/exhalation cycle, and/or quality of breath status information is searched and displayed in real time on the display screen. It can perform the function of displaying.

The external terminal 20 is preferably made of at least one mobile terminal device among a smart phone, a smart pad, or a smart note communicating through wireless Internet or portable Internet, In addition, personal PCs, notebook PCs, Palm PCs, mobile play-stations, digital multimedia broadcasting (DMB) phones with communication functions, tablet PCs, and communication networks 10 and/or All wired/wireless home appliances/communication devices having a user interface for accessing the passer-by management server 2000 may be generically meant.

That is, the external terminal 20 is a wireless communication module 21, an audio/video (A/V) input module 22, a user input module 23, and a sensing module 24, as shown in FIG. 7. , An output module 25, a storage module 26, an interface module 27, a terminal control module 28, a power module 29, and the like. Meanwhile, since the components shown in FIG. 7 are not essential, the external terminal 20 may have more components or fewer components.

Hereinafter, a detailed look at the components of the external terminal 20 are as follows.

The wireless communication module 21 may include one or more modules that enable wireless communication between the external terminal 20 and the passenger management server 2000. For example, the wireless communication module 21 may include a broadcast reception module 21a, a mobile communication module 21b, a wireless Internet module 21c, a short-range communication module 21d, and a location information module 21e.

The broadcast receiving module 21a broadcasts broadcast signals (eg, TV broadcast signals, radio broadcast signals, data broadcast signals, etc.) and/or broadcasts from an external broadcast management server through various broadcast channels (eg, satellite channels, terrestrial channels, etc.). Receive related information.

The mobile communication module 21b transmits and receives a radio signal with at least one of a base station, an external terminal 20, and a server on a mobile communication network. The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission and reception of text/multimedia messages.

The wireless Internet module 21c is a module for wireless Internet access, and may be built in or external to the external terminal 20. As the wireless Internet technology, for example, WLAN (Wi-Fi), Wibro, Wimax, HSDPA, LTE, and the like may be used.

The short-range communication module 21d is a module for short-range communication, for example, Bluetooth communication, ZigBee communication, Ultra Wideband (UWB) communication, Radio Frequency Identification (RFID) communication, or infrared data association (IrDA). ) Communication, etc. can be used.

The location information module 21e is a module for checking or obtaining the location of the external terminal 20, and may obtain current location information of the external terminal 20 using a Global Position System (GPS) or the like.

On the other hand, by using a specific application program stored in the storage module 26 through the above-described wireless communication module 21 and/or a wired communication module (not shown) under the control of the terminal control module 28, the passenger management server ( 2000) and data transmission/reception can be performed.

The A/V input module 22 is a module for inputting an audio signal or a video signal, and may basically include a camera unit 22a and a microphone unit 22b. The camera unit 22a processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a photographing mode. The microphone unit 22b receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc. and processes it as electrical voice data.

The user input module 23 is a module that generates input data for controlling the operation of the external terminal 20, and in particular, it is applied to any one of the data management information displayed through the display unit 25a of the output module 25. Performs a function of inputting a selection signal for, for example, a touch panel input by a user's touch (positive pressure/power failure), or using a separate input device (e.g., a keypad dome switch, a jog wheel, a jog switch, etc.) Can be entered.

The sensing module 24 is the open/closed state of the external terminal 20, the location of the external terminal 20, the presence or absence of user contact, the user's touch motion to a specific part, the orientation of the external terminal 20, the external terminal A sensing signal for controlling the operation of the external terminal 20 is generated by detecting the current state of the external terminal 20, such as acceleration/deceleration of (20). Such a sensing signal is transmitted to the terminal control module 28, and may serve as a basis for the terminal control module 28 to perform a specific function.

The output module 25 is a module for generating output related to visual, auditory or tactile sense, and basically includes a display unit 25a, an audio output unit 25b, an alarm unit 25c, and a haptic unit 25d. I can.

The display unit 25a is for displaying and outputting information processed by the external terminal 20, for example, when the external terminal 20 is in a call mode, a user interface (UI) or a graphical user interface (GUI) related to a call ), and in the case of a video call mode or a photographing mode, a photographed and/or received image, UI, or GUI is displayed.

The sound output unit 25b may output audio data received from the wireless communication module 21 or stored in the storage module 26 in, for example, a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, etc. .

The alarm unit 25c may output a signal for notifying the occurrence of an event of the external terminal 20. Examples of events occurring in the external terminal 20 include call signal reception, message reception, key signal input, and touch input.

The haptic unit 25d generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic unit 25d is vibration. The intensity and pattern of the vibration generated by the haptic part 25d can be controlled.

The storage module 26 may store a program for the operation of the terminal control module 28 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.).

In addition, the storage module 26 may store data related to vibrations and sounds of various patterns that are output when a touch input on the touch screen is input, and may store an application program related to measuring a traffic condition.

In addition, the storage module 26 may store source data for formation of information related to passenger condition measurement, and the data related to passenger condition measurement may be formed in a form consisting of images and sounds. The process and result of the generation of related data may also be stored.

The storage module 26 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM, SRAM, ROM, EEPROM, and PROM. , A magnetic memory, a magnetic disk, and an optical disk.

The interface module 27 serves as a passage for all external devices connected to the external terminal 20. The interface module 27 receives data from an external device or receives power and transmits it to each component inside the external terminal 20 or transmits data inside the external terminal 20 to an external device.

The terminal control module 28 generally controls the overall operation of the external terminal 20, and performs related control and processing for, for example, a voice call, data communication, video call, and execution of various applications.

That is, the terminal control module 28 controls to execute an application program related to passenger condition measurement stored in the storage module 26, and generates data related to passenger condition measurement through execution of the application program related to passenger condition measurement. It performs the function of controlling so that it can request and receive data related to measuring the condition of passengers.

In addition, the terminal control module 28 displays auxiliary elements including at least one of video, audio, and sound in the process of generating the data related to the user's desired passenger condition through the execution of the application program related to the passenger condition measurement. (25a) and other output devices (eg, the sound output unit 25b, the alarm unit 25c, the haptic unit 25d, etc.) to perform a control to be output through at least one.

In addition, the terminal control module 28 may monitor the charging current and the charging voltage of the battery unit 29a at all times, and temporarily store the monitoring value in the storage module 26. At this time, it is preferable that the storage module 26 stores not only battery charging status information such as monitored charging current and charging voltage, but also battery specification information (product code, rating, etc.).

The power module 29 receives external power and internal power under the control of the terminal control module 28 to supply power necessary for the operation of each component. The power module 29 operates by supplying power from the built-in battery unit 29a to each component, and charging the battery is possible using a charging terminal (not shown).

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , Processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions may be used. In some cases such embodiments may be implemented by the terminal control module 28.

According to a software implementation, embodiments such as procedures or functions may be implemented together with separate software modules that perform at least one function or operation. The software code can be implemented by a software application written in an appropriate programming language. Further, the software code is stored in the storage module 26 and can be executed by the terminal control module 28.

If the external terminal 20 is made of a smartphone, the smartphone can freely use and delete various application programs desired by the user, unlike a general mobile phone (a feature phone). As a phone based on an open operating system that is possible, not only functions such as voice/video calls and Internet data communication, which are commonly used, but also all mobile phones with mobile office functions or all Internet that do not have voice call functions but can access the Internet It is preferable to understand it as a communication device including a phone or tablet PC.

As described above, since a smartphone uses an open operating system, unlike a mobile phone having a closed operating system, a user can arbitrarily install and manage various application programs.

Although a preferred embodiment of the passenger monitoring system using the gate device according to the present invention has been described above, the present invention is not limited thereto, but variously within the scope of the claims and the detailed description of the invention and the accompanying drawings. It is possible to change and implement, and this also belongs to the present invention.

1000-1 to 1000-N: gate device,
100: entrance gate module,
200: passenger heart rate/respiration measurement module,
300: passenger temperature measurement module,
400: power supply module,
500: display module,
600: gate control module,
700: image acquisition module,
800: heat detection module,
2000: Passer management server

Claims (40)

It is installed at the entrance/exit of a gate provided in a building or airport facility, and detects a signal related to biometric information about the respiratory rate and heart rate of at least one passerby existing at the entrance/exit of the gate through a radar in a non-contact manner. In addition, at least one gate device for acquiring temperature data around the entrance/exit of the corresponding gate through a thermal imaging camera and extracting measured temperature data of each passer-by; And
Receives signals related to biometric information on the respiratory rate and heart rate of each passer-by detected from each gate device, detects a change in the chest displacement of each passer-by based on this, and determines the detected chest displacement of each passer-by. After analyzing the heart rate, hyperventilation, and tachypnea of each passer according to the change in data, the heart rate, respiration rate, hyperventilation, and tachypnea status information of each passer-by analyzed by each gate device is stored and managed in a database. Provides a service to visually monitor the heart rate, respiration rate, hyperventilation and tachypnea status of each passer-by in real time, and receives the measured temperature data of each passer-by extracted from each gate device and receives a preset temperature based on this After obtaining the skin temperature status information of each passerby by analyzing the measured temperature data pattern of the human area extracted during the extraction time, the skin temperature status information of each passer-by acquired for each gate device is converted into a database and stored and managed. In addition, it includes a passenger management server that provides a service so that the administrator can visually monitor the skin temperature condition of each passenger in real time,
Each gate device is installed at the entrance/exit of a gate provided in a building or airport facility, and is installed at the entrance/exit of the entrance/exit of the entrance gate module and the entrance gate module provided to allow at least one passer-by. A passer's heart rate/respiration measurement module that non-contactly detects signals related to biometric information on the respiratory rate and heart rate of each passer existing at the entrance/exit of the corresponding gate, and is installed at the entrance/exit of the gate module. A passenger temperature measurement module that acquires temperature data around the entrance/exit of the corresponding gate through a thermal imaging camera and extracts the measured temperature data of each passenger, and information on the heart rate/breathing status and skin temperature status of each passenger. A display module that visually displays, and an image acquisition module that is installed at the entrance/exit of the gate module and acquires image data about the entrance/exit of the entrance gate module through a real image camera, and the image acquisition Receives the image data obtained from the module and the measured temperature data extracted from the passenger temperature measurement module, and extracts and transmits the temperature data for the corresponding face detection location along with image compression data, face detection location and size data based on this. Receives signals related to biometric information on the respiratory rate and heart rate of each passenger measured from the heat detection module and the passenger's heart rate/respiration measurement module, and detects a change in the chest displacement of each passenger based on this, After analyzing the heart rate, hyperventilation, and tachypnea of each passer according to the detected chest displacement of each passer-by, display so that the user can visually check the analyzed heart rate, hyperventilation, and tachypnea status information of each passer-by. Controls the operation of the display module to be displayed on the screen, and receives the measured temperature data of each passer-by extracted from the passer-by temperature measurement module, and based on this, the measured temperature data pattern of the person region extracted during a preset temperature extraction time After analyzing the skin temperature status information of each passer-by, the obtained skin temperature of each passer-by Controls the operation of the display module to be displayed on the display screen so that state information can be visually confirmed, and temperature data for the corresponding face detection location along with image compression data, face detection location and size data transmitted from the heat detection module Receiving and restoring the compressed image data to the original image based on this, obtaining a face image from the restored image according to the face detection location and size information, and using the reference information extracted from the obtained face image In addition to extracting features, the operation of the display module is performed to extract face classification and face ID information for pre-stored facial image features, and to synthesize the extracted face ID information and temperature information in the restored image to be displayed on the display screen. Including a gate control module to control,
The passenger heart rate/respiration measurement module includes a radar transmitter for transmitting a first signal having a radar pulse for each of the passengers present at the entrance/exit of a gate provided in the entrance gate module, and the The first signal transmitted from the radar transmitter is reflected from each of the passengers, and the radar receiver receives a second signal related to the first signal, and the phase changes at a preset angle for each of a plurality of transmission antennas provided in the radar transmitter. Based on the first and second signals transmitted and received from the radar transmitter and the radar receiver, and a passer-by tracking unit that tracks a plurality of passers using a beam steering technology that can give a signal, the breath of each passer-by And a signal processing unit that extracts a frequency including motion information about a heart rate, and processes a signal related to biometric information about the respiratory rate and heart rate of each passer-by according to the phase change of the extracted frequency,
The signal processing unit converts data of a second signal, which is a reflected electromagnetic wave, into a frequency domain through Fast Fourier Transform (FFT), and includes a frequency in a frequency domain corresponding to a preset frequency range among the converted frequency domains. The peak value is detected, the phase value of the frequency over time is obtained by using the peak value of the detected frequency, and when the electromagnetic wave of the first signal transmitted from the radar transmitter is reflected and returned, it is reflected through the radar receiver. It collects data on a second signal that is a plurality of reflected electromagnetic waves that are returned, acquires only data of the same frequency band among the collected second signals that are reflected electromagnetic waves, and converts the acquired data of the same frequency band to a high-speed Fourier transform ( FFT) to convert to a frequency domain, extract frequencies related to respiratory rate and heart rate from the converted frequency domain, convert the converted frequency domain to a time domain to detect a peak value, and detect a peak value between the detected peak values. By measuring the distance, a correlation coefficient for the heart rate of each passenger is calculated, and when the phase difference between successive values for the extracted frequency is greater than or less than ±π, 2π is added or subtracted from the phase to unwrapping (Phase Unwrapping). ), the phase difference (Phase Difference) operation of subtracting the continuous phase value for the phase unwrapped phase is processed, and spectrum estimation is performed on the phase unwrapped and phase difference-processed frequencies. Determine the respiratory rate and heart rate of the passerby, generate a correlation equation of the respiratory rate with respect to the frequency peak using the frequency related to the extracted respiratory rate, and in the preset respiratory rate frequency range from the frequency related to the extracted respiratory rate. Based on the included frequency data, the respiratory rate of each passer is determined, a correlation equation of the heart rate for the frequency peak is generated using the frequency related to the extracted heart rate, and preset at the frequency related to the extracted heart rate. In the heart rate frequency domain Based on the included frequency data, the heart rate of each passer is determined, a frequency including movement information on the breathing and heart rate of each passer-by tracked from the passer-by tracking unit is extracted, and the phase of the extracted frequency Processes signals related to biometric information about the respiratory rate and heart rate of each passenger according to the change,
The heat detection module includes an image compression unit for compressing the image data acquired from the image acquisition module and outputting image compression data, the image data acquired from the image acquisition module, and a measurement temperature extracted from the passenger temperature measurement module. A heat detection unit that receives each data and extracts temperature data for the face detection location along with face detection location and size data through artificial intelligence machine learning-based image and data processing, and image compression output from the image compression unit A data processing unit that transmits temperature data for a corresponding face detection location along with data and face detection location and size data extracted from the heat detection unit,
The gate control module receives signals related to biometric information on the respiratory rate and heart rate of each passer measured from the passer's heart rate/respiration measurement module, and detects a change in the chest displacement of each passer based on this. A heart rate that analyzes the heart rate, hyperventilation, or tachypnea status of each passer-by according to the change in the chest displacement of each passerby detected from the chest displacement detection unit and the chest displacement detector to obtain the heart rate/breathing status information of each passer-by. /A breathing state acquisition unit receives the measured temperature data of each passer-by extracted from the passer-by temperature measurement module and analyzes the measured temperature data pattern of the person area extracted for a preset temperature extraction time based on this. The interval between breaths along with a cycle of inhalation or exhalation during the breathing process based on a skin temperature status acquisition unit that acquires skin temperature status information of a child, and a change in the chest displacement of each passenger detected by the chest displacement detection unit. A respiratory quality analysis unit that analyzes the state information of the breathing quality for each passerby by acquiring the data, and the change state information on the chest displacement of each passer-by, the heart rate of each passer-by, hyperventilation and tachypnea status information, and each A storage unit that stores the status information of the interval between breaths, the status information of the breathing quality for each passer-by, and the skin temperature status information of each passer-by, along with the cycle of inhalation/exhalation for the passer-by, and from the heat detection module A data receiving unit that receives the transmitted image compressed data, face detection position and size data, and temperature data for a corresponding face detection position, and a real image restoration unit that restores the compressed image data received from the data receiving unit to an original image. , A face detection processing unit that acquires a face image from an image restored from the real image restoration unit according to the face detection position and size information received from the data receiving unit, and the face classification and face ID information for each face image feature are converted into a database and stored. And a managing face information storage unit, and artificial intelligence by receiving a face image obtained from the face detection processing unit. Reference information is extracted from the face image obtained through machine learning-based image and data processing, and facial image features are extracted using the extracted reference information, and the facial image features extracted through the face information storage unit are A face recognition processing unit that searches and extracts face classification and face ID information for, and an image that combines face ID information extracted from the face recognition processing unit and temperature information on a corresponding face detection location with an image restored from the real image restoration unit. A synthesizing unit, image compression data received from the data receiving unit, temperature information for a corresponding face detection location along with face detection location and size information, facial image feature information extracted from the face recognition processing unit, and a face for the corresponding facial image feature Classification and face ID information, and a data storage unit for storing and managing the image information synthesized from the image synthesizing unit into a database, and change state information on the chest displacement of each passenger, heart rate, hyperventilation, and Tachypnea status information, breathing/exhaling cycles for each passer-by, breathing interval status information, breathing quality status information for each passer-by, and skin temperature status information of each passer by wired or wireless communication method And image compression data received from the data receiving unit, facial image feature information extracted from the face recognition processing unit, face classification and face ID information for the corresponding facial image feature, and image information synthesized from the image synthesizing unit. When at least one piece of information is transmitted to an external terminal or server through a communication network, and there is no face classification and face ID information for the extracted facial image feature in a separate face information storage unit through the face recognition processing unit , A communication unit that receives facial image feature information for a face classification that does not exist in the face information storage unit from the face recognition processing unit and transmits it to the external terminal or server through the communication network, and from the heart rate/breathing state acquisition unit The acquired heart rate/breathing status information and the blood of each passer-by Controls the operation of the display module so that the skin temperature status information of each passer-by acquired from the sub-temperature status acquisition unit is displayed on the display screen so that the user can visually check the corresponding passages analyzed by the respiratory quality analysis unit. It includes a gate control unit for controlling the operation of the display module to be displayed on the display screen so that the user can visually check the state of the breathing quality of the ruler,
The gate control unit includes the detected change status information on the chest displacement of each passenger, heart rate of each passenger, hyperventilation and tachypnea status information, and interval between breaths along with a cycle of inhalation/exhalation for each passenger. Information, state information of the quality of breathing for each passer-by, and skin temperature status information of each passer-by are provided, and based on this, change status information on chest displacement for each passer-by, heart rate, hyperventilation or tachypnea status information , Inhalation/exhalation interval status information, breathing quality status information, and skin temperature status information are databaseized and stored in the storage unit, along with the inhalation/exhalation cycle, and the detected change in the chest displacement of each passer-by Status information, heart rate of each passer-by, hyperventilation and tachypnea status information, inhalation/exhalation cycle for each passer-by, as well as breathing interval status information, breathing quality status information for each passer-by, and each The user receives the status information of the skin temperature of the passer-by, and the user receives the change status information on the chest displacement for each passer-by, the heart rate, hyperventilation and tachypnea status information, the interval status information between breaths along with the inhalation/exhalation cycle, the quality of breathing status information, And controlling the operation of the display module to be displayed on the display screen so that skin temperature status information can be visually confirmed, and the detected change status information on the chest displacement of each passenger, heart rate, hyperventilation and tachy breathing of each passenger. Status information, breathing interval status information for each passer-by, breathing interval status information for each passer-by, and skin temperature status information of each passer-by are provided based on this Wired or wireless communication method of state information of changes in chest displacement for each passer-by, heart rate, hyperventilation and tachypnea status information, interval between breathing status information, breathing quality status information, and skin temperature status information along with inhalation/exhalation cycles. It controls the operation of the communication unit so that it is transmitted to an external terminal or server, and the image data synthesized from the image synthesis unit can be visually viewed by the user. Controls the operation of the display module so that it is displayed on the display screen, and searches for temperature information corresponding to the face ID information and restores corresponding to the temperature using face ID information and temperature information input through a separate user input unit. It controls to search or play back the recorded video,
The external terminal or server may include change state information on chest displacement for each passenger transmitted from the communication unit through a pre-installed passenger condition measurement-related application, heart rate, hyperventilation and tachypnea status information, inhalation/exhalation cycles, and By receiving interval status information between breaths, breathing quality status information, and skin temperature status information, based on this, by using at least one of a line, circle, and bar graph according to the user's request, by time/day/day of the week/weekly /Monthly, it displays the status information of changes in the chest displacement of each passer-by, heart rate, hyperventilation and tachypnea status information, interval status information between breaths, breathing quality status information, and skin temperature status information along with inhalation/exhalation cycles. Provides a service to be displayed on the screen, and receives facial image feature information for face classification that does not exist in the face information storage unit from the face recognition processing unit through the communication unit, and based on this, the face image feature information is provided through a separate face classification DB. Face ID information for face classification that does not exist in the information storage unit is extracted, the extracted face ID information and temperature information are synthesized in the restored image and output on the display screen, and the face input through a separate user input module Provides a service to enable searching for temperature information corresponding to the corresponding face ID information and searching or reproducing a restored image corresponding to the corresponding temperature using ID information and temperature information,
The passer-by management server acquires the interval between breaths along with the cycle of inhalation or exhalation during the breathing process based on the change in the chest displacement of the corresponding passer-by detected from each gate device, and breathing for each patient. Analyzing the quality of the patient, change status information on the chest displacement of each passenger, heart rate of each passenger, hyperventilation and tachypnea status information, inhalation/exhalation cycles and interbreathing interval status information for each passenger, And breathing with change status information on chest displacement for each gate device and for each passer-by, heart rate, hyperventilation and tachypnea status information, and inhalation/exhalation cycles based on the breathing quality status information for each passer-by. Provides a service to store and manage the inter-interval status information and breathing quality status information in a separate storage device, and the manager provides the change status information on the chest displacement for each passer-by, heart rate, hyperventilation and tachypnea status Provides a service to be displayed on the display screen so that information, breathing interval status information, and breathing quality status information can be visually confirmed along with inhalation/exhalation cycles, and change status information on chest displacement for each passer-by, heart rate , Hyperventilation and tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality status information are transmitted to external terminals by wired or wireless communication through a communication network, and each gate By receiving a signal related to the biometric information on the respiratory rate and heart rate of each passer-by detected from the device, the respiratory rate of each passer-by is extracted based on this, and the extracted respiratory rate is maintained for more than a preset breathing reference duration. If the respiratory rate is below the set minimum or above the preset maximum, it generates a pre-set respiration rate bio-abnormality notification message and monitors it to be displayed in real time on the display screen so that the administrator can visually see the respiration rate bio-abnormality notification message. Provide a service, or send a notification message of respiratory rate and bio-abnormality for each passer by hour/day/day/weekly/monthly As a database (DB), the service is provided to be stored and managed in a separate storage device, and signals related to biometric information on the respiratory rate and heart rate of each passer-by detected from each gate device are provided and based on this When the heart rate of a passerby is extracted, and the extracted heart rate is below a preset minimum reference heart rate or more than a preset maximum reference heart rate while continuing for a preset heart rate reference duration or more, a preset heart rate bio-abnormality notification message is generated. In addition, it provides a monitoring service to be displayed on the display screen in real time so that the administrator can visually see the heart rate bio-abnormality notification message, or the heart rate bio-abnormality notification message for each passer-by is converted into a database by hour/day/day of the week/weekly/monthly. Provides services to be stored and managed in a separate storage device, provides cloud computing services in response to requests from external client terminals, and changes state information on chest displacement for each passenger, heart rate, hyperventilation and tachypnea state information , In case of storing the status information of the interval between breathing and the status information of the breathing quality in a database, along with the period of inhalation/exhalation, change status information on the chest displacement for each passer-by using a symmetrical or asymmetric encryption method, heart rate, and Respiration and tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality status information are encrypted and stored, as well as the encrypted state information of changes in chest displacement for each passenger, heart rate, and hyperventilation. And a decryption key for decoding tachypnea status information, breathing interval status information, and breathing quality status information along with periods of inhalation/exhalation are transmitted to the client terminal. Provides a cloud web service to download the status information of changes in chest displacement for each passer-by, heart rate, hyperventilation and tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality status information.
The external terminal is transmitted from the passer-by-passenger management server through a pre-installed passer-by-passer condition measurement-related application, and the change status information on the chest displacement for each passer-by, heart rate, hyperventilation and tachypnea status information, inhalation/exhalation cycle In addition, it receives the status information of the interval between breaths and the status information of the quality of breath, and based on this, by using at least one of a line, a circle, and a bar graph according to the user's request, it corresponds by time/day/day/week/month Provides a service to display change status information on the displacement of each passer's chest, heart rate, hyperventilation and tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality status information on the display screen.
The client terminal, using the client member login cloud web service of the passenger management server, the change state information on the chest displacement for each passenger analyzed from the passenger management server, heart rate, hyperventilation and tachypnea state information, It searches and displays the status information of the interval between breaths and the quality of breathing on the display screen in real time along with the cycle of inhalation/exhalation, and by using the decryption key transmitted from the passenger management server along with the corresponding client member login information. The change status information for the chest displacement for each passer-by, which is encrypted and stored in the passer-by management server, heart rate, hyperventilation and tachypnea status information, interval status information between breaths along with inhalation/exhalation cycles, and breathing quality status information. It is decoded and displayed on the real-time search and display screen, and change state information, heart rate, and chest displacement for each passer-by stored in the passer-by-passenger management server through the passer-by-passer condition measurement-related application downloaded from the passer-by-passenger management server. Passer monitoring system using a gate device, characterized in that hyperventilation and tachypnea status information, breathing interval status information along with inhalation/exhalation cycles, and breathing quality status information are displayed on a real-time search and display screen. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images