KR102598784B1 - Non face to face signage system for determining whether to visit screening center and method thereof - Google Patents

Abstract

The present invention relates to a non-face-to-face signage system and method for determining whether to visit a screening clinic, which measures biometric information including the user's body temperature, respiratory rate per minute, heart rate per minute, or a combination thereof non-face-to-face and based on voice. The present invention relates to a non-face-to-face signage system and method that performs an electronic questionnaire and determines whether the user should visit a screening clinic based on the results of measuring the biometric information, the results of performing the electronic questionnaire, or a combination thereof, and outputs the result. .

Description

Non-face-to-face signage system and method for determining whether to visit a screening clinic {NON FACE TO FACE SIGNAGE SYSTEM FOR DETERMINING WHETHER TO VISIT SCREENING CENTER AND METHOD THEREOF}

The present invention relates to a non-face-to-face signage system and method for determining whether to visit a screening clinic, and more specifically, to non-face-to-face measurement of biometric information including the user's body temperature, respiratory rate per minute, heart rate per minute, or a combination thereof. Non-face-to-face signage that performs a voice-based electronic medical examination non-face-to-face, determines whether or not the user should visit a screening clinic based on the results of measuring the biometric information, the results of performing the electronic medical examination, or a combination thereof, and outputs the result. It relates to systems and methods.

Recently, due to environmental factors such as global warming, powerful new viruses that have not been predicted by experts frequently occur, and public interest in preventing the spread of infectious diseases such as infectious diseases caused by viruses is rapidly increasing.

In order to prevent the spread of infectious diseases, it is very important to screen people who show abnormal symptoms (suspected infectious diseases) early and provide treatment.

Generally, when an infectious disease occurs, special personnel (on-site personnel) are deployed to medical institutions such as hospitals and public health centers or places with a large floating population such as public facilities such as subways, airports, and ports, and the person's body temperature is directly measured by the on-site personnel. In most cases, people suspected of having an infectious disease are screened face-to-face by requesting answers to questions (i.e., questionnaires) and announcing a visit to a screening clinic.

This poses a fatal problem in that because field agents measure body temperature or conduct questionnaires in direct contact with the subject, if the subject is already suffering from an infectious disease, the infectious disease may spread due to secondary infection transmitted to the field agent. .

To solve this problem, recently, field agents are equipped with thermal imaging cameras to measure a person's body temperature non-contactly and the field agents check and select the measured results. Because field personnel must always be located on site, there is still a risk that normal field personnel will contract an infectious disease, so there is a problem that damage from secondary infection cannot be completely prevented.

Meanwhile, body temperature is important information when screening people suspected of having an infectious disease, but since a person's body temperature is greatly influenced by the surrounding environment, body temperature alone has limitations in ensuring the accuracy of screening.

Accordingly, the present invention provides a method to ensure the accuracy of screening for infectious diseases by using a thermal imaging camera and RADAR to non-face-to-face measure biometric information including the user's body temperature as well as respiratory rate per minute and heart rate per minute. I would like to make a suggestion.

In addition, the present invention performs a voice-based text questionnaire according to a preset scenario, measures biometric information, and determines whether or not to visit a screening clinic based on the results of the text questionnaire or a combination thereof to screen people suspected of having an infectious disease. Therefore, we would like to propose a plan to treat early and prevent the spread of infectious diseases at the same time.

In particular, the present invention seeks to propose a method to prevent the spread of infectious diseases due to secondary infection by implementing an unmanned determination of whether to visit a screening clinic, thereby eliminating the need to deploy separate field personnel.

Next, we will briefly describe the prior art existing in the technical field of the present invention, and then describe the technical details that the present invention seeks to achieve differently compared to the prior art.

First, Korean Patent No. 2246765 (2021.04.26.) relates to a school infectious disease management application stored in media, which prints out a checklist for each symptom from an infectious disease self-diagnosis app installed on a smartphone and allows the user to check the checklist for each symptom. This relates to a school infectious disease management application stored on a medium that, when each item is checked, determines whether or not to attend school based on the check results and prints it out.

In other words, Korean Patent No. 2246765 prints a pre-stored checklist and allows the user to simply check each item of the checklist through touch, and does not measure biometric information in a non-face-to-face manner as proposed in the present invention. , the electronic medical examination is not performed based on voice, and the method of determining and printing whether to visit a screening clinic based on the results of measuring the biometric information and the text questionnaire is not described at all, so the present invention and Korean registration Patent No. 2246765 has notable differences.

In addition, Korean Patent No. 2243814 (April 19, 2021) relates to a non-face-to-face access management method, device, and system. When there is a visitor's touch input on the display, heat is generated from the visitor's image captured through a thermal imaging camera. It relates to a non-face-to-face access management method, device, and system that detects and allows entry when the visitor's heat temperature is below the set temperature.

In other words, Korean Patent No. 2243814 simply measures the body temperature of visitors non-face-to-face using a thermal imaging camera to prevent visitors with an abnormal temperature range from entering the building.

On the other hand, the present invention measures biometric information including body temperature, respiratory rate per minute, and heart rate per minute to accurately screen people suspected of infectious diseases and self-determine whether to visit a screening clinic. Korean Patent No. 2243814 describes the technical features of the present invention. There is no description or suggestion or any hint whatsoever.

The present invention was created to solve the above problems, and measures biometric information including the user's body temperature, respiratory rate per minute, and heart rate per minute non-face-to-face, and conducts an electronic medical examination of the user based on voice. The purpose is to provide a non-face-to-face signage system and method that can determine whether to visit a screening clinic to accurately screen people suspected of infectious diseases according to the results of measuring the biometric information and electronic questionnaire. Do it as

In addition, the present invention is a non-face-to-face signage system that allows early treatment of suspected infectious diseases and prevents the spread of infectious diseases by determining and outputting the results of biometric information measurement and electronic questionnaire performance or a combination thereof to determine whether the user should visit a screening clinic. The purpose is to provide methods and methods.

In addition, the present invention stores a mapping table that maps the pixel value range and temperature value of a thermal image acquired through a thermal imaging camera, and converts each pixel value of the thermal image into a temperature value by referring to the mapping table, thereby providing non-face-to-face The purpose is to provide a non-face-to-face signage system and method for measuring a user's body temperature.

In addition, the purpose of the present invention is to provide a non-face-to-face signage system and method for measuring the body temperature of a user by averaging the temperature values in a preset threshold range among temperature values converted to pixel values of thermal images. .

In addition, the present invention provides a non-face-to-face signage system and method for non-face-to-face measuring the respiratory rate per minute and heart rate per minute for the user using the reflected signal that is reflected and received by transmitting a radar signal to the user through a radar. It is for that purpose.

In addition, the present invention converts the reflected signal into the frequency domain and extracts frequencies having the frequency range for the preset breathing rate per minute and heart beats per minute from the converted results, respectively, to measure the breathing rate per minute and heart beats per minute separately. The purpose is to provide a non-face-to-face signage system and method.

In addition, the present invention provides a non-face-to-face signage system and method that performs an electronic questionnaire on the user based on voice according to a preset scenario to prevent secondary infection due to touch and to select people suspected of infectious diseases. The purpose is to do so.

A non-face-to-face signage system that determines whether to visit a screening clinic according to an embodiment of the present invention uses a biometric information measurement engine to measure the user's biometric information, and an electronic questionnaire to determine whether the user is suspected of having an infectious disease based on voice. It includes an electronic medical examination engine that performs an electronic medical examination and a screening clinic visit decision engine that determines whether the user has visited a screening clinic based on the results of measuring the biometric information, the results of performing the electronic medical examination, or a combination thereof, and the biometric information The measurement and the electronic questionnaire are characterized in that they are performed non-face-to-face.

Additionally, the biometric information may include body temperature, respiratory rate per minute, heart rate per minute, or a combination thereof.

In addition, the biometric information measurement engine refers to a thermal image acquisition unit that acquires a thermal image of the user through a thermal imaging camera and a mapping table that maps the pixel value range and temperature value of the thermal image to determine pixels for the facial area of the obtained thermal image. It is characterized by comprising a body temperature measurement unit that measures the body temperature by converting the value into a temperature value and averaging the temperature values that fall within a preset threshold range among the converted temperature values.

In addition, the biometric information measurement engine includes a reflected signal acquisition unit that acquires a reflected signal by transmitting a radar signal in the direction of the user's chest for a certain period of time through radar, and a preset setting from the result of converting the obtained reflected signal into the frequency domain. The respiratory rate per minute measurement unit extracts the frequency of the frequency range for one respiratory rate per minute and measures the respiratory rate per minute, and extracts the frequency of the frequency range for the preset heart beats per minute from the result of conversion to the frequency range. It is characterized by including a heart beats per minute measuring unit that measures.

In addition, the breathing rate per minute and the heart beat per minute are the result of extracting the frequency of the frequency range for the breathing rate per minute and the result of extracting the frequency of the frequency range for the heart beat per minute, and the signal size (magnitude) is the largest. It is characterized in that it includes measurement by selecting each frequency.

In addition, the electronic questionnaire engine displays and outputs a plurality of items constituting the electronic questionnaire in order on the signage, outputs them as voices, or outputs a combination thereof, and generates a response waiting signal for each of the items, respectively, at a constant schedule. The electronic medical examination is performed by receiving and recognizing responses to each item within a time period.

In addition, the electronic questionnaire is composed of a normal questionnaire and a symptom questionnaire, the normal questionnaire is composed of a plurality of items to determine suspicion of infectious disease based on the user's experience, and the symptom questionnaire is a questionnaire that is currently expressed in the user. It is characterized by comprising a plurality of items for determining suspicion of infectious disease according to symptoms.

In addition, the screening engine determines whether to visit the screening clinic if at least one of the results of measuring the biometric information is in the abnormal range, if the number of positive responses in the result of performing the electronic questionnaire is more than a preset number, or a combination thereof. It is characterized in that it includes determining the user's visit to the screening clinic and outputting a recommendation to visit the screening clinic through signage, a speaker, or a combination thereof.

In addition, the method of determining whether to visit a screening clinic according to an embodiment of the present invention includes a biometric information measurement step of measuring the user's biometric information, and an electronic questionnaire based on voice to determine whether the user is suspected of having an infectious disease. It is characterized by comprising a step of performing a medical examination and a determining step of determining whether the user has visited a screening clinic based on a result of measuring the biometric information, a result of performing an electronic questionnaire, or a combination thereof.

In addition, the biometric information measurement step includes a thermal image acquisition step of acquiring a thermal image of the user through a thermal imaging camera, and pixels for the facial area of the obtained thermal image by referring to a mapping table that maps the pixel value range and temperature value of the thermal image. A body temperature measurement step of converting the value into a temperature value and measuring the body temperature by averaging the temperature values within a preset threshold range among the converted temperature values, and a radar signal for a certain period of time in the direction of the user's chest through radar. A reflected signal acquisition step of acquiring a reflected signal by transmitting a reflected signal, and respirations per minute of measuring the respiratory rate per minute by extracting the frequency of the frequency range for the preset respiratory rate per minute from the result of converting the acquired reflected signal into the frequency domain. It is characterized in that it includes a heart beats per minute measurement step of measuring the heart beats per minute by extracting the frequency of the frequency range for the heart beats per minute set in advance from the result of converting the number measurement step and the frequency domain.

In addition, the step of performing the electronic questionnaire includes displaying and outputting a plurality of items constituting the electronic questionnaire in order on the signage, outputting them as voices, or a combination thereof, and outputting a response waiting signal for each of the items. It is characterized in that it includes performing the electronic questionnaire by receiving and recognizing the response to each of the items as a voice within a certain period of time.

In addition, in the step of determining whether to visit a screening clinic, at least one of the results of measuring the biometric information is in the abnormal range, the number of positive responses from the electronic questionnaire is more than a preset number, or a combination thereof. In this case, the user's visit to the screening clinic is determined and a recommendation to visit the screening clinic is output through signage, a speaker, or a combination thereof.

As described above, the non-face-to-face signage system and method for determining whether to visit a screening clinic of the present invention measures the user's biometric information through a thermal imaging camera and radar, and uses the user according to a preset scenario based on voice. By conducting an electronic questionnaire and determining whether an infectious disease is suspected, it is effective in determining whether the user should visit a screening clinic, allowing early screening and treatment of those suspected of having an infectious disease, and ultimately preventing the spread of the infectious disease. .

1 is a conceptual diagram illustrating a non-face-to-face signage system and method for determining whether to visit a screening clinic according to an embodiment of the present invention.
Figure 2 is a diagram showing a thermal image according to an embodiment of the present invention.
Figure 3 is a flowchart showing a procedure for measuring body temperature according to an embodiment of the present invention.
Figure 4 is a diagram illustrating a method of measuring the respiratory rate per minute and heart rate per minute according to an embodiment of the present invention.
Figure 5 is a flowchart showing a procedure for performing an electronic medical examination according to an embodiment of the present invention.
Figure 6 is a block diagram showing the configuration of a non-face-to-face signage system for determining whether to visit a screening clinic according to an embodiment of the present invention.
Figure 7 is a block diagram showing the configuration of a biometric information measurement engine according to an embodiment of the present invention.
Figure 8 is a flowchart simultaneously showing the procedure for performing a normal questionnaire and the procedure for determining whether to visit a screening clinic according to the results of the normal questionnaire according to an embodiment of the present invention.
Figure 9 is a flowchart simultaneously showing the procedure for performing a non-face-to-face symptom questionnaire and the procedure for determining whether to visit a screening clinic according to the results of performing a non-face-to-face symptom questionnaire according to an embodiment of the present invention.
Figure 10 is a flowchart showing a procedure for determining whether to visit a screening clinic according to an embodiment of the present invention.

Hereinafter, with reference to the attached drawings, a preferred embodiment of the non-face-to-face signage system and method for determining whether to visit a screening clinic according to the present invention will be described in detail. The same reference numerals in each drawing indicate the same member. In addition, specific structural and functional descriptions of the embodiments of the present invention are merely illustrative for the purpose of explaining the embodiments of the present invention, and unless otherwise defined, all terms used herein, including technical or scientific terms, are provided. They have the same meaning as generally understood by those skilled in the art to which the present invention pertains. Terms as defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings they have in the context of the related technology, and unless clearly defined in this specification, should not be interpreted in an idealized or overly formal sense. It is desirable not to.

1 is a conceptual diagram illustrating a non-face-to-face signage system and method for determining whether to visit a screening clinic according to an embodiment of the present invention.

As shown in Figure 1, the non-face-to-face signage system 100 (hereinafter referred to as the non-face-to-face signage system) that determines whether to visit a screening clinic according to an embodiment of the present invention uses signage (digital) and thermal imaging. It is composed of a camera, radar, microphone, and speaker, and when the user is recognized within a preset certain distance, the user's biometric information is measured non-face-to-face using the thermal imaging camera and radar, and the signage is displayed. , an electronic questionnaire including a general questionnaire and a symptom questionnaire is performed through a microphone and speaker based on voice to determine whether or not to visit the screening clinic for the user and output, allowing the user to self-determine whether to visit the screening clinic. performs its function. Through this, the present invention prevents the spread of infectious diseases in advance by allowing early screening and treatment of suspected infectious diseases.

Additionally, the preset certain distance refers to the distance between the signage and the user, and can be set to 0.5m for the accuracy of thermal imaging cameras and radars.

In addition, the non-face-to-face signage system 100 is installed in various places (sites) such as hospitals, airports, ports, subways, bus stops, public places, etc. to screen people suspected of infectious diseases and print out whether they have visited a screening clinic, and field agents It is implemented to operate unmanned without the need for deployment.

Biometric information also includes body temperature, respiration rate per minute (RPM), beat rate per minute (BRM), or a combination thereof. Here, body temperature is measured using the pixel value of a specific body part (e.g., face) in the user's thermal image obtained through a thermal imaging camera.

In addition, the thermal imaging camera includes a temperature sensor array (thermopile array) and acquires a thermal image of the user by detecting infrared rays emitted from the user and outputting an image of the temperature distribution according to the wavelength of the detected infrared rays.

In addition, the respiratory rate per minute and heart rate per minute are measured using a reflected signal that is reflected by transmitting a radar signal toward the user's chest through radar (more specifically, Doppler radar). At this time, the radar signal is a continuous sinusoidal wave (CW, continuous wave) signal.

Meanwhile, a radar signal is transmitted in the direction of the user's chest, and the reflected signal reflected by the chest is accompanied by physical changes in the chest surface due to the user's breathing and cardiac activity. Accordingly, the non-face-to-face signage system 100 measures the respiratory rate per minute and heart rate per minute by analyzing physical changes in the chest surface from the reflection signal. Meanwhile, measuring body temperature, respiratory rate per minute, and heart rate per minute will be described with reference to FIGS. 2 to 3 and FIG. 4, respectively.

Additionally, when measuring the body temperature of a specific body part (face), the specific body part must be recognized from the thermal image, and when measuring the respiratory rate per minute and heart rate per minute, the chest to which the radar signal will be transmitted must be recognized.

Therefore, the non-face-to-face signage system 100 recognizes the face and chest through an artificial intelligence learning model created by learning a plurality of thermal image images with the face and chest set as areas of interest as learning images, and calculates the body temperature for the face area. Depending on the measured and recognized location of the chest, the transmission direction of the radar signal can be controlled to the chest direction to receive the reflected signal. At this time, the thermal image obtained for the user is input into the artificial intelligence learning model to recognize the face and chest respectively.

However, in the present invention, there is no limitation on the method for recognizing the face and chest, and it can be performed through various methods for recognizing the face and chest, such as an image matching method including pattern matching.

In addition, when performing an electronic questionnaire including a normal questionnaire and a symptom questionnaire, the non-face-to-face signage system 100 displays and outputs the items for each questionnaire as text through signage according to a predetermined scenario, or uses a speaker. The electronic medical examination is performed by outputting it as a voice or a combination of these.

At this time, the scenario means outputting each item of the electronic questionnaire one by one in a preset order, and each item is output in text and voice simultaneously so that the user can check each item audio-visually. Let it happen.

Additionally, the user inputs a response (Yes or No) to each item by voice, and the non-face-to-face signage system 100 recognizes the response to each item by recognizing the user's voice input through the microphone.

Recognizing the answer to each item is not limited and can be performed through various voice recognition methods such as Siri. Meanwhile, performing an electronic medical examination will be described in detail with reference to FIG. 5.

In addition, the management server 200 maintains/manages the non-face-to-face signage systems 100 installed in various locations, and receives the results of screening people suspected of infectious diseases from each non-face-to-face signage system 100 and deciding whether to visit a screening clinic. It performs a management function.

In addition, the management server 200 calculates statistical data according to the results of determining whether to visit a screening clinic by location, region, time zone, or a combination thereof, and provides each of the calculated statistical data to an administrator terminal (not shown). performs its function.

Through this, managers can identify the spread of infectious diseases by checking the occurrence of suspected infectious disease patients by location, region, or time zone, and plan efficient operation of screening clinics, such as adding additional medical staff to screening clinics.

In addition, the non-face-to-face signage system 100 includes only signage, a thermal imaging camera, radar, a microphone, and a speaker, and may be implemented so that measuring biometric information or recognizing voice can be performed in the management server 200. . In this case, the management server 200 receives thermal images, reflected signals, and the user's voice from the non-face-to-face signage system 100, performs biometric information measurement and response recognition, and determines whether to visit the screening clinic. It is provided to the corresponding non-face-to-face signage system 100 so that it can be printed.

Meanwhile, due to recent miniaturization of hardware and rapid development of communication technology, user terminals (smartphones) are equipped with various sensors. Accordingly, the non-face-to-face signage system 100 can be implemented as an application program on a user terminal (smart phone). At this time, the user can download and run an application to determine whether to visit a screening clinic from the management server 200 and receive results regarding whether to visit the screening clinic.

Meanwhile, if the user terminal is not equipped with a thermal imaging camera or radar, the thermal imaging camera or radar can be connected to the user terminal (USB, etc.) and an application program can be used to determine whether to visit a screening clinic.

In addition, the database 300 contains location information of the non-face-to-face signage system 100 installed in various places, the result of the judgment on whether or not to visit the screening clinic performed by each non-face-to-face signage system 100, and the determination of whether or not to visit the screening clinic. It performs the function of storing statistical data according to the results.

Figure 2 is a diagram showing a thermal image according to an embodiment of the present invention.

As shown in FIG. 2, the non-face-to-face signage system 100 according to an embodiment of the present invention measures the user's body temperature from a thermal image obtained from a thermal imaging camera.

At this time, the non-face-to-face signage system 100 measures the user's body temperature using the pixel value for the user's face area in the thermal image.

Below, the process of measuring the user's body temperature will be described in detail.

Figure 3 is a flowchart showing a procedure for measuring body temperature according to an embodiment of the present invention.

As shown in FIG. 3, the non-face-to-face signage system 100 according to an embodiment of the present invention performs a step of acquiring a thermal image of the user through a thermal imaging camera (S110).

Next, the non-face-to-face signage system 100 performs a step of converting each pixel value of the thermal image into a temperature value (S120).

At this time, each pixel value of the thermal image converted to a temperature value means the pixel value corresponding to the face area recognized in the thermal image, and the step of converting to temperature is to map the relationship between the range of the pixel value of the thermal image and the temperature value in advance. This is performed by referring to the mapping table stored in memory (not shown).

Meanwhile, a person's normal body temperature ranges from 36.5 degrees to 37 degrees, and generally the lowest body temperature at which a person can survive is 30 degrees and the highest body temperature is 42 degrees. Therefore, when measuring a user's body temperature for screening, it is desirable to measure it within the range of body temperature that a person can have (i.e., 30 to 42 degrees).

Therefore, the non-face-to-face signage system 100 measures the user's body temperature by averaging the temperature values in a preset threshold range among the converted temperature values (S130). Here, the critical range is set as the range of body temperature that a person can have.

Figure 4 is a diagram illustrating a method of measuring the respiratory rate per minute and heart rate per minute according to an embodiment of the present invention.

As shown in FIG. 4, the non-face-to-face signage system 100 according to an embodiment of the present invention transmits a radar signal to the user's chest for a certain period of time (e.g., 1 minute) through radar and is reflected by the chest. Obtain the reflected signal. Additionally, the non-face-to-face signage system 100 measures the respiratory rate per minute and heart rate per minute using the acquired reflection signal.

At this time, the non-face-to-face signage system 100 converts the reflection signal in the time domain into the frequency domain to measure the breathing rate per minute and the heart rate per minute. Conversion to the frequency domain can be performed using a fast Fourier transform (FFT) method.

In addition, the non-face-to-face signage system 100 extracts the frequencies corresponding to the preset frequency range for the respiratory rate per minute and the frequency range for the heart beats per minute from the result of conversion to the frequency domain.

Meanwhile, in general, the normal breathing rate per minute is 15 to 20 and the normal heart rate per minute is 60 to 100. Therefore, in the present invention, in order to measure abnormal respiratory rate per minute or heart rate per minute, the respiratory rate per minute and heart rate per minute are expanded, and the frequency range for the respiratory rate per minute and the frequency range for the heart rate per minute are set and stored in advance.

At this time, the frequency range for the respiratory rate per minute and the frequency range for the heart beats per minute are set so that they do not overlap.

Additionally, since frequency means change in cycle (frequency) per second, the non-face-to-face signage system 100 measures the breathing rate per minute and heart rate per minute by multiplying each extracted frequency by 60 (seconds).

For example, if the frequency extracted from the frequency range for the number of breaths per minute is 0.8 Hz, the number of breaths per minute is 80 (0.8 x 60). As another example, if the frequency extracted from the frequency range for heart beats per minute is 1.0 Hz, the heart beats per minute is 60 (1.0 x 60).

On the other hand, it is clear that signals with a frequency range of respiratory beats per minute are most affected by the user's breathing, and signals with a frequency range of heart beats per minute are most affected by the user's heartbeat. do.

Therefore, the non-face-to-face signage system 100 extracts a plurality of frequencies from the frequency range for the breathing rate per minute and the frequency range for the heart beat per minute. Select the frequency with the largest signal magnitude among the plurality of frequencies, select the frequency with the largest signal magnitude among the plurality of frequencies extracted from the frequency range for heart beats per minute, and measure the breathing rate per minute and heart beats per minute, respectively. .

Figure 5 is a flowchart showing a procedure for performing an electronic medical examination according to an embodiment of the present invention.

As shown in Figure 5, the electronic medical examination according to an embodiment of the present invention is performed based on voice without allowing any touch to the signage. The reason that touch is not allowed here is to prevent secondary damage from infectious diseases caused by allowing touch when multiple users use the non-face-to-face signage system 100.

In addition, the electronic questionnaire includes a regular questionnaire and a symptom questionnaire, and Figure 5 shows each step of performing an electronic questionnaire by integrating the symptom questionnaire and the regular questionnaire. However, the symptom questionnaire is conducted after performing the regular questionnaire.

In addition, the normal questionnaire is a questionnaire conducted to determine suspicion of infectious diseases based on the user's experience, such as whether they have been in contact with a confirmed patient or visited an overseas medical facility, and the symptom questionnaire is a questionnaire that determines the current status, including coughing, fatigue, muscle pain, etc. This means conducting a questionnaire to determine whether an infectious disease is suspected based on the symptoms displayed by the user. The above general questionnaire and symptom questionnaire will be described in detail with reference to FIGS. 8 and 9, respectively.

Additionally, in the procedure for performing an electronic questionnaire, first, the non-face-to-face signage system 100 performs a step of outputting the items of the electronic questionnaire according to a preset scenario (S210).

At this time, each item of the electronic medical questionnaire is output in stages, output in text format through signage, and simultaneously output as a voice through a speaker, allowing the user to check each item audio-visually and answer the question.

Next, the non-face-to-face signage system 100 outputs the items of the electronic questionnaire and then performs the step of generating and outputting a response waiting signal for the items (S220).

The response waiting signal is output to wait for the user's response for a certain period of time, and is output as a preset sound after printing the items of the electronic questionnaire.

On the other hand, after the response waiting tone is output, if the user's response is not input for a certain period of time, the response waiting tone is re-output. If no response is input after re-printing, the electronic questionnaire is stopped and the decision to visit the screening clinic is not made. No.

Next, the non-face-to-face signage system 100 performs a step of acquiring the user's voice in response to the output item (S230).

The step of acquiring voice is performed through a microphone provided on one side of the signage.

Next, the non-face-to-face signage system 100 performs a step of recognizing the response to the item by recognizing the acquired user's voice (S240). As described above, recognizing the voice can be performed through various voice recognition methods.

Next, the non-face-to-face signage system 100 repeatedly performs steps S210 to S240 until the electronic questionnaire for all items prepared according to a preset scenario is completed (S250).

Figure 6 is a block diagram showing the configuration of a non-face-to-face signage system for determining whether to visit a screening clinic according to an embodiment of the present invention.

As shown in FIG. 6, the non-face-to-face signage system 100 according to an embodiment of the present invention includes a signage 110, a user recognition engine 120 that recognizes a user to determine whether to visit a screening clinic, and A biometric information measurement engine 130 that non-face-to-face measures biometric information including the user's body temperature, respiratory rate per minute, heart rate per minute, or a combination thereof, and an electronic medical examination engine 140 that performs an electronic medical examination non-face-to-face based on voice. ) and a screening clinic visit decision engine 150 that determines whether the user should visit the screening clinic based on the results of measuring biometric information, the results of performing an electronic questionnaire, or a combination thereof.

In addition, as described above, a thermal imaging camera, radar, speaker, and microphone are installed on one side of the signage 110.

Additionally, the user recognition engine 120 performs a function of recognizing users within a preset distance to determine whether to visit a screening clinic non-face-to-face.

At this time, the user recognition engine 120 uses the reflected signal received through the radar, and the speed (propagation speed) of the radar signal is divided into the time period between the time the radar signal is transmitted and the time the reflected signal is received (i.e., round trip time). ) is multiplied by half to measure the distance between the signage 110 and the user to recognize users within a preset distance.

In addition, when the user is recognized, the user recognition engine 120 asks the user by voice whether to decide whether to visit the screening clinic and recognizes the user's response, thereby performing a process of determining whether to visit the screening clinic. At this time, the user's age can be input by voice for more accurate judgment.

In addition, the biometric information measurement engine 130 measures the user's biometric information, and the configuration of the biometric information measurement engine 130 will be described in detail with reference to FIG. 7.

In addition, the electronic questionnaire engine 140 sequentially outputs each item of the electronic questionnaire through the signage 110 and a speaker according to a predetermined scenario, and outputs a pre-stored response waiting signal for each item to ensure that the user's A response is requested, and the response to each item is recognized by recognizing the user's voice in response to the electronic medical examination. The process of performing the electronic medical examination has been described with reference to FIG. 5, so further detailed description is required. Please omit it.

In addition, the screening clinic visit decision engine 150 analyzes the results of measuring biosignals, the results of electronic questionnaires, or a combination thereof to determine whether the user has visited the screening clinic and outputs the results.

At this time, the determination engine 150 for visiting the screening clinic determines whether at least one of body temperature, respiratory rate per minute, and heart rate per minute is in the abnormal range as a result of measuring vital signs, or as a result of performing a normal medical examination, the number of positive results exceeding the preset number is determined. If there is an answer, or if there are more than a preset number of positive answers as a result of the symptom questionnaire, a visit to the screening clinic is decided for the user and a visit to the screening clinic is recommended.

Meanwhile, the function of the screening clinic visit determination engine 150 may be provided in the management server 200. In this case, the non-face-to-face signage system 100 provides the results of measuring biometric information and performing an electronic questionnaire to the management server 200, receives the results of determining whether to visit a screening clinic, and uses the signage 110 and Output as voice.

Figure 7 is a block diagram showing the configuration of a biometric information measurement engine according to an embodiment of the present invention.

As shown in FIG. 7, the biometric information measurement engine 130 according to an embodiment of the present invention includes a thermal image acquisition unit 131, a body temperature measurement unit 132, a reflection signal acquisition unit 133, and a frequency converter. (134), a respiratory rate per minute measurement unit (135), and a heart rate per minute measurement unit (136).

Additionally, the thermal image acquisition unit 131 performs a function of acquiring a thermal image of the user from a thermal imaging camera provided on one side of the signage 110.

Additionally, the body temperature measurement unit 132 performs the function of measuring the user's body temperature from the user's thermal image acquired through the thermal image acquisition unit 131.

At this time, the body temperature measurement unit 132 converts a plurality of pixel values corresponding to the face area in the thermal image into temperature values by referring to the mapping table stored in memory (not shown), and sets a preset threshold among the converted temperature values. The body temperature is measured by averaging the temperature values within the range. Meanwhile, since measuring body temperature was explained with reference to FIGS. 2 and 3, it will be omitted here.

In addition, the reflected signal acquisition unit 133 transmits a radar signal through radar in the direction of the user's chest for a certain period of time to acquire a reflected signal reflected by the chest and returned, and the frequency converter 134 acquires It performs the function of converting a reflected signal into the frequency domain.

In addition, the respiration rate per minute measuring unit 135 measures the respiration rate per minute by extracting a frequency in a preset respiration rate per minute frequency range from the result of converting the reflected signal into the frequency domain, and the heart rate per minute measuring unit 136 is configured as described above. It performs the function of measuring heart beats per minute by extracting the frequency of the preset heart beats per minute frequency range from the result of conversion to the frequency domain. Measuring the breathing rate per minute and heart beats per minute was explained with reference to FIG. 4, so no further steps are required. Detailed description will be omitted.

Figure 8 is a flowchart simultaneously showing the procedure for performing a normal questionnaire and the procedure for determining whether to visit a screening clinic according to the results of the normal questionnaire according to an embodiment of the present invention.

As shown in FIG. 8, the procedure for determining whether to visit a screening clinic according to the results of performing a normal questionnaire and a normal questionnaire according to an embodiment of the present invention is, first, the non-face-to-face signage system 100 contacts a confirmed patient. A step is performed to recognize the user's response by outputting an item asking whether or not to do so (S310).

Next, the non-face-to-face signage system 100 recognizes the user's response by printing an item asking whether to visit an overseas medical institution (S320), and recognizing the user's response by printing an item asking whether to self-quarantine (S330). , a step (S340) of recognizing the user's response by outputting an item asking whether there is a feeling of heat is sequentially performed.

Here, contact with a confirmed patient, visit to an overseas medical institution, self-quarantine, and fever represent each item of the regular questionnaire, and when the user's response to each item is recognized, the next item is output in order. Meanwhile, since the process of performing a normal interview has been described with reference to FIG. 5, further detailed description will be omitted.

Next, the non-face-to-face signage system 100 recognizes the responses to each item of the normal questionnaire and, if all responses are negative, performs a non-face-to-face symptom questionnaire (S350). Performing the non-face-to-face symptom questionnaire will be described in detail with reference to FIG. 9.

However, even if not all responses are negative, the non-face-to-face signage system 100 can perform a non-face-to-face symptom questionnaire.

In addition, the non-face-to-face signage system 100 performs a step of determining whether to visit a screening clinic according to the results of a normal questionnaire and outputting a recommendation to visit a screening clinic according to the determined results (S360).

At this time, the non-face-to-face signage system 100 outputs a recommendation to visit a screening clinic if there are more positive responses than the preset number as a result of performing the normal questionnaire.

Meanwhile, Figure 8 shows that if there is a positive response for each item, a recommendation to visit the screening clinic is output. However, the procedure for determining whether to visit the screening clinic according to the results of performing the regular questionnaire and regular questionnaire is easier to understand. As shown for illustrative purposes, the screening clinic visit recommendation output step (S260) of FIG. 8 outputs a screening clinic visit recommendation when there are more than a predetermined number of positive responses according to the results of the regular questionnaire actually performed through steps S310 to S340. do.

Figure 9 is a flowchart simultaneously showing the procedure for performing a symptom questionnaire and the procedure for determining whether to visit a screening clinic according to the results of the symptom questionnaire according to an embodiment of the present invention. Meanwhile, the procedure for conducting a non-face-to-face symptom questionnaire includes a total of three steps.

As shown in Figure 9, the procedure for performing a symptom questionnaire according to an embodiment of the present invention and the procedure for determining whether to visit a screening clinic according to the results of the symptom questionnaire are first, the non-face-to-face signage system 100. performs a step of recognizing the user's response by outputting an item asking whether to cough (S410).

Next, the non-face-to-face signage system 100 sequentially outputs items asking about fatigue, muscle pain, phlegm, and shortness of breath and performs a step (step 1) of recognizing each response (S420). At this time, fatigue, muscle pain, phlegm, and shortness of breath are sequentially output when responses to each are recognized.

Next, the non-face-to-face signage system 100 performs a step (step 2) of recognizing the user's responses by sequentially outputting items asking about chest pain, chills, headache, and neck pain (S440). At this time, chest pain, chills, headache, and neck pain are sequentially output when responses to each are recognized.

Next, the non-face-to-face signage system 100 performs a step of recognizing the user's responses by sequentially outputting items asking whether the user is dizzy, has diarrhea, has a runny nose, has bloody phlegm, and has a stuffy nose (S460). At this time, whether dizziness, diarrhea, runny nose, bloody phlegm, or stuffy nose are sequentially output when responses to each are recognized.

Meanwhile, each of steps S410 to S460 constitutes each item of the symptom questionnaire and is sequentially output according to the user's response. The process of performing the non-face-to-face symptom questionnaire was explained with reference to FIG. 5, so no further explanation. is omitted.

In addition, the non-face-to-face signage system 100 generates the results of performing a non-face-to-face symptom questionnaire, determines whether to visit a screening clinic based on the results of the non-face-to-face symptom questionnaire, and outputs a recommendation to visit the screening clinic (S360).

At this time, the non-face-to-face signage system 100 performs a non-face-to-face symptom questionnaire and, if the number of positive answers is more than a predetermined number, outputs a recommendation to visit a screening clinic. More specifically, there is one or more symptoms (S430) in stage 1 (i.e., one or more positive responses), two or more symptoms (S450) in stage 2 (i.e., two or more positive responses), or stage 3. If there are two or more symptoms (S470) (i.e., there are two or more positive responses), a recommendation to visit a screening clinic is output.

Figure 10 is a flowchart showing a procedure for determining whether to visit a screening clinic according to an embodiment of the present invention.

As shown in FIG. 10, the procedure for determining whether to visit a screening clinic according to an embodiment of the present invention is, first, the non-face-to-face signage system 100 recognizes the user located in front of the signage 110. Perform the recognition step (S510).

The user recognition is performed by recognizing the user's location within a preset distance using radar. At this time, the user recognition step is performed by outputting a voice to the user to determine whether to visit the screening clinic or not, and the user's response. By recognizing, the process of determining whether to visit a screening clinic is performed, and the user's age can be input by voice.

Next, the non-face-to-face signage system 100 performs a biometric information measurement step to measure biometric information including the user's body temperature, respiratory rate per minute, and heart rate per minute (S520).

Since measuring biometric information has been described with reference to FIGS. 2 to 4, further detailed description will be omitted.

Meanwhile, although not shown in FIG. 10, the biometric information measurement step includes a thermal image acquisition step of acquiring a thermal image of the user, a body temperature measurement step of measuring the user's body temperature using the obtained thermal image, and transmission for a certain period of time through radar. A reflected signal acquisition step of acquiring a reflected signal for a laser signal, a frequency conversion step of converting the obtained reflected signal into the frequency domain, a respiratory rate measurement step of measuring the respiratory rate per minute using the result of conversion to the frequency domain, and It includes a heart beats per minute measurement step of measuring the heart beats per minute using the conversion result.

Next, the non-face-to-face signage system 100 performs an electronic questionnaire including a non-face-to-face general questionnaire and a non-face-to-face symptom questionnaire based on voice (S530).

As described above, the non-face-to-face general questionnaire is intended to determine suspicion of infectious disease infection based on the user's experience, and the non-face-to-face symptom questionnaire is intended to determine suspicion of infectious disease infection based on the user's current symptoms.

Additionally, each questionnaire consists of multiple items, and each item is output sequentially in order according to a preset scenario. Meanwhile, the process of performing an electronic medical examination has been described with reference to FIGS. 5 and 8 to 9 and will therefore be omitted here.

Next, the non-face-to-face signage system 100 performs a decision whether to visit a screening clinic by analyzing the results of measuring biometric information, performing an electronic questionnaire, or a combination thereof to determine whether to visit the screening clinic (S540) .

Determining whether or not to visit the screening clinic is based on whether at least one of the results of measuring biometric information is in the abnormal range, or the result of performing an electronic questionnaire is positive for more than the preset number of non-face-to-face regular questionnaires and non-face-to-face symptom questionnaires. This is done by deciding whether to visit a screening clinic if there is a positive answer or a combination of these.

Meanwhile, in the case of respiratory rate per minute and heart rate per minute among the results of measuring biometric information, the abnormal range can be set differently depending on the user's age.

For example, for users aged 6 to 12, the normal range for heart beats per minute is generally 75 to 120, so the abnormal range of heart beats per minute for users aged 6 to 12 can be set to less than 75 and greater than 120. For users over 12 years of age, the normal range for heart beats per minute is 60 to 100, so the abnormal range of heart beats per minute for users over 12 years of age can be set to less than 60 and more than 100. Meanwhile, the normal range of respiratory rate per minute for people over 6 years of age is 12 to 20, so the abnormal range of respiratory rate per minute can be set to less than 12 and greater than 20. However, the present invention is not limited to this, and the abnormal range can be set for each age group by further subdividing it.

In addition, in the step of determining whether to visit the screening clinic, if visit is decided as a result of determining whether to visit the screening clinic (S550), a step of outputting a recommendation to visit the screening clinic is performed (S560).

At this time, the recommendation to visit the screening clinic is displayed in text format on the signage 110, output as a voice through a speaker, or a combination of these.

As described above, the non-face-to-face signage system and method for determining whether to visit a screening clinic of the present invention measure the user's biometric information non-face-to-face and conduct an electronic questionnaire to determine whether to visit the screening clinic. It has the effect of effectively preventing the spread of infectious diseases by allowing early screening and treatment of those suspected of having infectious diseases.

In the above, the preferred embodiments according to the present invention have been described in detail, but the technical idea of the present invention is not limited thereto, and each component of the present invention is changed or modified within the technical scope of the present invention to achieve the same purpose and effect. It could be.

In addition, although preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the invention pertains without departing from the gist of the present invention as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

100: Non-face-to-face signage system that determines whether to visit a screening clinic
110: Signage 120: User recognition engine
130: Biometric information measurement engine 131: Thermal image acquisition unit
132: body temperature measurement unit 133: reflection signal acquisition unit
134: Frequency conversion unit 135: Respiration rate per minute measurement unit
136: Heart rate per minute measurement unit 140: Electronic questionnaire engine
150: Determination engine for whether to visit a screening clinic 200: Management server
300: database

Claims (14)

In a non-face-to-face signage system including a thermal imaging camera, radar, microphone, speaker, and signage,
A biometric information measurement engine that measures biometric information including the user's body temperature, respiratory rate per minute, and heart rate per minute;
An electronic medical examination engine that performs an electronic medical examination based on voice to determine whether the user is suspected of having an infectious disease; and
It includes a screening clinic visit decision engine that determines whether the user should visit the screening clinic according to the results of measuring the biometric information and the results of performing the electronic questionnaire;
The biometric information measurement engine,
The user's body temperature is measured by averaging the temperature values in a preset threshold range among temperature values converted to pixel values for the facial area of the thermal image acquired through the thermal imaging camera, and the reflection received through the radar The signal is converted to the frequency domain, and from the converted result, frequencies having a frequency range for the preset breathing rate per minute and heart beats per minute are extracted, respectively, the results of extracting the frequencies in the frequency range for the breathing rate per minute, and If there are multiple results of extracting the frequencies in the frequency range for heart beats per minute, the frequency with the largest signal magnitude is selected, respectively, to measure the respiratory rate per minute and heart beats per minute for the user non-face-to-face,
The electronic questionnaire includes a general questionnaire and a symptom questionnaire. The regular questionnaire consists of a plurality of items to determine suspicion of infectious disease based on the user's experience, and the symptom questionnaire is based on the symptoms currently expressed in the user. It includes a plurality of items to determine suspicion of infectious disease,
The engine for determining whether to visit the screening clinic is,
If at least one of the results of measuring the biometric information is in the abnormal range, or the number of symptoms is more than a preset number in the results of the electronic questionnaire, or a combination thereof, the user's visit to the screening clinic is determined and the screening clinic is located. Includes output of visit advisories on signage, speakers, or a combination thereof;
According to a pre-set scenario, an electronic medical examination of the user is performed non-face-to-face based on voice, and according to the results of measuring the biometric information and the results of performing the electronic medical examination, a secondary examination according to the touch of the signage is performed. A non-face-to-face signage system that determines whether to visit a screening clinic by screening people suspected of having an infectious disease while preventing infection. delete In claim 1,
The biometric information measurement engine,
A thermal image acquisition unit that acquires a thermal image of the user through a thermal imaging camera; and
A non-face-to-face signage system for determining whether to visit a screening clinic, comprising a body temperature measurement unit that measures the body temperature by referring to a mapping table that maps the pixel value range and temperature value of the thermal image. In claim 1,
The biometric information measurement engine,
a reflected signal acquisition unit that acquires a reflected signal by transmitting a radar signal through radar in the direction of the user's chest for a certain period of time;
A respiratory rate per minute measuring unit that measures the respiratory rate per minute by extracting a frequency in a frequency range for a preset respiratory rate per minute from the result of converting the acquired reflection signal into the frequency domain; and
A heart beats per minute measuring unit that extracts the frequency of the frequency range for the preset heart beats per minute from the result of conversion to the frequency domain and measures the heart beats per minute; a non-face-to-face device that determines whether or not to visit a screening clinic; Nizi system. delete In claim 1,
The electronic paperweight engine,
Displaying and outputting a plurality of items constituting the electronic questionnaire in order on signage, outputting them in voice, or a combination thereof,
A non-face-to-face process that determines whether to visit a screening clinic, characterized in that the electronic questionnaire is performed by generating a response waiting signal for each of the plurality of items and receiving and recognizing the response to each item as a voice within a certain period of time. Nizi system. delete delete In the method of determining whether to visit a screening clinic through a non-face-to-face signage system including a thermal imaging camera, radar, microphone, speaker, and signage,
In the biometric information measurement engine, a biometric information measurement step of measuring biometric information including the user's body temperature, respiratory rate per minute, and heart rate per minute;
In an electronic medical examination engine, an electronic medical examination is performed based on voice to determine whether the user is suspected of having an infectious disease; and
It includes a screening clinic visit decision step of determining, in the visit decision engine, whether the user has visited the screening clinic according to the results of measuring the biometric information and performing an electronic questionnaire;
In the biometric information measurement step,
The user's body temperature is measured by averaging the temperature values in a preset threshold range among temperature values converted to pixel values for the facial area of the thermal image acquired through the thermal imaging camera, and the reflection received through the radar The signal is converted to the frequency domain, and from the converted result, frequencies having a frequency range for the preset breathing rate per minute and heart beats per minute are extracted, respectively, the results of extracting the frequencies in the frequency range for the breathing rate per minute, and If there are multiple results of extracting the frequencies in the frequency range for heart beats per minute, the frequency with the largest signal magnitude is selected, respectively, to measure the respiratory rate per minute and heart beats per minute for the user non-face-to-face,
The electronic questionnaire includes a general questionnaire and a symptom questionnaire. The regular questionnaire consists of a plurality of items to determine suspicion of infectious disease based on the user's experience, and the symptom questionnaire includes symptoms currently expressed by the user. It includes a plurality of items to determine suspicion of infectious disease according to the
At the stage of determining whether to visit the screening clinic,
If at least one of the results of measuring the biometric information is in the abnormal range, or the number of symptoms is more than a preset number in the results of the electronic questionnaire, or a combination thereof, it is decided to visit the screening clinic for the user. Includes output of visit advisories on signage, speakers, or a combination thereof;
According to a pre-set scenario, an electronic medical examination of the user is performed non-face-to-face based on voice, and according to the results of measuring the biometric information and the results of performing the electronic medical examination, a secondary examination according to the touch of the signage is performed. A method of determining whether to visit a screening clinic, which is characterized by determining whether to visit a screening clinic by screening people suspected of having an infectious disease while preventing infection. In claim 9,
The biometric information measurement step is,
A thermal image acquisition step of acquiring a thermal image of a user through a thermal imaging camera;
A body temperature measurement step of measuring the body temperature with reference to a mapping table that maps the pixel value range of the thermal image and the temperature value;
A reflected signal acquisition step of acquiring a reflected signal by transmitting a radar signal through radar toward the user's chest for a certain period of time;
A respiration rate measurement step of measuring the respiration rate per minute by extracting a frequency in a frequency range for a preset respiration rate per minute from the result of converting the acquired reflection signal into the frequency domain; and
A heart beats per minute measurement step of extracting the frequency of the frequency range for the preset heart beats per minute from the result of conversion to the frequency domain and measuring the heart beats per minute. A method for determining whether to visit a screening clinic, comprising a. delete In claim 9,
The step of performing the electronic questionnaire is,
Displaying and outputting a plurality of items constituting the electronic questionnaire in order on signage, outputting them in voice, or a combination thereof,
Determining whether to visit a screening clinic, comprising performing the electronic questionnaire by generating a response waiting signal for each of the plurality of items and receiving and recognizing the response to each item as a voice within a certain period of time. method. delete delete