KR20220114389A - Kiosk with the function of detecting facial recognition and thermal imaging, and an access control method using it - Google Patents

Abstract

A kiosk system having face recognition and thermal image detection functions, according to an embodiment of the present invention, comprises: a customer terminal for registering face information in a platform and receiving an entrance waiting number ticket for a store to be visited; a kiosk, which recognizes the face of a customer, detects a febrile state, and provides the detection result to a store terminal, and requests that the GPS positioning unit transmits, to the store terminal, indoor position information of the customer whose temperature is greater than a preset temperature, if the customer carrying the customer terminal is positioned within a preset distance; and the store terminal for monitoring, on the basis of transmission values of the kiosk and the GPS positioning unit, whether the customer, whose temperature is greater than a preset value, goes indoors. Therefore, the present invention can easily identify a person with an elevated body temperature and related symptoms.

Description

Kiosk with the function of detecting facial recognition and thermal imaging, and an access control method using it

The present invention relates to a kiosk system having facial recognition and thermal image detection functions and an access control method using the same.

Humans are classified as warm-blooded animals, and when an outbreak occurs, changes in body temperature occur due to the action of internal immune functions.

It may be a common occurrence from serious infectious diseases such as Middle East Respiratory Syndrome (MERS) or Severe Acute Respiratory Syndrome (SARS).

In the case of MERS in 2015, failure to manage patients infected with MERS caused many people to suffer from the fear of MERS infection, which incurs many social costs.

Since then, hospitals, clinics, and postpartum care centers of various levels have been controlling outpatients and visitors. However, this control simply limits the visit time, and there is a problem in that if an infected person enters and exits within the controlled visit time, it cannot be prepared. Therefore, a method of measuring the body temperature of an entrant has emerged as a method of restricting access.

In particular, Korean Patent No. 10-1912390 uses a thermal imaging sensor to measure skin temperature, but there is a disadvantage in that it is impossible to determine the skin temperature change due to the external air temperature.

Laid-Open Patent Publication No. 10-2003-0011582

An object of the present invention is to provide a kiosk system having facial recognition and thermal image detection functions that can solve the problems of the prior art, and an access control method using the same.

A kiosk system having a facial recognition and thermal image detection function according to an embodiment of the present invention for solving the above problems includes: a user terminal that registers facial information on a platform and is issued an access waiting list for a store to be visited; When a customer with the customer terminal is located within the preset distance, after detecting the customer's face recognition and body temperature fever, the detection result is provided to the store terminal, and the customer's body temperature exceeds the preset temperature. a kiosk that requests a GPS positioning unit to transmit location information to a store terminal; and a store terminal for monitoring whether a customer whose body temperature and fever temperature exceeds a preset value based on the transmission value of the kiosk and the GSP positioning unit enters the room.

In one embodiment, the kiosk is a video camera for taking a face image of the entrant; a thermal imaging camera that detects the face heat temperature of the entrant; an information processing unit that confirms the identity of the person entering and exits based on the facial image, and determines whether access is possible based on the facial fever temperature; and an access number issuing unit that issues an access number when receiving an identification check and access permission instruction from the information processing unit.

In an embodiment, the information processing unit is characterized in that, when the facial fever temperature exceeds a preset heating temperature, the location tracking of the user terminal of the corresponding person is requested to the GPS positioning unit.

In one embodiment, further comprising a platform management server that issues an encryption token obtained by encrypting user information input in the platform to the user terminal, wherein the platform management server is the time, date, and heat of contacting the kiosk in the encryption token. It is characterized in that at least one or more of temperature and in-store location information are recorded and stored as encrypted text.

The access control method using a kiosk system having a facial recognition and thermal image detection function according to an embodiment of the present invention for solving the above problems is a step of issuing an access waiting number table for a store to be visited using a platform in a user terminal ; when the user carrying the user terminal is located in a preset area of the store, the kiosk detects the user's face recognition and body temperature fever, and then displays the detection result; Among the detection results, if the identification of the user is impossible or the facial body temperature exceeds the preset temperature, the GPS measurement unit requests indoor location tracking of the user terminal, and requests to transmit the tracked indoor location information of the user terminal to the store terminal. step; and monitoring whether the user terminal for which the location tracking is requested from the store terminal enters the room.

In one embodiment, before the step of receiving the access waiting number ticket issuance, the platform management server further comprises issuing an encryption token obtained by encrypting user information input into the platform to the user terminal, the encryption token is It is characterized in that it is a program that records and stores at least one of the contact time, date, temperature of the kiosk, and location information in the store as encrypted text.

By utilizing the kiosk system operating based on facial recognition and thermal image detection and the access control method using the same according to an embodiment of the present invention, it is possible to block an infected person with fever from entering a store in a narrow space, There is an advantage of being able to easily find a person with fever symptoms even if they sneak into an indoor store by tracking the location of the detected person's terminal.

In addition, by providing reservation and waiting status online, the user can check the order information and make a reservation, so that it is possible to suppress the crowding phenomenon in which a large number of people are crowded due to waiting in a narrow place at a certain time.

In addition, if identification information is registered in the platform before visiting the store, it provides the advantage of being able to easily enter the store through a simple temperature check process after confirming the location information of the user terminal in which the identification information is registered.

1 is a network configuration diagram of a kiosk system having facial recognition and thermal image detection functions according to an embodiment of the present invention.
FIG. 2 is a device block diagram of the kiosk shown in FIG. 1 .
3 is a block diagram showing the detailed configuration of the platform management server shown in FIG.
4 to 6 are flowcharts for explaining various examples of an access control method using a kiosk system having facial recognition and thermal image detection functions according to an embodiment of the present invention.
7 illustrates an example computing environment in which one or more embodiments disclosed herein may be implemented.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be recognized by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of the various methods in principles of various aspects may be employed, and the descriptions set forth are intended to include all such aspects and their equivalents.

Further, various aspects and features will be presented by a system that may include a number of devices, components and/or modules, and the like. It is also noted that various systems may include additional apparatuses, components, and/or modules, etc. and/or may not include all of the apparatuses, components, modules, etc. discussed with respect to the drawings. must be understood and recognized.

As used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. may not be construed as an advantage or an advantage in any aspect or design described above over other aspects or designs. . The terms 'component', 'module', 'system', 'interface', etc. used below generally mean a computer-related entity, for example, hardware, a combination of hardware and software, It can mean software.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from context, "X employs A or B" is intended to mean one of the natural implicit substitutions. That is, X employs A; X employs B; or when X employs both A and B, "X employs A or B" may apply to either of these cases. It should also be understood that the term “and/or” as used herein refers to and includes all possible combinations of one or more of the listed related items.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements and/or groups thereof. should be understood as not Also, unless otherwise specified or unless it is clear from context to refer to a singular form, the singular in the specification and claims should generally be construed to mean “one or more”. In addition, as used herein, the terms “client,” “user,” and “user” are often used interchangeably. In addition, the terms “component” and “element” as used herein may also often be used interchangeably.

Hereinafter, based on the accompanying drawings, a kiosk operating based on facial recognition and thermal image detection according to an embodiment of the present invention and an O2O platform interworking therewith will be described in more detail.

1 is a network configuration diagram of a kiosk system having facial recognition and thermal image detection functions according to an embodiment of the present invention, FIG. 2 is a device block diagram of the kiosk shown in FIG. 1, and FIG. 3 is shown in FIG. It is a block diagram showing the detailed configuration of the platform management server.

First, as shown in FIG. 1 , the kiosk system 100 having a facial recognition and thermal image detection function according to an embodiment of the present invention includes a user terminal 200 , a kiosk 300 , a store terminal 400 and It includes a platform management server (500).

Each component shown in FIG. 1 is connected by a network. Here, the network refers to a connection structure in which information exchange is possible between each node, such as a plurality of terminals and servers. Examples of such networks include RF, 3rd Generation Partnership Project (3GPP) network, Long Term Evolution (LTE). ) network, 5th Generation Partnership Project (5GPP) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, and the like are included, but are not limited thereto.

In the following, the term at least one is defined as a term including the singular and the plural, and even if at least one term does not exist, each component may exist in the singular or plural, and may mean the singular or plural. it will be self-evident In addition, it will be said that each component is provided in singular or plural depending on the embodiment.

First, the user terminal 200 may be a terminal running the kiosk interworking platform 10 capable of interworking with the kiosk 300 having the facial recognition and thermal image detection functions presented herein.

The user terminal 200 accesses the platform management server 400 to be described later through the kiosk interworking platform 10, and requests and receives the access number required for entering the store where the kiosk having facial recognition and thermal image detection functions is located. can be

The user terminal 200 may be a terminal that receives an encryption token obtained by encrypting personal identification information (facial information, etc.) registered in the kiosk interworking platform 10, and a kiosk 300 having facial recognition and thermal image detection functions. When close to , it may be a terminal that provides the corresponding encryption token to the kiosk 300 .

Here, the encryption token is a program that records and stores at least one information among the time, date, temperature of contact with the kiosk having facial recognition and thermal image detection functions, and information on the movement of the kiosk in the store where the kiosk is located. can

The information stored in the encryption token may be information processed using an encryption program in a platform management server to be described later.

In addition, the user terminal 200 may be a terminal that can search for a store or a place in which a kiosk having a facial recognition and thermal image detection function is located using the kiosk interworking platform 10 , and also stores from the kiosk located in the store. It may be a terminal capable of receiving information within.

The stores and places mentioned herein may be any place where electronic commerce is possible, such as a bank, a shopping mall, and a hospital.

The user terminal 200 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, navigation, a laptop equipped with a web browser, a desktop, and a laptop.

In addition, it may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one customer terminal 200, for example, as a wireless communication device that guarantees portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) terminal, a smart phone, a smart pad, a tablet PC, etc. may include all kinds of handheld-based wireless communication devices.

In addition, the user terminal 200 may be a terminal capable of installing or opening a kiosk interworking platform (application, program, app page, web page, etc.).

Here, the web browser is a program that enables the use of a web (world wide web) service, and refers to a program that receives and displays hypertext written in HTML (hyper text mark-up language), for example, Netscape , Explorer, and Chrome. In addition, the application means an application on the terminal, for example, includes an app (app) executed in a mobile terminal (smartphone).

Next, the kiosk 300 detects the customer's face recognition and body temperature fever when a customer holding the user terminal 200 on which the kiosk interworking platform is executed is located within a preset distance, and then sends the detection result to the store terminal. and may be a device that requests the GPS positioning unit to transmit the indoor location information of the customer whose body temperature exceeds a preset temperature to the store terminal.

The kiosk 300 referred to in the present invention is connected to the Internet and a computer with the support of a wired or wireless Internet function, and can also perform functions such as e-mail, web browsing, banking or games, and is a general purpose standardized for these various functions. An OS may be used. In addition, since various applications can be freely added or deleted on the general-purpose OS kernel, various user-friendly functions can be performed.

In addition, the kiosk 300 may be combined with digital signage, and the above-described digital signage is a communication tool that can induce marketing, advertising, training effects and customer experience of companies, such as airports or hotels. It is a digital imaging device that provides specific information in public places such as hospitals and hospitals.

In addition, the kiosk introduced herein may include various functions such as a previously known store search, a function to display product search results, a product payment function, a reservation function, a parking processing function, etc. Specifies that it is a device that stores and registers.

More specifically, the kiosk 300 having a face recognition and thermal image detection function includes a touch display 310 , an image camera 320 , a thermal image camera 330 , a memory 340 , a user interface unit 350 , and a network. It may include an interface unit 360 and an access number issuing unit 370, and may further include a configuration for performing and processing payment, information search, and the like.

In addition, the kiosk 300 having a face recognition and thermal image detection function may further include an object detector for detecting an object of a preset radius using near-infrared or ultrasonic waves. Thermal imaging and facial recognition are performed automatically. Meanwhile, detailed descriptions of the above-described configuration for payment and information retrieval are omitted as they are the same as those previously known in various documents.

The touch display 310 may be configured to display preset content information and graphic information corresponding to a user's touch input value (location information).

The touch display 310 may generate a driving signal by converting an image signal processed by an information processing unit to be described later, a data signal, or an image signal, a data signal received from an external device interface, into R, G, and B signals, respectively. And, PDP, LCD, OLED, flexible display (flexible display), three-dimensional display (3D display), etc. may be possible.

In addition, the touch display 310 may include a GUI for displaying at least one or more contents, for example, an object.

The video camera 320 may be configured to take a body image of a target located in a preset area based on the above-described object detection signal, and then extract and provide a facial image from the body image.

The thermal imaging camera 330 provides a thermal image of the heat state of the body of a subject located in a preset region based on the above-described object detection signal, and extracts and provides a thermal image of the facial region from among the thermal image. can be configuration.

The video camera and the thermal imaging camera may be located at the same point, and the photographing angle may also be the same.

Next, the information processing unit 340 may be configured to confirm the identity of the entrant based on the facial image transmitted from the image capturing unit, and to determine whether the user is allowed to enter or not based on the thermal image of the facial region.

In addition, when receiving the encryption token from the user terminal through the network interface unit 360 to be described later, the information processing unit 340 may be configured to only determine whether the user can enter or not based on the thermal image of the facial region. have.

The information processing unit 340 may provide the access information (time, date) and heat temperature of the entered user to the platform management server 400 to be described later through the network interface unit 360 .

The information processing unit 340 may be configured to request tracking of the location of the user terminal possessed by the user when the user's facial heating temperature exceeds a preset heating temperature.

Next, the memory 350 may be implemented by an EEPROM (Electrically Erasable Programmable Read-Only Memory) or the like, and stores a program for each signal processing and control in the information processing unit 340 , or a signal-processed image, audio, or It is also possible to store data signals. Also, the memory 350 may perform a function for temporarily storing an image, audio, or data signal input from the user interface unit 360 or the network interface unit 370 .

In addition, the memory 350 may be configured to store a reference of the identity information of the entrant and the face temperature information that can be accessed.

In addition, the memory 340 stores information necessary for manipulation of the touch panel, preset content information corresponding to the touch information, and graphic information. The preset content information may include product information, advertisement information, manual information, and the like.

Next, the user interface unit 360 may be configured to provide an application program interface for executing and manipulating contents displayed on the kiosk.

Next, the network interface unit 370 may be configured to provide a communication interface for a wired or wireless network connection with an external device (not shown), the user terminal 200 and the platform management server 300 .

For example, for connection with a wired network, an Ethernet (Ethernet) terminal or the like may be provided. In addition, for connection with a wireless network, for example, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. is available.

The network interface unit 370 performs a communication input/output function for exchanging data with external components, and can request and receive an encryption token through short-distance communication with a user terminal, and is described above with the platform management server 400 . It is possible to transmit identity confirmation information, facial fever temperature, exit information, and operation state information of the kiosk through one network, and receive operation setting information of the kiosk, information on waiting people for access, and the like from the platform management server 400 .

Next, the access (standby) number issuing unit 380 may be configured to issue an access (standby) number to the user based on the determination result value determined as the identification and/or normal heating temperature from the information processing unit.

The access (standby) number issuing unit 380 may output the issued access (standby) number on paper or transmit it to the touch display panel of the kiosk.

Next, the GPS positioning unit may be configured to track location information of a user who has entered a store or a designated indoor place, and provides the tracked location information to a store terminal.

The GPS positioning unit uses a plurality of positioning terminals to position the user's location information using a triangulation technique, a fingerprinting technique, and the like.

Indoor positioning result information may be provided as a 3D map from the store terminal in conjunction with the LBS service system. In the case of the triangulation technique, a received signal strength indicator (RSSI) value received from at least three APs (Access Points) is converted into a distance, and a simple equation is applied to calculate the location.

Here, each of the positioning terminals is a terminal equipped with a beacon, a geomagnetic sensor, a gyro sensor, an accelerometer sensor, and a communication module (not shown), and periodically transmits a beacon signal and transmits data It may be a terminal with a function.

Next, the store terminal 500 may be configured to monitor whether or not a customer enters the room whose body temperature and fever temperature exceeds a preset value based on the transmission value of the kiosk and the GSP positioning unit.

The store terminal 500 may be a terminal in which a program for displaying location information of a user moving in an indoor space in a 3D map is installed.

Next, the platform management server 400 may be configured to issue an encryption token obtained by encrypting user information input into the kiosk interworking platform 10 to the user terminal.

In addition, the platform management server 400 converts at least one or more of the time, date, heat temperature, and location information (moving line) in the indoor store to the encrypted text when the kiosk having a facial recognition and thermal image detection function is touched in the issued encryption token. It may be configured to process and record storage.

More specifically, the platform management server 400 may include a platform providing unit 410 , an encryption token generation unit 420 , a kiosk management unit 430 , and an AI search unit 440 .

The platform providing unit 410 functions to provide a kiost interworking platform (app).

The kiosk interworking platform 10 may include applications, programs, web pages, etc. installed or driven in a user terminal through a network.

Here, the web browser is a program that enables the use of a web (World Wide Web) service, and refers to a program that receives and displays hyper text described in HTML (hyper text mark-up languge), for example, Netscape (Netscape). ), Explorer, and Chrome.

In addition, the application means an application on the terminal, for example, includes an app (app) executed in a mobile terminal (smartphone). Apps can be downloaded and installed from the application market, a virtual marketplace where mobile content can be freely bought and sold.

Next, the encryption token issuance unit 420 is the identity information of the user terminal 10, scissor encryption, single substitution encryption, multiple substitution encryption, stream encryption, block encryption (ECB encryption, CBC encryption, CFB encryption, OFB encryption, CTR) Encryption)) may be a configuration for issuing an encryption token to which any one of the encryption structures is applied.

For reference, Caesar encryption is an encryption method that moves and maps a specific location. If the encryption key is z, it maps to C that has moved from A to Z. When AB is encrypted, it is encrypted with a CD moved by Z. Next, the single substitution cipher has a structure in which characters are mapped and encrypted using a substitution table, the multiple substitution cipher is encryption in which N characters are substituted by assigning integer values to plaintext characters, and stream encryption is in bits and bytes. It is an in-key stream XOR encryption structure, and block encryption is a structure in which an input block of a fixed length is converted into an output block, and plaintext is encrypted for each fixed block. ECB (plaintext block encryption), DES ( Block 64-bit partition encryption), AES (block 128-bit partition encryption), CBC (in the same way as ECB, plaintext is encrypted by blocking and XOR-encrypted using a specific key value), CFB (padding) Encryption in any one of block-level encryption without stream encryption (bit unit), OFB (encryption used for video, audio data and analog signals), and CTR (plaintext block and keystream XOR operation encryption) is a form of

In addition, the encryption token issuance unit 420 is provided by the kiosk in the encryption token issued to the user terminal, at least one or more of the time, date, heat temperature, and location information (moving line) in the indoor store when the user touched the kiosk. may be of a configuration for recording and storing by encrypting in any one of the above-described encryption types.

The encryption token issued by the encryption token issuing unit 420 may be decrypted in the kiosk interworking platform 10 executed in the user terminal.

Meanwhile, the encryption token issuing unit 420 may execute various encryption algorithms (RSA encryption algorithm, HASH encryption algorithm, DES encryption algorithm, AES encryption algorithm, SPEED encryption algorithm, etc.).

Next, the kiosk management unit 430 may be configured to manage location information and operation state (including normal and abnormal states) information of the kiosk having a facial recognition and thermal image detection function.

Next, the AI search unit 440 may be configured to search the kiosk location information input from the user terminal 200 and store information in which the corresponding kiosk is located through the AI algorithm.

For reference, the AI search unit 224 refines unstructured data, structured data, and semi-structured data included in the stored raw data in order to build big data, and uses it as metadata. Preprocessing including classification may be performed, and analysis including data mining may be performed on the preprocessed data.

In addition, it is possible to provide information that visualizes the analyzed data. At this time, data mining is a classification that predicts a class of new data by learning a training data set with a known class by exploring the inherent relationship between preprocessed data, or grouping data based on similarity without class information. clustering) can be performed. Of course, there may be various other mining methods, and mining may be performed differently depending on the type of big data to be collected and stored or the type of query to be requested later. Big data constructed in this way can be verified through artificial neural network deep learning or machine learning. At this time, the artificial neural network can use a convolutional neural network (CNN) structure, which is a network structure using a convolutional layer and is suitable for image processing. because it can In addition, text mining is a technology for the purpose of extracting and processing useful information from non/semi-structured text data based on natural language processing technology. Through text mining technology, it is possible to extract meaningful information from a large collection of texts, identify links with other information, find categories of texts, or obtain results beyond simple information search.

4 to 6 are flowcharts for explaining various examples of an access control method using a kiosk system having facial recognition and thermal image detection functions according to an embodiment of the present invention.

4 to 6 , in the access control method ( S700 ) using the kiosk system having a facial recognition and thermal image detection function according to an embodiment of the present invention, first, the platform 10 in the user terminal 200 is By using the issuance of an access waiting number table for the store to be visited (S710).

After that, when the user with the user terminal is located in a preset area of the store, the kiosk 300 detects the user's face recognition and body temperature fever, and then outputs the detection result as a screen or voice (S720) and , If it is impossible to verify the user's identity among the detection results or if the facial body temperature exceeds the preset temperature, the GPS measurement unit requests indoor location tracking of the user terminal and transmits the tracked indoor location information of the user terminal to the store terminal. Request (S730).

Thereafter, the store terminal 500 monitors whether the user terminal 200 for which the location tracking is requested enters the room (S740).

On the other hand, the access control method ( S700 ) using a kiosk system having a facial recognition and thermal image detection function according to an embodiment of the present invention is performed before the step of receiving the access waiting number ticket, which is before the S710 process, in the platform management server. The method may further include issuing (S701) an encryption token obtained by encrypting user information input into the platform to the user terminal.

Here, the encryption token may be a program that records and stores at least one of the contact time, date, heating temperature, and location information in the store as encrypted text.

In addition, the access control method ( S700 ) using a kiosk system having a facial recognition and thermal image detection function according to an embodiment of the present invention recognizes a user of a user terminal issued an encryption token from the platform management server 400 . The method may further include a process of recording and storing the time, date, fever temperature, and entry in the store (including indoor movement information) in the encryption token from the temperature-checked kiosk to when the user touched the kiosk.

By using a kiosk operating based on thermal image detection according to an embodiment of the present invention and an O2O platform interworking therewith, it is possible to block an infected person with fever from entering a store in a narrow space, and It has the advantage of being able to easily find people with fever symptoms even if they sneak into an indoor store by tracking the location of the terminal.

In addition, by providing reservation and waiting status online, the user can check the order information and make a reservation, so that it is possible to suppress the crowding phenomenon in which a large number of people are crowded due to waiting in a narrow place at a certain time.

In addition, if identification information is registered in the platform before visiting the store, it provides the advantage of being able to easily enter the store through a simple temperature check process after confirming the location information of the user terminal in which the identification information is registered.

7 is a diagram illustrating an example computing environment in which one or more embodiments disclosed herein may be implemented, and is an illustration of a system 1000 including a computing device 1100 configured to implement one or more embodiments described above. shows For example, computing device 1100 may be a personal computer, server computer, handheld or laptop device, mobile device (mobile phone, PDA, media player, etc.), multiprocessor system, consumer electronics, minicomputer, mainframe computer, distributed computing environments including any of the aforementioned systems or devices, and the like.

The computing device 1100 may include at least one processing unit 1110 and a memory 1120 . Here, the processing unit 1110 may include, for example, a central processing unit (CPU), a graphic processing unit (GPU), a microprocessor, an Application Specific Integrated Circuit (ASIC), Field Programmable Gate Arrays (FPGA), etc. and may have a plurality of cores. The memory 1120 may be a volatile memory (eg, RAM, etc.), a non-volatile memory (eg, ROM, flash memory, etc.), or a combination thereof. Additionally, the computing device 1100 may include additional storage 1130 . Storage 1130 includes, but is not limited to, magnetic storage, optical storage, and the like.

The storage 1130 may store computer readable instructions for implementing one or more embodiments disclosed herein, and other computer readable instructions for implementing an operating system, an application program, and the like. Computer readable instructions stored in storage 1130 may be loaded into memory 1120 for execution by processing unit 1110 . Computing device 1100 may also include input device(s) 1140 and output device(s) 1150 .

Here, the input device(s) 1140 may include, for example, a keyboard, mouse, pen, voice input device, touch input device, infrared camera, video input device, or any other input device, or the like. Further, the output device(s) 1150 may include, for example, one or more displays, speakers, printers, or any other output device, or the like. Also, the computing device 1100 may use an input device or an output device included in another computing device as the input device(s) 1140 or the output device(s) 1150 . Computing device 1100 may also include communication connection(s) 1160 that enable computing device 1100 to communicate with other devices (eg, computing device 1300 ).

Here, communication connection(s) 1160 may be a modem, network interface card (NIC), integrated network interface, radio frequency transmitter/receiver, infrared port, USB connection, or other for connecting computing device 1100 to another computing device. It may include interfaces. Further, the communication connection(s) 1160 may include a wired connection or a wireless connection. Each component of the computing device 1100 described above may be connected by various interconnections such as a bus (eg, peripheral component interconnection (PCI), USB, firmware (IEEE 1394), optical bus structure, etc.) and may be interconnected by a network 1200 . As used herein, terms such as "component," "system," and the like, generally refer to a computer-related entity that is hardware, a combination of hardware and software, software, or software in execution.

For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. For example, both an application running on a controller and a controller may be a component. One or more components may reside within a process and/or thread of execution, and components may be localized on one computer or distributed between two or more computers.

The present invention is not limited by the above embodiments and the accompanying drawings. For those of ordinary skill in the art to which the present invention pertains, it will be apparent that components according to the present invention can be substituted, modified and changed without departing from the technical spirit of the present invention.

100: Kiosk system with facial recognition and thermal image detection
200: user terminal
300: kiosk
400: platform management server
500: store terminal

Claims (6)

a user terminal that registers facial information on the platform and receives an access waiting number ticket for a store to be visited;
When a customer with the customer terminal is located within the preset distance, after detecting the customer's face recognition and body temperature fever, the detection result is provided to the store terminal, and the customer's body temperature exceeds the preset temperature. a kiosk that requests a GPS positioning unit to transmit location information to a store terminal; and
A kiosk system having a facial recognition and thermal image detection function, comprising a store terminal that monitors whether a customer enters the room with a body temperature and fever temperature exceeding a preset value based on the transmission value of the kiosk and the GSP positioning unit.
According to claim 1,
The kiosk is
a video camera that takes a face image of the person entering;
a thermal imaging camera that detects the face heat temperature of the entrant;
an information processing unit that confirms the identity of the person entering and exits based on the facial image, and determines whether access is possible based on the facial fever temperature; and
A kiosk system having a facial recognition and thermal image detection function, including an access number issuing unit that issues an access number when an identification check and access permission instruction are received from the information processing unit.
3. The method of claim 2,
The information processing unit
A kiosk system having a facial recognition and thermal image detection function for requesting the GPS positioning unit to track the location of the user terminal of the person in question when the facial heating temperature exceeds a preset heating temperature.
According to claim 1,
Further comprising a platform management server that issues an encryption token encrypted user information input into the platform to the user terminal,
The platform management server
A kiosk system having a facial recognition and thermal image detection function, characterized in that in the encryption token, at least one of a contact time, date, heat temperature, and location information in a store is recorded and stored in encrypted text.
Receiving an access waiting number ticket for a store to be visited by using the platform in the user terminal;
when the user carrying the user terminal is located in a preset area of the store, the kiosk detects the user's face recognition and body temperature fever, and then displays a detection result;
Among the detection results, if the identification of the user is impossible or the facial body temperature exceeds the preset temperature, the GPS measurement unit requests indoor location tracking of the user terminal and requests to transmit the tracked indoor location information of the user terminal to the store terminal. step; and
An access control method using a kiosk system having facial recognition and thermal image detection functions, comprising the step of monitoring whether a user terminal for which location tracking is requested from a store terminal enters the room.
6. The method of claim 5,
Prior to the step of issuing the access waiting number table,
Further comprising the step of issuing an encryption token obtained by encrypting user information input into the platform by the platform management server to the user terminal,
The encryption token is a kiosk system having a facial recognition and thermal image detection function, characterized in that it is a program that records and stores at least one of the contact time, date, heat temperature, and location information in the store as an encrypted text. Access control method.

Images