CN110647872A

CN110647872A - Device and method for automatically detecting human body characteristics

Info

Publication number: CN110647872A
Application number: CN201911075931.7A
Authority: CN
Inventors: 许启扬; 吴泳波; 林建材; 杨健辉; 何阳
Original assignee: Guangzhou Haopin Information Technology Co Ltd
Current assignee: Guangzhou Haopin Information Technology Co Ltd
Priority date: 2019-11-06
Filing date: 2019-11-06
Publication date: 2020-01-03

Abstract

The invention discloses a device and a method for automatically detecting human body characteristics, wherein the device comprises a power supply unit, an infrared detection unit, an LED lamp unit, a camera unit, a main control unit and a display unit; the power supply unit is used for providing a voltage source; the infrared detection unit is used for detecting human body approaching and communicating with the main control unit through a UART serial port to inform the current detection state in real time; the LED lamp unit is used for supplementing light for the camera unit; the camera unit is used for capturing human body images, is connected to the main control unit through a USB and transmits the captured human body images to the main control unit; the main control unit is responsible for carrying out data processing and analysis on the received human body image by adopting back-end software to realize face analysis and output a judgment result; the display unit displays the judgment result; the determination result is transmitted to the remote server, and the remote server transmits the registered data to the external device according to the determination result. The invention can realize the function of helping shopping guide to quickly and accurately position the member requirement.

Description

Device and method for automatically detecting human body characteristics

Technical Field

The invention relates to the technical field of image analysis and face recognition, in particular to a device and a method for automatically detecting human body characteristics.

Background

At present, commercial development competition is intensified, and member mechanism stores in various forms and different scales are produced in order to enable more consumer groups to draw close and show own brand advantages. As the accumulated customer groups reach a certain scale, the difficulty of manually memorizing the members is very high, and unpleasantness caused by misidentification may be generated; when the customer flow is large, BA (shopping guide) cannot give consideration to each customer, so that member customers can not pay attention to psychology, and the service image of stores can be influenced; the store shopping guide mobility is high, and the member information loss rate is high; shopping guide can not quickly and accurately position member requirements, and needs to know client requirements through long-time communication.

Disclosure of Invention

The technical problem to be solved by the present invention is to provide a device and a method for automatically detecting human body characteristics, which provide a hardware and method support to help shopping guide to quickly and accurately locate member requirements, in view of the above-mentioned deficiencies of the prior art.

In order to solve the technical problems, the technical scheme adopted by the invention is as follows: a device for automatically detecting human body characteristics comprises a power supply unit, an infrared detection unit, an LED lamp unit, a camera unit, a main control unit and a display unit; the power supply unit is used for providing a voltage source for the infrared detection unit, the camera unit, the main control unit and the display unit; the infrared detection unit is used for detecting human body approaching and communicating with the main control unit through a UART serial port to inform the current detection state in real time; the LED lamp unit is used for supplementing light for the camera unit; the camera unit is used for capturing human body images, is connected to the main control unit through a USB and transmits the captured human body images to the main control unit; the main control unit is responsible for carrying out data processing and analysis on the received human body image by adopting back-end software to realize face analysis and output a judgment result; the display unit displays the judgment result; the determination result is transmitted to the remote server, and the remote server transmits the registered data to the external device according to the determination result.

In the above technical solution, the infrared detection unit adopts an infrared detection chip U1 as a sensor for human body detection; one end of the resistor R5 is connected with an OMTIME pin of the U1, and the other end of the resistor R5 is grounded; the resistor R5 is used for adjusting the time length of high level output when the REL pin is triggered, the C1 capacitor is used as a filter capacitor of the power supply of the U1, and the REL pin of the U1 is connected to the I/O pin of the main control unit and used for detecting the approaching state of a human body.

In the above technical solution, the LED lamp unit includes an atmosphere lamp circuit and a light supplement lamp circuit.

In the above technical solution, the atmosphere lamp circuit: the main control unit is connected to the LED lamp strip through a P1 port, the field effect transistor Q6 is used as a switch tube for controlling the LED lamp strip, the grid electrode of the field effect transistor Q6 is connected to the collector electrode of the triode Q1, and the field effect transistor Q6 is controlled by the triode Q1; the collector of the triode Q1 is connected with the resistor R1, and the other end of the resistor R1 is pulled up to a power supply end of 12V, so that the triode Q1 is ensured to be conducted in a default state, and the grid of the field effect transistor Q6 is at a low level in the default state, namely the field effect transistor Q6 is closed; the base electrode of the triode Q1 is connected to an IO port of the main control unit through R1, and the main control unit controls the LED lamp strip to be opened or closed through the IO port; the IO port of the main control unit outputs low level to an interface LED1 of the LED lamp strip, and then the atmosphere lamp is started; the IO port of the master control unit outputs a high level to the interface LED1, and the ambience lamp is turned off.

In the above technical solution, the fill-in light circuit includes a driving chip U5, and a +12V power supply is connected to a zener diode D6 through a resistor R4, thereby generating a power supply to be provided to a VDD pin of U5; the EN pin of U5 is connected to the VDD pin of resistor R22 connected to U5, making U5 in an enabled state by default; a DIM pin of the U5 is used for controlling the U5 to be turned on or off; a DIM pin of the U5 is controlled by a triode Q2, a collector of the Q2 is connected to a VDD pin of the U5 through a resistor R72, a base of the Q2 is connected to the VDD pin of the U5 through a resistor R23, so that the DIM pin of the U5 is in a low level state, that is, the LED is in an off state by default, one end of the resistor R24 is connected to the base of the Q2, the other end of the resistor R24 is connected to the main control unit through an interface LED2, the main control unit gives a high level to the interface LED2 through an IO port, the Q2 is turned on, the DIM pin of the U5 is in a low level, a fill light LED1, an LED2, an LED3 of the USB camera is turned off, the interface gives a low level to the interface LED2 through the IO port, the Q9 is turned off, then the DIM pin of the U695; the LED1, the LED2, the LED3, the L2 and the D5 form a loop, when the SW pin of the U5 is opened, current circulates through the LED1, the LED2, the LED3, the L2 and the SW pin, and at the moment, the L2 stores energy; when the SW pin of U5 is turned off, current circulates through LED1, LED2, LED3, L2, and D5, and at this time, D5 serves as a freewheeling diode; one end of the resistor R21 is connected to GND, and the other end of the resistor R21 is connected to the CS pin of the U5 and is used for adjusting the brightness of the LED1, the LED2 and the LED 3; the TOFF pin of U5 is connected to GND through capacitor C24 for adjusting the switching frequency of U5.

In the above technical solution, the camera unit includes an image acquisition chip U1 and a DSP chip, and the DSP chip is used to control the image acquisition chip U1; a plurality of capacitors connected in parallel and 0.1UF are adopted to respectively provide a filter circuit for DOVDD, VDDA _ SEN and DVDD of an image acquisition chip U1; and a plurality of capacitors connected in parallel and used for 0.1UF are used for providing filter circuits for two power supplies of VDD33 and VDD12 of the DSP chip respectively.

In the above technical solution, the power conversion circuit is further included, and the voltage conversion chip U4 converts the DC-5V voltage into the voltage sources required by VDD33, VDDA _ SEN, DOVDD, DVDD and VDD12, and provides the voltage sources to the circuits of the camera.

In the above technical solution, the main control unit includes a main control chip U1W, which adopts a chip of RK3399 type; the DDR pin of the main control chip U1W is connected with the DDR memory chip to provide the memory for the main control unit.

In the above technical solution, the power supply unit includes a power management chip U4, and adopts a chip of RK808 type.

A method for automatically detecting human body features adopts the device for automatically detecting human body features; firstly, inputting character information in a main control unit, wherein the character information at least comprises face image information, character name information, gender information and contact information, and the main control unit transmits the character information to a remote server for storage; then when the person approaches, the infrared detection unit detects the approach of the human body, the camera unit is started to collect face image information of the person, the collected face image information close to the person is transmitted to the main control unit to be processed and analyzed by the back-end software, compared with the face image information recorded in advance, and finally a judgment result is output, the person is judged to be not recorded in advance, the display unit displays the face image information to remind a manager, the person is judged to be recorded in advance, the face image information is transmitted to the remote server through the network, and the remote server sends the registered person information of the person recorded in advance to external equipment held by the manager.

The invention has the beneficial effects that:

1. adopt intelligent store management mode like this embodiment, realize pinpointing and remind the shopping guide to store customer identity in the time of the utmost point, avoid producing because of the mistake recognition leads to the customer unpleasant, promote customer experience and satisfaction. The member customer information is stored in the remote server, so that the loss of the customer information caused by the flow of shopping guide of stores is effectively prevented. The accurate analysis and positioning of the shopping guide to the member requirements are ensured, and the success rate of the transaction is improved.

2. The device composed of the power supply unit, the infrared detection unit, the LED lamp unit, the camera unit, the main control unit and the display unit realizes human body induction and face recognition of a visitor and outputs a judgment display result. The circuit design structure has strong reliability, and the filter circuits arranged at multiple positions can provide good anti-interference performance, thereby ensuring the accuracy of transmission, analysis and the like of image data.

Drawings

Fig. 1 is a block circuit diagram of the apparatus of the present invention.

FIG. 2 is a flow chart of the customer information entry of the present invention.

Fig. 3 is a flow chart of store customer information analysis of the present invention.

Fig. 4 is a schematic circuit diagram of the infrared detection unit of the present invention.

Fig. 5 is a circuit schematic of an ambient light circuit in an LED lamp unit of the present invention.

Fig. 6 is a schematic circuit diagram of a fill light circuit in an LED lamp unit according to the present invention.

Fig. 7 is a schematic circuit diagram of an image capture chip in the camera unit of the present invention.

Fig. 8 is a schematic circuit diagram of a filter circuit of an image pickup chip in the camera unit of the present invention.

Fig. 9 is a circuit schematic of the DSP circuit in the camera unit of the present invention.

Fig. 10 is a circuit schematic diagram of a filter circuit of the DSP circuit in the camera unit of the present invention.

Fig. 11 is a schematic circuit diagram of a power conversion circuit in the camera unit of the present invention.

Fig. 12 is a circuit schematic of (part of) the master control unit of the present invention.

Fig. 13 is a schematic circuit diagram of a memory chip in the main control unit according to the present invention.

Fig. 14 is a circuit schematic diagram of a filter circuit of a memory chip in the main control unit according to the present invention.

Fig. 15 is a circuit schematic of the power supply unit of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings.

The automatic human body feature detection method comprises the steps that firstly, customer information is input in a main control unit, the customer information at least comprises face image information, customer name information, gender information and contact information, and the main control unit transmits the customer information to a remote server for storage; then when the customer is at home, the infrared detection unit detects the approach of the human body, the camera unit is started to collect the face image information of the customer, the collected face image information of the customer at home is transmitted to the main control unit to be processed and analyzed by the back-end software, compared with the face image information recorded in advance, and finally a judgment result is output, the customer is judged to be a new customer or a common customer, the customer is displayed by the display unit to remind shopping guide, the customer is judged to be a member customer, the customer information and the consumption record of the member customer are transmitted to the remote server through the network, and the remote server sends the registered customer information and the consumption record of the member customer to the external equipment held by the shopping guide.

As shown in fig. 2, the client information input flow chart of the device is that the device takes a picture of a store client through a camera, stores face image information of the client, inputs information such as name, sex, age, contact way and the like of the client, and transmits the client information to a remote server through a network port.

Fig. 3 shows a flow chart of store customer information analysis. When a customer enters a store, the device detects the approach of a human body through infrared rays, and then judges whether the customer currently enters the store is a new customer or a VIP customer through face analysis. If the customer is a store new customer, the BA is informed through the device that the customer is the store new customer. In the case of a store VIP customer, the device transmits customer information to a remote server via a network, and analyzes the current customer's purchasing preferences via the server while feeding back the customer's information to the BA via the network.

Fig. 1 is a circuit diagram of an apparatus for automatically detecting human body characteristics, which is composed of a power supply, an infrared detector, a camera, a RK3399 main control circuit, a 13.3 inch display screen and a remote server.

1. The infrared is used for detecting human body approaching, and communicates with the RK3399 main control board circuit through the UART serial port to inform the system of the current detection state in real time.

2. The LED lamp is used as a light supplement lamp of the camera, and the image capturing effect of the system under low illumination is improved.

3. The camera captures human body images, is connected to the RK3399 main control board through a USB, and transmits the captured images to the main control system, and after the RK3399 main control receives the images, the images are processed through back-end software, so that the face analysis is realized.

4. The RK3399 main control circuit is used as a core processing module of the whole system and is responsible for logic and data processing of the whole system.

5. The working flow of the device is as follows: after the infrared light supplement lamp LED lamp is turned on by the system after the human body is detected to be close to the system, the screen is lightened, meanwhile, the camera starts to capture human body images, after the human body images are acquired by the RK3399 main control circuit, the current store-arriving customer is judged to be a new customer or a VIP customer through face analysis, if the store-arriving customer is a store-arriving customer, the BA is informed of the arrival of the new customer, and if the store-arriving customer is a store-arriving VIP customer, the purchase preference of the current customer is analyzed through the remote server, and the BA is.

As shown in fig. 4, the infrared detection circuit adopts a pyroelectric digital intelligent sensor AM412 as a human body detection sensor, a resistor R5 is used for adjusting the time length of outputting a high level when the REL pin is triggered, R5 sets the time of outputting the high level to be 2.3S for 0 ohm, a C1 capacitor is used as a filter capacitor of the U1, and the REL pin of the U1 is connected to an I/O pin of the RK3399 main control circuit and is used for detecting the state of approaching a human body.

As shown in fig. 5, as an atmosphere lamp circuit of the system, the atmosphere lamp circuit is connected to the LED strip through a P1 port, and the field effect transistor Q6 is used as a switch tube for controlling the LED strip. The gate of fet Q6 is connected to the collector of transistor Q1, and fet Q6 is controlled by transistor Q1. The collector of the transistor Q1 is connected to the R1, and the other end of the R1 is pulled up to the 12V power supply terminal, so that the transistor Q1 is turned on by default, and the gate of the fet Q6 is turned off by default, i.e., the fet Q6 is turned off by default. The base electrode of the triode Q1 is connected to an IO port of the RK3399 main control circuit through R1, and the RK3399 main control circuit controls the turning on or off of the atmosphere lamp through the IO port. An IO port of the RK3399 main control circuit outputs low level to an LED1 interface, and then the atmosphere lamp is started; the IO port of the RK3399 master control circuit outputs a high level to the LED1 interface, then the atmosphere lamp is off.

As shown in fig. 6, the fill-in light circuit is used as a camera fill-in light of the system, and U5 is used as a driving chip, and +12V power is connected to a zener diode D6 through a resistor R4, thereby generating a power of about 5.6V to be supplied to the VDD pin of U5. The EN pin of U5 is connected to the VDD pin of resistor R22 connected to U5, causing U5 to be in an enabled state by default. A DIM pin of the U5 is used for controlling the U5 to be turned on or off; the DIM pin of the U5 is controlled by a triode Q2, the collector of Q2 is connected to the VDD pin of the U5 through a resistor R72, the base of Q2 is connected to the VDD pin of the U5 through R23, so that the DIM pin of the U5 is in a low level state, that is, the LED is in an off state by default, one end of the resistor R24 is connected to the base of the Q2, the other end of the resistor R24 is connected to the RK3399 main control circuit through a signal LED2, the RK3399 main control circuit gives a high level to the LED2 through IO, Q2 is turned on, the DIM pin of the U5 is in a low level, the fill light LEDs 1, the LEDs 2 and the LEDs 3 of the USB camera are turned off, the RK3399 main control circuit gives a low level to the LED2 through an IO port, and the Q2 is turned off, so that the DIM pin of the U5 is. The LED1, the LED2, the LED3, the L2 and the D5 form a loop, when the SW pin of the U5 is opened, current circulates through the LED1, the LED2, the LED3, the L2 and the SW pin, and at the moment, the L2 stores energy; when the SW pin of U5 is off, current circulates through LED1, LED2, LED3, L2, D5, where D5 acts as a freewheeling diode. The capacitor C25 is used as a filter capacitor and is connected to the VDD pin of U5. The resistor R21 has one end connected to GND and the other end connected to the CS pin of the U5, and is used for adjusting the brightness of the LED1, the LED2 and the LED 3. The TOFF pin of U5 is connected to GND through capacitor C24 for adjusting the switching frequency of U5.

As shown in fig. 7, the image imaging employs an MI5100 chip, which is a COMS image chip of 500 ten thousand pixels. As shown in fig. 8, the circuit is a power supply filter circuit of an MI5100 image acquisition chip, and a 0.1UF capacitor is adopted to provide the filter circuit for three power supplies, namely, a doddd power supply, a VDDA _ SEN power supply and a DVDD power supply.

As shown in fig. 9: the circuit is a circuit diagram of a DSP chip for image processing, and an SN9C5259AFG chip is adopted as an MI5100 image chip for controlling the image processing circuit in the image processing circuit 7. As shown in FIG. 10, the power supply filter circuit of the DSP image chip of the circuit adopts a 0.1UF capacitor to provide filter circuits for VDD33 and VDD12 respectively.

As shown in fig. 11, the circuit is a power conversion circuit. The DC-5V voltage is converted into voltage sources of VDD33, VDDA _ SEN, DOVDD, DVDD, and VDD12 by a voltage conversion chip, and is supplied to each circuit part of the camera.

FIG. 12 shows a partial pin diagram of the RK3399 host chip. The capacitances C1, C2, C3, C4, and C5 are filter capacitances of VDD _ CPU _ B, VDD _ CPU _ L, VDD _ LOG, VDD _ GPU, and VDD _ CENTER, respectively. Fig. 13 shows a DDR pin portion of the RK3399 main control chip, which is connected to a DDR memory chip to provide memory for the main control circuit. As shown in fig. 14, a filter circuit of the DDR memory chip is provided, and a capacitor and a resistor of the filter circuit provide a power supply filtering function for the DDR memory chip.

Shown in FIG. 15 is RK808 power management circuit. RK808 is a complete power supply solution for portable systems. The high-integration circuit comprises a four-way step-down DC/DC converter, 8 high-performance Idos, two low Rds switches, an IIC interface, a programmable power supply sequence and a real-time clock. The RK808 improves performance, reduces component count and size, and therefore provides a lower cost solution compared to conventional portable designs. The ultra-fast 2MHz current mode DC/DC architecture optimizes transient performance and is compatible with miniature low cost ceramic inductors and capacitors. All DC/DC channels include integrated MOSFETs. The internal soft start and compensation circuitry minimizes the number of external components. Most of the outputs can be programmed through the IIC interface. And the RK808 power management circuit provides required power for the RK3399 main control chip.

The above examples are intended to illustrate rather than to limit the invention, and all equivalent changes and modifications made by the methods described in the claims of the present invention are intended to be included within the scope of the present invention.

Claims

1. An apparatus for automatically detecting human body characteristics, comprising: the LED lamp comprises a power supply unit, an infrared detection unit, an LED lamp unit, a camera unit, a main control unit and a display unit; the power supply unit is used for providing a voltage source for the infrared detection unit, the camera unit, the main control unit and the display unit; the infrared detection unit is used for detecting human body approaching and communicating with the main control unit through a UART serial port to inform the current detection state in real time; the LED lamp unit is used for supplementing light for the camera unit; the camera unit is used for capturing human body images, is connected to the main control unit through a USB and transmits the captured human body images to the main control unit; the main control unit is responsible for carrying out data processing and analysis on the received human body image by adopting back-end software to realize face analysis and output a judgment result; the display unit displays the judgment result; the determination result is transmitted to the remote server, and the remote server transmits the registered data to the external device according to the determination result.

2. The apparatus of claim 1, wherein: the infrared detection unit adopts an infrared detection chip U1 as a sensor for human body detection; one end of the resistor R5 is connected with an OMTIME pin of the U1, and the other end of the resistor R5 is grounded; the resistor R5 is used for adjusting the time length of high level output when the REL pin is triggered, the C1 capacitor is used as a filter capacitor of the power supply of the U1, and the REL pin of the U1 is connected to the I/O pin of the main control unit and used for detecting the approaching state of a human body.

3. The apparatus of claim 1, wherein: the LED lamp unit comprises an atmosphere lamp circuit and a light supplement lamp circuit.

4. The apparatus of claim 3, wherein the atmosphere lamp circuit: the main control unit is connected to the LED lamp strip through a P1 port, the field effect transistor Q6 is used as a switch tube for controlling the LED lamp strip, the grid electrode of the field effect transistor Q6 is connected to the collector electrode of the triode Q1, and the field effect transistor Q6 is controlled by the triode Q1; the collector of the triode Q1 is connected with the resistor R1, and the other end of the resistor R1 is pulled up to a power supply end of 12V, so that the triode Q1 is ensured to be conducted in a default state, and the grid of the field effect transistor Q6 is at a low level in the default state, namely the field effect transistor Q6 is closed; the base electrode of the triode Q1 is connected to an IO port of the main control unit through R1, and the main control unit controls the LED lamp strip to be opened or closed through the IO port; the IO port of the main control unit outputs low level to an interface LED1 of the LED lamp strip, and then the atmosphere lamp is started; the IO port of the master control unit outputs a high level to the interface LED1, and the ambience lamp is turned off.

5. The apparatus of claim 3, wherein the human body characteristic detecting device comprises: the supplementary lighting circuit comprises a driving chip U5, a +12V power supply is connected to a voltage stabilizing diode D6 through a resistor R4, and therefore a power supply is generated and provided for a VDD pin of U5; the EN pin of U5 is connected to the VDD pin of resistor R22 connected to U5, making U5 in an enabled state by default; a DIM pin of the U5 is used for controlling the U5 to be turned on or off; a DIM pin of the U5 is controlled by a triode Q2, a collector of the Q2 is connected to a VDD pin of the U5 through a resistor R72, a base of the Q2 is connected to the VDD pin of the U5 through a resistor R23, so that the DIM pin of the U5 is in a low level state, that is, the LED is in an off state by default, one end of the resistor R24 is connected to the base of the Q2, the other end of the resistor R24 is connected to the main control unit through an interface LED2, the main control unit gives a high level to the interface LED2 through an IO port, the Q2 is turned on, the DIM pin of the U5 is in a low level, a fill light LED1, an LED2, an LED3 of the USB camera is turned off, the interface gives a low level to the interface LED2 through the IO port, the Q9 is turned off, then the DIM pin of the U695; the LED1, the LED2, the LED3, the L2 and the D5 form a loop, when the SW pin of the U5 is opened, current circulates through the LED1, the LED2, the LED3, the L2 and the SW pin, and at the moment, the L2 stores energy; when the SW pin of U5 is turned off, current circulates through LED1, LED2, LED3, L2, and D5, and at this time, D5 serves as a freewheeling diode; one end of the resistor R21 is connected to GND, and the other end of the resistor R21 is connected to the CS pin of the U5 and is used for adjusting the brightness of the LED1, the LED2 and the LED 3; the TOFF pin of U5 is connected to GND through capacitor C24 for adjusting the switching frequency of U5.

6. The apparatus of claim 1, wherein: the camera unit comprises an image acquisition chip U1 and a DSP chip, and the DSP chip is used for controlling the image acquisition chip U1; a plurality of capacitors connected in parallel and 0.1UF are adopted to respectively provide a filter circuit for DOVDD, VDDA _ SEN and DVDD of an image acquisition chip U1; and a plurality of capacitors connected in parallel and used for 0.1UF are used for providing filter circuits for two power supplies of VDD33 and VDD12 of the DSP chip respectively.

7. The apparatus of claim 6, wherein: the power conversion circuit is also included, and the voltage conversion chip U4 is used for converting the DC-5V voltage into the voltage sources required by VDD33, VDDA _ SEN, DOVDD, DVDD and VDD12, and providing the voltage sources for each circuit of the camera.

8. The apparatus of claim 1, wherein: the main control unit comprises a main control chip U1W and adopts a chip of RK3399 model; the DDR pin of the main control chip U1W is connected with the DDR memory chip to provide the memory for the main control unit.

9. The apparatus of claim 1, wherein: the power supply unit comprises a power management chip U4 and adopts a chip of RK808 model.

10. A method for automatically detecting human body features is characterized in that: use of a device for automatically detecting human body characteristics according to any one of claims 1 to 9; firstly, inputting character information in a main control unit, wherein the character information at least comprises face image information, character name information, gender information and contact information, and the main control unit transmits the character information to a remote server for storage; then when the person approaches, the infrared detection unit detects the approach of the human body, the camera unit is started to collect face image information of the person, the collected face image information close to the person is transmitted to the main control unit to be processed and analyzed by the back-end software, compared with the face image information recorded in advance, and finally a judgment result is output, the person is judged to be not recorded in advance, the display unit displays the face image information to remind a manager, the person is judged to be recorded in advance, the face image information is transmitted to the remote server through the network, and the remote server sends the registered person information of the person recorded in advance to external equipment held by the manager.