WO2020213384A1

WO2020213384A1 - Courier authentication method, courier authentication system, server device, and control device

Info

Publication number: WO2020213384A1
Application number: PCT/JP2020/014716
Authority: WO
Inventors: 田中　直也; 徳田　肇道; 昭年泉
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2019-04-19
Filing date: 2020-03-30
Publication date: 2020-10-22
Also published as: JP2020177545A; JP7378042B2

Abstract

This courier authentication method is a courier authentication method using a voice uttered by a delivery person, the method involving: receiving a voice input signal based on the uttered voice of the delivery person collected by a voice input terminal; extracting identification information capable of identifying the delivery person on the basis of the received voice input signal, ; determining whether or not the extracted identification information on the delivery person is registered, by referring to a database including the respective pieces of identification information on the delivery persons of a plurality of couriers that are registered in advance; and performing control to unlock an automatic locking system for controlling admission to a predetermined area that is accessible to the front door of the house of the delivery destination when the identification information on the delivery person is registered.

Description

Courier authentication method, courier authentication system, server device and control device

This disclosure relates to a courier authentication method, a courier authentication system, a server device, and a control device.

In Patent Document 1, in an apartment house in which an entrance management system for managing entrance is installed, a face image of a person who is permitted to enter the apartment house in advance is stored, and a person who enters the apartment house. If the person whose face image is memorized by collating the face image detected from the photographed image with the face image of the memorized person, admission is permitted and the delivery person is allowed to deposit the goods. The article management system to be used is disclosed.

Japanese Patent Application Laid-Open No. 2003-276489

However, in the configuration of Patent Document 1, for example, in an existing private house or an apartment house that is not equipped with equipment for authenticating a face image, it is not possible to allow a courier to deposit goods. Further, in such a case, the courier company has to redeliver the goods, which causes a problem that the load on the courier company increases and the business efficiency decreases.

The present disclosure is devised in view of the above-mentioned conventional circumstances, and provides a courier authentication method, a courier authentication system, a server device, and a control device that can reduce the work load due to redelivery of a courier due to the absence of a recipient. The purpose is to do.

The present disclosure is a delivery company authentication method using the voice of a delivery person, which receives a voice input signal based on the voice of the delivery person picked up by a voice input terminal and receives the voice input signal. The identification information that can identify the delivery person is extracted based on the above, and the identification information of the delivery person is extracted by referring to the database including the identification information of each of the delivery persons of the plurality of courier companies registered in advance. Is registered, and if the delivery person's identification information is registered, an automatic locking system that controls admission to a predetermined area accessible in front of the entrance of the delivery destination house is installed. Provide a delivery company authentication method for unlocking control.

Further, the present disclosure is a courier authentication system capable of communicating between a control device that controls an automatic locking system and a server device, and the control device is used for the voice of a delivery person picked up by a voice input terminal. Based on the voice input signal, the received voice input signal is transmitted to the server device, and the server device extracts identification information that can identify the delivery person based on the received voice input signal. , It is determined whether or not the extracted identification information of the delivery person is registered by referring to the database including the identification information of each of the delivery persons of the plurality of delivery companies registered in advance, and the delivery person's identification information is determined. When the identification information is registered, an unlocking signal permitting the unlocking of the automatic locking system is generated and transmitted to the control device, and the control device is based on the received unlocking signal. To provide a courier authentication system that controls unlocking of the automatic locking system.

Further, the present disclosure includes an identification information extraction unit that extracts identification information of the delivery person based on a voice input signal based on the voice input of the delivery person received by the voice input terminal, and a plurality of pre-registered home deliveries. A registrant determination unit that determines whether or not the extracted identification information of the delivery person is registered by referring to a database containing each identification information of the delivery person of the trader, and a determination result of the registrant determination unit. A server comprising an unlocking permission unit that generates an unlocking permission signal for unlocking an automatic locking system that controls entry permission to a predetermined area accessible in front of the entrance of the delivery destination house. Provide the device.

Further, the present disclosure is whether or not the receiving unit that receives the voice input signal based on the voice of the delivery person by the voice input terminal and whether or not the delivery person is registered with the delivery person of a plurality of pre-registered delivery companies. To the server device that generates the unlocking permission signal of the automatic locking system, the transmitter that transmits the voice input signal and the generated unlocking permission signal are received in front of the entrance of the delivery destination house. Provided is a control device including an unlock control unit for unlocking and controlling an automatic locking system for controlling access permission to a predetermined accessible area.

According to this disclosure, it is possible to reduce the work load due to the redelivery of the courier company due to the absence of the recipient.

The figure explaining the configuration example of the courier authentication system which concerns on Embodiment 1. The figure which shows the system configuration example of the server apparatus which concerns on Embodiment 1. Flow chart showing an example of one-way authentication procedure of courier authentication system Diagram showing an example of identification information of a registered courier company The figure which shows the system configuration example of the server apparatus which concerns on Embodiment 2. Flow chart showing an example of the two-way authentication procedure of the courier authentication system Flow chart showing an example of the utterance detection procedure of the courier authentication system Flow chart showing an example of the authentication procedure by utterance detection of the courier authentication system Diagram explaining an example of utterance detection of a courier authentication system

Hereinafter, each embodiment that specifically discloses the configuration and operation of the courier authentication method, the courier authentication system, the server device, and the control device according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration example of a delivery company authentication system according to the first embodiment. The courier certification system is installed in, for example, a private house or an apartment house. The courier authentication system executes voice authentication based on the voice of the courier delivery person H1. If the courier company delivery person H1 is a pre-registered courier company delivery person, the gate GT2 provided in the private house. Alternatively, the automatic locking system GT provided at the common entrance GT1 of the housing complex is unlocked and controlled.

In the following description, the delivery company authentication system will be described as a system for unlocking the automatic locking system GT installed at the entrance GT1 of the common area of the apartment house, but the automatic locking system GT is provided in, for example, a private house. It may be provided in the gate GT2 or the delivery box GT3 installed in the housing complex. Further, the courier authentication system according to the first embodiment will be described as a system for unlocking and controlling the automatic locking system GT on the assumption that the recipient who receives the goods delivered by the courier H1 of the courier is absent. However, the present invention is not limited to this, and the delivery person H1 of the courier company may be authenticated when the recipient is at home, and the authentication result may be provided to the recipient. The courier company according to the first embodiment indicates a company engaged in a business of delivering goods such as a courier service.

The courier authentication system shown in FIG. 1 includes an intercom Int1, a control device CD1, a server device S1, a registrant database DB1, and an automatic locking system GT.

The intercom Int1 is installed at the common entrance GT1 of the apartment house, and is communicably connected to each of the plurality of intercoms (not shown) installed in each house in the apartment house. The intercom Int1 includes a communication unit 10, a control unit 11, a memory 12, an input unit 13, an output unit 14, and an imaging unit 15.

The communication unit 10 is configured by using a circuit capable of transmitting and receiving data or information to and from the control unit 11. The communication unit 10 transmits a voice input signal based on the utterance voice Msg1 of the delivery person H1 of the courier company picked up by the input unit 13 to the control device CD1. The communication unit 10 is communicably connected to the control device CD1 by a wired LAN (Local Area Network).

The control unit 11 is configured by using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), or an FPGA (Field Programmable Gate Array). The control unit 11 functions as a controller that controls the overall operation of the intercom Int1, controls processing for controlling the operation of each part of the intercom Int1 in cooperation with the memory 12, and data between each part of the intercom Int1. Performs input / output processing, data calculation (calculation) processing, and data storage processing. The control unit 11 operates according to the program and data stored in the memory 12. The control unit 11 uses the memory 12 during operation, and temporarily stores the data or information created or acquired by the control unit 11 in the memory 12.

The memory 12 is, for example, a RAM (Random Access Memory) as a work memory used when executing each process of the control unit 11, and a ROM (Read Only Memory) for storing a program and data defining the operation of the control unit 11. And have. Data or information created or acquired by the control unit 11 is temporarily stored in the RAM. A program that defines the operation of the control unit 11 is written in the ROM. Further, the memory 12 stores the data of the utterance voice Msg1 of the delivery person H1 of the courier company input to the input unit 13, the captured image data captured by the imaging unit 15, and the like together with the time information.

The input unit 13 is, for example, a microphone array constituted by a plurality of microphones (not shown), speech Msg1 courier delivery person H1 (e.g., "is Hi, XX transportation.", Etc.) for collecting. The input unit 13 outputs the utterance voice Msg1 of the delivery person H1 of the courier company, which is picked up from each of the plurality of microphones, to the control unit 11. It should be noted that each of the plurality of microphones may be an omnidirectional microphone, a unidirectional microphone, or a phase directional microphone, or a combination thereof may be used.

The output unit 14 is provided with the speaker 16 and outputs the voice of a resident or an apartment house manager who uses each of the intercoms installed in the residence designated by the visitor such as the delivery person H1 of the courier company.

The imaging unit 15 includes at least a lens 18 and an image sensor (not shown). The image sensor is, for example, a CCD (Charged-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) solid-state image sensor, and converts an optical image imaged on an imaging surface into an electric signal.

The imaging unit 15 is provided so as to be able to image a predetermined imaging area in front of the intercom Int1, and images the delivery person H1 of the delivery company in the imaging area. The imaging unit 15 outputs the captured image data to the control unit 11.

Next, the configuration of the control device CD1 will be described. The control device CD1 is a device capable of executing unlocking control of the automatic locking system GT.

The communication unit 20 as an example of the reception unit and the transmission unit is configured by using a circuit capable of transmitting and receiving data or information between the intercom Int1 and the server device S1. The communication unit 20 transmits the voice input signal received from the intercom Int1 to the server device S1. The communication unit 20 is communicably connected to the intercom Int1 and the server device S1 by a wired LAN.

The unlock control unit 21 is configured by using, for example, a CPU, DSP or FPGA. The control unit 11 functions as a controller that controls the overall operation of the interphone Int1, controls processing for controlling the operation of each part of the control device CD1 in cooperation with the memory 22, and between each part of the control device CD1. Performs data input / output processing, data calculation (calculation) processing, and data storage processing. The unlock control unit 21 operates according to the program and data stored in the memory 22. The unlock control unit 21 uses the memory 22 during operation, and temporarily stores the data or information created or acquired by the unlock control unit 21 in the memory 22. The unlocking control unit 21 generates an unlocking control signal as an example of an unlocking signal for unlocking the automatic locking system GT based on the unlocking permission received from the server device S1, and automatically locks the unlocking control signal. Send to GT.

The memory 22 has, for example, a RAM as a work memory used when executing each process of the unlock control unit 21, and a ROM for storing a program and data defining the operation of the unlock control unit 21. Data or information created or acquired by the unlocking control unit 21 is temporarily stored in the RAM. A program that defines the operation of the unlock control unit 21 is written in the ROM. Further, the memory 22 stores the history information of the unlocking control executed by the unlocking control unit 21 together with the time information.

Next, the configuration of the server device S1 will be described. The server device S1 refers to each of the data D1, D2, ..., Dn stored (registered) in the trader registrant database DB1 based on the voice input signal of the courier delivery person H1 collected by the intercom Int1. To do. The server device S1 includes a communication unit 30, a control unit 31, and a memory 32.

The communication unit 30 is configured by using a circuit capable of transmitting and receiving data or information between the server device S1 and the trader registrant database DB1. The communication unit 30 receives the voice input signal from the intercom Int1 via the control device CD1. The communication unit 30 is communicably connected to the server device S1 and the trader registrant database DB1 by a wired LAN.

The control unit 31 is configured by using, for example, a CPU, DSP or FPGA. The control unit 31 functions as a controller that controls the overall operation of the server device S1, and is a control process for controlling the operation of the unlock determination unit 312 of the server device S1 in cooperation with the memory 32, the server device S1. Performs data input / output processing, data calculation (calculation) processing, and data storage processing with and from each unit. The control unit 31 operates according to the program and data stored in the memory 32. The control unit 31 uses the memory 32 during operation, and temporarily stores the data or information created or acquired by the control unit 31 in the memory 32. The unlocking determination unit 312 will be described later.

The memory 32 has, for example, a RAM as a work memory used when executing each process of the control unit 31, and a ROM for storing a program and data defining the operation of the control unit 31. Data or information created or acquired by the control unit 31 is temporarily stored in the RAM. A program that defines the operation of the control unit 31 is written in the ROM. In addition, the memory 32 stores identification information (for example, a company name) regarding a plurality of delivery companies registered in advance in the company registrant database DB1.

Next, the trader registrant database DB1 will be described. The trader registrant database DB1 is configured to include each of a plurality of data D1, D2, ..., Dn. The identification information includes, for example, the company name of the courier company, the name of the business office, and a personally identifiable number (for example, an employee number) assigned to each delivery person, and one identification information or a plurality of identification informations are combined. This is information that can identify the delivery person. Each of the plurality of data D1, D2, ..., Dn is data in which each of the identification information of the plurality of courier companies registered in advance when using the courier company authentication system is stored. Each of the plurality of data D1, D2, ..., Dn is data that stores the identification information of each of the plurality of courier companies sorted by the courier company, by the courier company's business office, or by the delivery area managed by the courier company. Is.

Next, the automatic locking system GT will be described. The automatic locking system GT is installed between the common area where outsiders can enter in the apartment building and the passage including the route from the common area to the entrance of each house, and the door is automatically closed when the door is closed. It is a system that locks the door. The automatic locking system GT is provided, for example, in a gate GT2 provided in a private house, a common area entrance GT1 in an apartment house, a delivery box GT3, or the like.

The automatic locking system GT executes the unlocking control of the common part entrance GT1 of the apartment house based on the unlocking control signal received from the control device CD1. The automatic locking system GT controls the unlocking of the common part entrance GT1 of the apartment house even if the resident of the house has permission to unlock it through each of the plurality of intercoms installed in each house in the house. To execute.

In the description of the configuration of FIG. 1, the server device S1, the control device CD1, and the interphone Int1 each use a wired LAN (Local Area Network) for the connection between the communication units. The connection is not limited to a wired LAN, as long as the required communication is possible, and a communication path such as a wireless LAN (Local Area Network) may be used for the connection.

FIG. 2 is a diagram showing a system configuration example of the server device S1 according to the first embodiment. Each part constituting the server device S1 will be described with reference to FIG. The contents described in FIG. 1 will be omitted.

The communication unit 30 receives the voice input signal from the intercom Int1 via the control device CD1. Further, the communication unit 30 receives data including identification information about the delivery person H1 of the courier company included in the voice input signal from the trader registrant database DB1 based on the received voice input signal.

The control unit 31 includes an unlocking determination unit 312. The control unit 31 transmits an unlock permission to the control device CD1 based on the determination result by the unlock determination unit 312.

The unlocking determination unit 312 as an example of the unlocking permission unit is a courier company in which the courier company's delivery person H1 is registered using a voice input signal based on the received voice Msg1 of the courier company's delivery person H1. Whether or not it is determined, unlocking control of the automatic locking system GT is permitted based on the determination result, and an unlocking permission signal is generated. The unlocking determination unit 312 includes a voice analysis unit 312a and an identification information determination unit 312b.

The voice analysis unit 312a as an example of the identification information extraction unit analyzes the received voice input signal, and first, first, a predetermined utterance word including the identification information (for example, the company name) about the company included in the voice input signal. Extract. In addition, the voice analysis unit 312a analyzes the received voice input signal and extracts another predetermined utterance word. The voice analysis unit 312a outputs each of the extracted plurality of predetermined utterance words to the identification information determination unit 312b. The voice analysis unit 312a may extract at least one predetermined utterance word from the received voice input signals. In addition, the predetermined utterance word extracted at this time is other identification information (for example, the name of the delivery person, the name of the business office, and the personally identifiable number assigned to each delivery person, even if it is the identification information about the company. Etc.).

The predetermined utterance word is set based on the identification information registered in advance in the trader registrant database DB1, and for example, the name of the delivery person, the company name, the business office name, and the personal identification given to each delivery person can be identified. Number etc. The predetermined utterance word extracted by the voice analysis unit 312a is stored in the memory 32 in advance.

The identification information determination unit 312b as an example of the registrant determination unit is stored in the memory 32 based on a predetermined utterance word regarding the identification information about the company extracted by the voice analysis unit 312a (in other words, the trader registrant database). It is determined whether or not the company is a company (registered in advance in DB1). When the identification information determination unit 312b determines that the company is a registered company, the identification information determination unit 312b refers to the contractor registrant database DB1 based on other predetermined utterance words extracted by the voice analysis unit 312a, and delivers the delivery company. Determine if the person H1 is a pre-registered delivery person. The identification information determination unit 312b outputs an unlocking permission to the control device CD1 when the delivery person H1 of the courier company is a registered delivery person. On the other hand, the identification information determination unit 312b outputs that the control device CD1 is not permitted to unlock when the delivery person H1 of the courier company is an unregistered delivery person.

The memory 32 presets and stores a predetermined utterance word extracted by the voice analysis unit 312a and identification information (for example, a company name) relating to a plurality of companies registered in advance in the trader registrant database DB1. Further, the memory 32 includes the visit time (voice input signal reception time) of the delivery person H1 of the courier who visited for delivery, a predetermined utterance word extracted by the voice analysis unit 312a, and home delivery by the identification information determination unit 312b. The determination result of the delivery person H1 of the trader and the presence / absence of unlocking permission are stored.

FIG. 3 is a flowchart showing an example of the one-way authentication procedure of the courier authentication system. Hereinafter, a one-way authentication procedure based on the utterance voice Msg1 of the delivery person H1 of the courier company executed by the server device S1 will be described with reference to FIG.

The communication unit 30 receives a voice input signal based on the utterance voice Msg1 of the delivery person H1 of the courier company from the intercom Int1 via the control device CD1 (St10).

The voice analysis unit 312a analyzes the received voice input signal. The voice analysis unit 312a includes a predetermined utterance word including identification information (for example, company name) about the delivery company included in the voice input signal and other predetermined utterance words including identification information other than the identification information about the company. It is determined whether or not it is present, and it is extracted (St11).

The identification information determination unit 312b determines whether or not the predetermined utterance word including the extracted identification information about the company is a pre-registered courier company stored in the memory 32 (St12).

When the predetermined utterance word including the identification information about the company extracted in step St12 is the identification information stored in the memory 32, the identification information determination unit 312b determines that it is a registered courier company (St12, YES). ), Connect to the trader registrant database DB1 (St13).

On the other hand, the identification information determination unit 312b determines that the delivery person is not a registered delivery person if the predetermined utterance word including the identification information about the company extracted in step St12 is not the identification information stored in the memory 32 (St12). , NO). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is not permitted to unlock based on the determination result of the identification information determination unit 312b in step St12 (St14).

The identification information determination unit 312b connects to the trader registrant database DB1 in step St13, and is a delivery person of a plurality of courier companies registered in predetermined data (for example, data D1) that stores the extracted identification information about the company. Refer to each of the identification information of (St15).

The identification information determination unit 312b refers to each of the identification information of the delivery person of the plurality of delivery companies, and whether or not the identification information of the delivery person H1 of the delivery company included in the other predetermined utterance word is registered ( In other words, it is determined (whether or not the person is registered in the trader registrant database DB1) (St16).

The identification information determination unit 312b determines that the identification information of the courier H1 included in the other predetermined utterance word in step St16 is the identification information registered in the predetermined data (for example, data D1). Determines that the delivery person H1 of the courier company is a registered courier company (registrant) (St16, YES). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is permitted to unlock based on the determination result of the identification information determination unit 312b in step St16 (St17).

On the other hand, in the identification information determination unit 312b, the identification information of the delivery person H1 of the courier company included in the other predetermined utterance word in step St16 is the identification information that is not registered in the predetermined data (for example, data D1). In some cases, it is determined that the courier delivery person H1 is not a registered delivery person (St16, NO). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is not permitted to unlock based on the determination result of the identification information determination unit 312b in step St16 (St14).

The one-way authentication procedure for the delivery person H1 of the courier company is not limited to the procedure shown in FIG. For example, in the one-way authentication procedure of the courier H1 of the courier, the determination of the identification information regarding the courier in step St12 and the determination of other identification information with reference to the registrant database DB1 may be performed at the same time. , The determination referring to the trader registrant database DB1 may be executed in step St12.

FIG. 4 is a diagram showing an example of identification information TA1 of a registered courier company. The identification information TA1 shown in FIG. 4 is an example, and is not limited to this, and may include, for example, identification information about a business office. Further, the identification information TA1 may include each of the identification information of the delivery person of the delivery company of the plurality of delivery companies and the delivery company of the business office, and when the identification information of the delivery company is registered in the company registrant database DB1, the plurality of companies And each of the delivery person of the courier company of the business office may be registered by giving an identification number (for example, a user number or an employee number) that can be identified.

Further, the identification information may include a feature amount (in other words, information that can identify the individual delivery person based on the voice) representing the individuality of the voice of the delivery person H1 of the courier company. The feature amount indicating the individuality of the voice is, for example, identification information based on the frequency characteristics and the temporal characteristics of the voice, which are different for each individual, and can be used as the personally identifiable identification information.

The registered courier identification information TA1 shown in FIG. 4 includes, for example, a company name, an area in charge, a personally identifiable number (for example, an employee number) assigned to each delivery person, and the name of the delivery person. It is information that can identify a delivery person by combining one identification information or a plurality of identification information. The registered courier company identification information TA1 is stored in the trader registrant database DB1 in association with each courier company. Further, the registered delivery company identification information TA1 may be classified by company, business office, or delivery area, and managed as a plurality of data D1, D2, ..., Dn, respectively.

As described above, in the courier authentication method according to the first embodiment, the server device S1 transmits a voice input signal based on the spoken voice Msg1 of the courier delivery person H1 picked up by the interphone Int1 (an example of a voice input terminal). It receives and extracts identification information that can identify the delivery person H1 of the courier company based on the voice input signal. The server device S1 refers to the trader registrant database DB1 (an example of a database) including the identification information of each of the delivery persons of the plurality of courier companies registered in advance, and identifies the extracted courier company delivery person H1. Determine if the information is registered. The control device CD1 controls admission to a predetermined area accessible in front of the entrance of the delivery destination house when it is determined by the server device S1 that the identification information of the delivery person H1 of the courier company is registered. The automatic locking system GT is unlocked and controlled.

Thereby, the courier authentication method according to the first embodiment can reduce the work load due to the redelivery of the courier H1 due to the absence of the recipient.

(Embodiment 2)
The courier authentication system according to the first embodiment analyzes a voice input signal based on the utterance voice Msg1 input from the courier H1 of the courier, and the courier H1 of the courier company registers in advance in the registrant database DB1. The case where it is judged whether or not it is a courier company that has been delivered is shown. The courier authentication system according to the second embodiment described below will explain an example of detecting a camouflaged utterance by another person (for example, when using the recorded voice of the courier H1 of the courier).

A configuration example of the courier authentication system according to the second embodiment will be described with reference to FIG. The configuration example of the courier authentication system according to the second embodiment has the same configuration as the configuration example of the courier authentication system shown in FIG. 1, and has different operations. Hereinafter, the operation of the courier authentication system according to the second embodiment different from that of the first embodiment will be described.

First, the intercom Int1 according to the second embodiment will be described.

The imaging unit 15 according to the second embodiment images the delivery person H1 of the courier company. The imaging unit 15 transmits the captured image to the server device S1 via the control device CD1.

As a result, the courier authentication system impersonates the delivery person H1 of the courier company, even if another person uses the voice recorded by the utterance voice Msg1 of the courier company H1. It is possible to determine whether or not it has been damaged.

Each of the plurality of utterance instruction data is data for instructing the delivery person H1 of the courier company to utter the content to be uttered. For example, an instruction to utter today's date and a predetermined sentence among a plurality of stored documents. It is data including an instruction to repeat and an instruction to utter other identification information not included in the utterance voice Msg1 of the delivery person H1 of the delivery company.

Based on the utterance instruction control signal received from the server device S1, the control unit 11 according to the second embodiment instructs the delivery person H1 of the courier company to utter the content of the utterance by using the speaker 16 included in the output unit 14. To do. Further, when the output unit 14 includes the monitor 17, the control unit 11 may display the utterance content on the monitor 17.

After the above-mentioned utterance instruction, the input unit 13 again picks up the other utterance voice of the delivery person H1 of the courier company. The input unit 13 converts another picked-up voice into a voice input signal and transmits it to the server device S1 via the control device CD1.

In the following description, the courier authentication system according to the second embodiment will be described as a system capable of determining whether or not the courier H1 of the courier is spoofed by another person. It suffices if the disguise determination possible can be performed by the intercom added to the built private house and the apartment house, and it is sufficient that the disguise determination using either the captured image or the other spoken sound can be performed.

FIG. 5 is a diagram showing a system configuration example of the server device S1 according to the second embodiment. The server device S1 according to the second embodiment has the same configuration as the server device S1 according to the first embodiment, and the description of the same configuration and operation will be omitted.

The server device S1 includes a communication unit 30, a control unit 31, and a memory 32.

In addition to the operation described in the first embodiment, the communication unit 30 according to the second embodiment has a voice input signal based on the voice input signal of the delivery person H1 of the courier company, which is picked up by the input unit 13 included in the interphone Int1. The captured image data of the delivery person H1 of the courier company captured by the imaging unit 15 is received.

The control unit 31 according to the second embodiment includes an unlocking determination unit 312 and a camouflage determination unit 313. When executing the spoofing determination, the control unit 31 generates an utterance instruction control signal instructing the delivery person H1 of the courier company to instruct the utterance content, and transmits the utterance instruction control signal to the intercom Int1.

Whether or not the unlocking determination unit 312 according to the second embodiment permits unlocking of the automatic locking system GT based on the respective determination results of the identification information determination unit 312b, the position collation unit 314c, and the operation collation unit 315c. To judge. Whether or not the unlocking determination unit 312 permits unlocking of the automatic locking system GT based on the determination result of either the identification information determination unit 312b, the position collation unit 314c, or the operation collation unit 315c. May be determined.

In the camouflage determination unit 313, the delivery person H1 of the delivery company impersonates the delivery person H1 of the delivery company based on the speech voice Msg1 of the delivery person H1 of the delivery company and the captured image of the delivery person H1 of the delivery company. Determine if it is a person. The camouflage determination unit 313 includes a face position estimation unit 314a, an utterance position estimation unit 314b, a position collation unit 314c, a mouth motion detection unit 315a, a utterance detection unit 315b, and a motion collation unit 315c. To.

The face position estimation unit 314a estimates the position of the face of the delivery person H1 of the courier company in the captured image based on the captured image captured by the imaging unit 15 of the intercom Int1. The face position estimation unit 314a outputs the estimation result to the position collation unit 314c.

The utterance position estimation unit 314b estimates the utterance position of the delivery person H1 of the courier company based on the voice input signal generated by the input unit 13 of the intercom Int1. Since the input unit 13 is, for example, an array microphone and is composed of a plurality of microphones, it is possible to generate a voice input signal including information such as the direction of the spoken voice. The utterance position estimation unit 314b outputs the estimation result to the position collation unit 314c.

The position collation unit 314c collates the input estimation result by the face position estimation unit 314a with the estimation result by the utterance position estimation unit 314b, and collates the input estimation result with the face position of the delivery person H1 of the courier company (in other words, if there is a face). It is determined whether or not the direction (estimated direction) and the direction of the spoken voice included in the voice input signal match. The position collation unit 314c outputs the determination result to the unlock determination unit 312.

The mouth motion detection unit 315a detects the mouth of the delivery person H1 of the delivery company based on the captured image captured by the image pickup unit 15 of the intercom Int1. The mouth movement detection unit 315a detects the detected mouth movement for a predetermined time (for example, the time from immediately before the delivery person H1 of the courier company starts the utterance to immediately after the utterance is finished). The mouth motion detection unit 315a outputs the detection result (see FIG. 9) to the motion collation unit 315c.

The voice detection unit 315b detects the magnitude of the voice signal over a predetermined time based on the voice input signal generated by the input unit 13 of the intercom Int1. The utterance detection unit 315b outputs the detection result (see FIG. 9) to the operation collation unit 315c.

The motion collation unit 315c collates the input detection result by the mouth motion detection unit 315a with the estimation result of the utterance detection unit 315b (see FIG. 9), and the movement amount of the mouth of the delivery person H1 of the courier company at a predetermined time. And whether or not the magnitude of the audio signal matches. The operation collation unit 315c outputs the determination result to the unlock determination unit 312.

FIG. 6 is a flowchart showing an example of the two-way authentication procedure of the courier authentication system. In the two-way authentication procedure of the courier authentication system shown in FIG. 6, the intercom Int1 describes an authentication procedure when an utterance instruction is output in order to pick up another utterance voice.

The communication unit 30 receives a voice input signal based on the spoken voice Msg1 of the delivery person H1 of the delivery company from the intercom Int1 via the control device CD1 (St20).

The voice analysis unit 312a analyzes the received voice input signal. The voice analysis unit 312a determines a predetermined utterance word including identification information (for example, a company name) about the company included in the voice input signal and another predetermined utterance word including identification information other than the identification information about the company. , Extract (St21).

The identification information determination unit 312b determines whether or not the predetermined utterance word including the extracted identification information about the company is a pre-registered courier company stored in the memory 32 (St22).

When the predetermined utterance word including the identification information about the company extracted in step St22 is the identification information stored in the memory 32, the identification information determination unit 312b determines that it is a registered courier company (St22, YES). ), Connect to the trader registrant database DB1 (St23).

On the other hand, if the predetermined utterance word including the identification information about the company extracted in step St22 is not the identification information stored in the memory 32, the identification information determination unit 312b determines that it is not a registered courier company (St22). , NO). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is not permitted to unlock based on the determination result of the identification information determination unit 312b in step St22 (St24).

The control unit 31 generates an utterance instruction control signal that instructs the delivery person H1 of the courier company to utter the content of the utterance, and transmits it to the intercom Int1. The intercom Int1 outputs the utterance instruction content from the output unit 14 according to the received utterance instruction control signal (St25).

The identification information determination unit 312b receives another voice input signal based on another utterance signal of the delivery person H1 of the courier after the utterance instruction in step St25. The identification information determination unit 312b extracts other identification information of the delivery person H1 of the delivery company included in the other voice input signal, and connects to the company registrant database DB1. The identification information determination unit 312b connects to the trader registrant database DB1 and refers to the identification information of each delivery person of the plurality of registered courier companies (St26).

The identification information determination unit 312b refers to each identification information of the delivery person of the plurality of delivery companies, and whether or not other identification information is registered in the company registrant database DB1 (in other words, the delivery person of the delivery company). Whether or not H1 is a registrant registered in the trader registrant database DB1) is determined (St27).

In step St27, the identification information determination unit 312b registers the delivery person H1 of the delivery company when the other identification information of the delivery person H1 of the delivery company is the identification information registered in the company registrant database DB1. It is determined that the courier company (registrant) is working (St27, YES). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is permitted to unlock based on the determination result of the identification information determination unit 312b in step St27 (St28).

On the other hand, when the other identification information of the delivery person H1 of the delivery company is the identification information not registered in the company registrant database DB1 in step St27, the identification information determination unit 312b determines the delivery person H1 of the delivery company. Is not a registered courier company (St27, NO). The unlocking determination unit 132 outputs to the control device CD1 that the automatic locking system GT is not permitted to unlock based on the determination result of the identification information determination unit 312b in step St27 (St24).

FIG. 7 is a flowchart showing an example of the utterance detection procedure of the courier authentication system. In the utterance detection procedure of the courier authentication system shown in FIG. 7, the authentication procedure when the determination by each unit of the impersonation determination unit 313 is executed will be described.

The communication unit 30 receives a voice input signal based on the spoken voice Msg1 of the delivery person H1 of the delivery company from the intercom Int1 via the control device CD1 (St30).

The utterance position estimation unit 314b estimates the utterance position of the courier company H1 from the voice input signal based on the received voice of the courier company H1 (St31).

The face position estimation unit 314a estimates the position of the face of the delivery person H1 of the delivery company based on the received image of the delivery person H1 of the delivery company (St32).

The position collation unit 314c collates the utterance position of the courier delivery person H1 estimated in step St31 with the face position of the courier delivery person H1 estimated in step St32 (St33).

Based on the collation result, the position collation unit 314c determines whether or not the utterance position of the courier company H1 matches the position of the face of the courier company H1 or the utterance position of the courier company H1. It is determined whether or not the direction including the above and the direction in which the face of the delivery person H1 of the courier company is located coincide with each other (St34).

As a result of the determination by the position matching unit 314c, the camouflage determination unit 313 determines that the utterance position of the courier delivery person H1 matches the position of the face of the courier company delivery person H1, or the utterance of the courier company delivery person H1. When the direction including the position and the direction in which the face of the delivery person H1 of the courier company is located match (St34, YES), the determination using the mouth motion detection unit 315a and the utterance detection unit 315b is further executed. The mouth motion detection unit 315a detects the movement of the mouth of the delivery person H1 of the courier company detected from the image captured by the image pickup unit 15 of the intercom Int1 over a predetermined time. The utterance detection unit 315b detects the magnitude of the voice signal over a predetermined time based on the voice input signal generated by the input unit 13 of the intercom Int1 (St35).

On the other hand, the camouflage determination unit 313 determines that the utterance position of the courier delivery person H1 matches the position of the face of the courier company delivery person H1 as a result of the determination by the position matching unit 314c, or the delivery person of the courier company. When the direction including the utterance position of H1 and the direction in which the face of the courier H1 is located do not match (St34, NO), it is determined that the voice input signal is not the utterance of the courier H1. (St36). When the utterance detection procedure of the courier authentication system shifts to the process of step St36, it shifts to the process of step St43 shown in FIG. The unlocking determination unit 312 outputs to the control device CD1 that the automatic locking system GT is not permitted to be unlocked (St43).

The motion collation unit 315c outputs the mouth motion amount and the voice signal magnitude of the delivery person H1 of the courier company at the same time based on the detection result by the mouth motion detection unit 315a and the estimation result of the utterance detection unit 315b. It is collated whether or not it is (St37).

As a result of the collation in step St37, the motion collation unit 315c delivers the voice input signal to the courier when the movement amount of the mouth of the courier H1 and the magnitude of the voice signal are output at the same time. It is determined that the speech is from person H1 (St38, YES).

On the other hand, when the motion collation unit 315c does not output the motion amount of the mouth of the courier H1 and the magnitude of the voice signal at the same time as the result of the collation in step St37 (St38, NO), It is determined that the voice input signal is not the utterance of the delivery person H1 of the courier company (St36). When the utterance detection procedure of the courier authentication system shifts to the process of step St36, it shifts to the process of step St43 shown in FIG. The unlocking determination unit 312 outputs to the control device CD1 that the automatic locking system GT is not permitted to be unlocked (St43).

When the unlocking determination unit 312 determines in step St38 that the voice input signal is the utterance of the delivery person H1 of the courier company in step St38, the unlocking determination unit 132 uses the automatic locking system GT. Is output to the control device CD1 to allow unlocking (St39). When the utterance detection procedure of the courier authentication system shifts to the process of step St39, it shifts to the process of step St40 shown in FIG.

FIG. 8 is a flowchart showing an example of the authentication procedure by detecting the utterance of the delivery company authentication system. Since the respective processes of steps St40 to St46 in the second embodiment are the same as the respective processes of steps St11 to St17 in FIG. 3 of the first embodiment, the description thereof will be omitted.

The voice analysis unit 312a analyzes the received voice input signal after executing the process of step St39 in FIG. The voice analysis unit 312a extracts a predetermined utterance word including identification information (for example, a company name) about the company included in the voice input signal and another predetermined utterance word including identification information other than the identification information about the company (for example). St40).

After executing the process of step St36 in FIG. 7, the unlocking determination unit 312 outputs to the control device CD1 that the automatic locking system GT is not permitted to unlock (St43).

FIG. 9 is a diagram illustrating an example of utterance detection of a courier authentication system. With reference to FIG. 9, a process of collating the movement amount of the mouth of the delivery person H1 of the courier company with the magnitude of the voice signal in the movement matching unit 315c will be described.

Delivery person H1 of the courier service, "Hello, XX is transportation" and outputs a speech Msg1 of speech content that. In the example shown in FIG. 9, delivery people H1 of the courier service, speaks of the "Hello" in between time t1 of the time t2 of the speech Msg1, "XX is transportation" time from the time t3 of the speech Msg1 Speaking during t4.

The mouth movement amount MO1 is the mouth movement amount of the delivery person H1 of the courier company at a predetermined time, which is detected by the mouth movement detection unit 315a. The mouth movement detection unit 315a, detects the operation amount MO11 from "Hello" and the utterance was time t1 of the speech Msg1 of courier delivery person H1 over the time t2, the speech as "XX is the transportation" of the speech Msg1 The operation amount MO12 is detected from the time t3 to the time t4.

The size of the voice signal MO2 is the size of the voice signal of the delivery person H1 of the courier company at a predetermined time based on the input voice signal detected by the voice detection unit 315b. Utterance detection unit 315b detects the voice signal MO21 from "Hello" and the utterance was time t1 of the speech Msg1 of courier delivery person H1 over the time t2, uttered as "XX is the transportation" of the speech Msg1 The voice signal MO22 is detected from time t3 to time t4.

The motion collation unit 315c collates the mouth motion amount MO1 detected by the mouth motion detection unit 315a with the voice signal magnitude MO2 detected by the utterance detection unit 315b. The motion matching unit 315c is based on the utterance voice Msg1 because the motion amount MO11 and the voice signal MO21 are detected in the same time zone T1 and the motion amount MO12 and the voice signal MO22 are detected in the same time zone T2. It is determined that the voice input signal is the utterance of the delivery person H1 of the delivery company.

As described above, in the courier company authentication method according to the second embodiment, in addition to the courier company authentication method according to the first embodiment, the server device S1 further uses the interphone Int1 (an example of a voice input terminal) of the courier company. An instruction regarding the utterance content is output to the delivery person H1, and another voice input signal based on the utterance voice of the delivery person H1 of the courier company after the instruction is received. The server device S1 extracts other identification information that can identify the delivery person H1 of the courier company based on the other voice input signal received, and refers to the company registrant database DB1 (an example of the database). It is determined whether or not other identification information of the extracted courier delivery person H1 is registered, and if the identification information of the delivery company H1 of the courier company is registered, the automatic locking system GT is unlocked. Control. As a result, the courier authentication system can reduce the work load due to the redelivery of the courier H1 due to the absence of the recipient, and whether or not another person is impersonating the courier H1. Can be determined.

As described above, in the courier authentication method, the server device S1 receives the captured image of the courier H1 imaged by the interphone Int1, and the courier company is based on the received image of the courier H1. The position of the mouth of the courier H1 is estimated, the sound source position of the spoken voice of the courier H1 is estimated based on the received voice input signal, and the estimated position of the mouth of the courier H1 is estimated. And the sound source position of the voice of the courier H1 of the courier company is collated to determine whether or not the voice input signal is the voice of the courier H1 of the courier company. As a result, the courier authentication system can reduce the work load due to the redelivery of the courier H1 due to the absence of the recipient, and whether or not another person is impersonating the courier H1. Can be determined.

Note that this application is based on a Japanese patent application (Japanese Patent Application No. 2019-080560) filed on April 19, 2019, the contents of which are incorporated by reference in this application.

Although various embodiments have been described above with reference to the attached drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications, modifications, substitutions, additions, deletions, and equality examples within the scope of the claims. It is understood that it belongs to the technical scope of the present disclosure. In addition, each component in the various embodiments described above may be arbitrarily combined as long as the gist of the invention is not deviated.

The present disclosure describes a courier authentication method, a courier authentication system, a courier authentication system, a courier authentication system, which can reduce the work load due to redelivery of a courier due to the absence of a recipient in presenting a courier authentication system, a server device, and a control device. It is useful as a server device and a control device.

10, 20, 30

Communication unit

11, 31

Control unit

12, 22, 32 Memory 13 Input unit 14 Output unit 15 Imaging unit 16 Speaker 17 Monitor 18 Lens 21 Unlocking control unit CD1 Control device DB1 Contractor registrant database GT automatic locking system H1 Delivery company Int1 Intercom Msg1 Speech voice S1 Server device

Claims

It is a courier authentication method that uses the voice of the delivery person.
Receives a voice input signal based on the voice of the delivery person picked up by the voice input terminal, and receives the voice input signal.
Identification information that can identify the delivery person is extracted based on the received voice input signal.
By referring to the database including the identification information of each of the delivery persons of the plurality of courier companies registered in advance, it is determined whether or not the extracted identification information of the delivery person is registered.
When the delivery person's identification information is registered, the automatic locking system that controls admission to a predetermined area accessible in front of the entrance of the delivery destination house is unlocked and controlled.
Courier certification method.
An instruction regarding the utterance content is output to the delivery person via the voice input terminal.
Upon receiving another voice input signal based on the voice spoken by the delivery person after the instruction,
Based on the other voice input signal received, other identification information that can identify the delivery person is extracted.
With reference to the database, it is determined whether or not the other identification information of the extracted delivery person is registered.
When the delivery person's identification information is registered, the automatic locking system is unlocked and controlled.
The courier authentication method according to claim 1.
Upon receiving the captured image of the delivery person captured by the voice input terminal,
The position of the delivery person's mouth is estimated based on the received image of the delivery person.
The sound source position of the voice of the delivery person is estimated based on the received voice input signal, and the sound source position is estimated.
By collating the estimated position of the delivery person's mouth with the sound source position of the delivery person's uttered voice, it is determined whether or not the voice input signal is the delivery person's uttered voice.
The courier authentication method according to claim 1.
It is a courier authentication system that can communicate between the control device that controls the automatic locking system and the server device.
The control device is
Receives a voice input signal based on the utterance voice of the delivery person picked up by the voice input terminal,
The received voice input signal is transmitted to the server device, and the voice input signal is transmitted to the server device.
The server device
Identification information that can identify the delivery person is extracted based on the received voice input signal.
By referring to the database including the identification information of each of the delivery persons of the plurality of courier companies registered in advance, it is determined whether or not the extracted identification information of the delivery person is registered.
When the delivery person's identification information is registered, an unlocking signal permitting the unlocking of the automatic locking system is generated and transmitted to the control device.
The control device is
The automatic locking system is unlocked and controlled based on the received unlocking signal.
Courier certification system.
An identification information extraction unit that extracts the identification information of the delivery person based on the voice input signal based on the utterance voice of the delivery person received by the voice input terminal.
A registrant determination unit that determines whether or not the extracted identification information of the delivery person is registered by referring to a database containing the identification information of each delivery person of a plurality of courier companies registered in advance.
Based on the determination result of the registrant determination unit, an unlocking permission signal for unlocking an automatic locking system that controls admission to a predetermined area accessible in front of the entrance of the delivery destination house is generated. With a permit section,
Server device.
A receiver that receives a voice input signal based on the voice of the delivery person using a voice input terminal,
Transmission of the voice input signal to a server device that determines whether or not the delivery person is registered with the delivery persons of a plurality of pre-registered courier companies and generates an unlocking permission signal of the automatic locking system. Department and
It is provided with an unlocking control unit that receives an generated unlocking permission signal and controls unlocking of an automatic locking system that controls entry permission to a predetermined area accessible in front of the entrance of the delivery destination house.
Control device.