JP2023128099A - Terminal device, external apparatus, communication system, program, and communication control method - Google Patents

Abstract

To provide a terminal device, an external apparatus, a communication system, a program, a communication control method, and the like that appropriately perform biometric authentication and transmission processing of personal information when the personal information stored in the terminal device is used in the external apparatus.SOLUTION: A terminal device includes: a storage unit that stores authentication information used for biometric authentication of a user and personal information of the user; a communication unit that communicates with an external apparatus that performs control based on the personal information; and a control unit that acquires biometric information from the external apparatus via the communication unit, performs biometric authentication based on the authentication information and the biometric information, and performs control to transmit the personal information to the external apparatus via the communication unit when it is determined that the biometric authentication is successful.SELECTED DRAWING: Figure 2

Description

The present invention relates to a terminal device, an external device, a communication system, a program, a communication control method, and the like.

Conventionally, biometric authentication using biometric information has been widely known as a method for verifying a user's identity. For example, when using a credit card, etc., personal authentication is performed. Also known is a method of performing biometric authentication using a network. For example, Patent Document 1 discloses a method of increasing the reliability of biometric authentication via a network by adding double digital signatures.

Japanese Patent Application Publication No. 2003-143136

The method disclosed in Patent Document 1 is a method for performing identity verification more safely, and there is no description regarding processing after verification, for example, processing using personal information. More specifically, in the conventional method such as Patent Document 1, it is not possible to perform communication processing suitable for a case where a terminal device that stores personal information and an external device that uses the personal information cooperate.

According to some aspects of the present disclosure, a terminal device, an external device, a communication system, and a program that appropriately perform biometric authentication and transmission processing of personal information when personal information stored in a terminal device is used in an external device. and a communication control method.

One aspect of the present disclosure includes: a storage unit that stores authentication information used for biometric authentication of a user and personal information of the user; and a communication unit that performs communication with an external device that executes control based on the personal information; Acquire biometric information from the external device via the communication unit, execute the biometric authentication based on the authentication information and the biometric information, and when it is determined that the biometric authentication is successful, obtain the biometric information from the external device via the communication unit. and a control unit that controls transmitting the personal information to the external device.

Another aspect of the present disclosure includes a sensor that detects biometric information, a communication unit that communicates with a terminal device that stores personal information of a user, and a control unit that performs control based on the personal information, and the control unit that performs control based on the personal information. The control unit transmits the biometric information detected based on the sensor to the terminal device via the communication unit, and when the terminal device determines that biometric authentication based on the biometric information is successful. , relates to an external device that performs control to request the personal information from the terminal device via the communication unit.

Still another aspect of the present disclosure includes a terminal device that stores authentication information used for biometric authentication of a user and personal information of the user, and a sensor that detects the biometric information, and controls based on the personal information. an external device that transmits the biometric information acquired by the sensor to the terminal device, and the terminal device transmits the authentication information and the biometric information received from the external device. When the biometric authentication is determined to be successful, the personal information is transmitted to the external device, and the external device performs control based on the personal information received from the terminal device. related to communication systems that perform

Still another aspect of the present disclosure stores authentication information used for biometric authentication of a user and personal information of the user, and communicates with an external device that executes control based on the personal information of the user, A process of acquiring biometric information from an external device, performing the biometric authentication based on the authentication information and the biometric information, and transmitting the personal information to the external device when it is determined that the biometric authentication is successful. Pertains to programs that cause a computer to execute.

Yet another aspect of the present disclosure includes a terminal device that stores authentication information used for biometric authentication of a user and personal information of the user, and a sensor that acquires the biometric information, and executes control based on the personal information. an external device, the method comprising: transmitting the biometric information acquired by the sensor from the external device to the terminal device; and performing the biometric authentication based on the authentication information and the biometric information. The present invention relates to a communication control method in which, when it is determined that the biometric authentication is successful, the personal information is transmitted from the terminal device to the external device, and the external device executes control based on the personal information.

This is an example of a communication system including a terminal device and external equipment. This is an example of the configuration of a terminal device. This is an example of the configuration of external equipment. It is a sequence diagram explaining the processing of this embodiment. This is an example of personal information stored in a terminal device. This is an example of a biological information detection device. This is an example of a communication system including a terminal device and external equipment. FIG. 3 is a diagram illustrating an example of control based on personal information.

This embodiment will be described below with reference to the drawings. In the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description will be omitted. Note that this embodiment described below does not unduly limit the content described in the claims. Furthermore, not all of the configurations described in this embodiment are essential configuration requirements of the present disclosure.

1. System Configuration Example FIG. 1 is a diagram showing an example of a communication system 10 according to the present embodiment. The communication system 10 includes a terminal device 100 and an external device 200 that is a device provided outside the terminal device 100. In FIG. 1, a mobile body 300 is illustrated as the external device 200. However, the configuration of the communication system 10 is not limited to that shown in FIG. 1, and various modifications such as omitting some configurations or adding other configurations are possible.

The terminal device 100 of this embodiment is a device that stores personal information that is information about the user of the terminal device 100. An example of personal information will be described later using FIG. 5. The terminal device 100 is, for example, a mobile terminal device such as a smartphone or a tablet terminal. Since a device used by the user himself is used as the terminal device 100, it is possible to easily and safely register the user's personal information. Note that the terminal device 100 may be any device used by a user, and may be any other type of device such as a laptop-type PC (Personal Computer).

The external device 200 is a device that executes control based on the user's personal information. For example, a moving body 300, which is an example of the external device 200, includes a control device 310, a camera 340, a handle 350, a seat 360, and the like, as shown in FIG. The control device 310 corresponds to the control unit 210 described later using FIG. 3, and the camera 340 corresponds to the sensor 240. Note that the control device 310 may be provided at a different position on the moving body 300. The moving body 300 may also include an accelerator pedal, a brake pedal, an engine, etc. (not shown). Further, although a passenger car is illustrated as the moving object 300 in FIG. 1, other types of moving objects such as a motorcycle or a construction machine may be used.

For example, the control device 310 is electrically connected to each part of the moving body 300, such as a camera 340, a steering wheel 350, a seat 360, an accelerator pedal, a brake pedal, etc., and controls these parts. For example, the control device 310 may perform automatic driving by controlling the steering wheel 350 and the like based on the user's personal information. The automatic driving here may be one that performs driving support corresponding to automatic driving level 1-2, or automatic driving with or without conditions corresponding to level 3-5. Furthermore, as will be described later, the control device 310 may perform control to improve user convenience, such as controlling the position of the seat 360 based on personal information. By having the external device 200 perform control based on personal information, appropriate control according to the target user can be realized.

When using personal information, biometric authentication may be performed at the terminal device 100 in order to prevent leakage of the personal information. At this time, the terminal device 100 of this embodiment acquires biometric information for biometric authentication from the external device 200 to which the personal information is transmitted. In this way, convenience can be improved by omitting operations on the terminal device 100 during biometric authentication. The method of the present disclosure will be specifically described below.

FIG. 2 is a diagram showing a configuration example of the terminal device 100. Terminal device 100 includes a control section 110, a storage section 120, a communication section 130, and a sensor 140. However, the configuration of the terminal device 100 is not limited to that shown in FIG. 2, and various modifications such as omitting some configurations or adding other configurations are possible. For example, the terminal device 100 may include a display section, an operation section, etc. that are not shown in FIG.

The control unit 110 performs various controls regarding the terminal device 100. For example, the control unit 110 performs authentication processing using biometric information (hereinafter referred to as biometric authentication), controls communication with the external device 200 via the communication unit 130, and the like. Details of the processing performed by the control unit 110 will be described later.

The control unit 110 of this embodiment is configured by the following hardware. The hardware can include at least one of a circuit that processes digital signals and a circuit that processes analog signals. For example, the hardware can be configured by one or more circuit devices mounted on a circuit board or one or more circuit elements. The one or more circuit devices are, for example, an IC (Integrated Circuit), an FPGA (Field-Programmable Gate Array), or the like. The one or more circuit elements are, for example, resistors, capacitors, etc.

Further, the control unit 110 may be realized by the following processor. The terminal device 100 of this embodiment includes a memory that stores information and a processor that operates based on the information stored in the memory. The information includes, for example, programs and various data. A processor includes hardware. As the processor, various types of processors can be used, such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor). The memory may be a semiconductor memory such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), or flash memory, or may be a register, or may be a hard disk drive (HDD), etc. The storage device may be a magnetic storage device, or an optical storage device such as an optical disk device. For example, the memory stores computer-readable instructions, and the processor executes the instructions to realize the functions of the control unit 110 as processing. The instructions here may be instructions of an instruction set that constitutes a program, or instructions that instruct a hardware circuit of a processor to operate.

The storage unit 120 is a work area of the control unit 110 and stores various information. The storage unit 120 can be realized by various types of memory, and the memory may be a semiconductor memory such as SRAM, DRAM, ROM, or flash memory, a register, or a magnetic storage device. It may also be an optical storage device.

As shown in FIG. 2, the storage unit 120 may store authentication information 121, personal information 122, and device authentication information 123. Authentication information 121 is information for performing biometric authentication of a user based on biometric information. The authentication information 121 is, for example, correct data registered in advance. For example, when biometric authentication is performed based on a facial image, the authentication information 121 is the user's own facial image data, feature amount information extracted from the facial image data, or the like.

The personal information 122 is information regarding the user of the terminal device 100, and includes various information as described later using FIG. 5.

The device authentication information 123 is information used when the external device 200 performs device authentication to authenticate whether the terminal device 100 is a legitimate device. For example, the device authentication information 123 is the public key of the terminal device 100 authenticated by a certification authority. The external device 200 determines that device authentication is successful when the public key has been authenticated by a certification authority and the signature information from the terminal device 100 is determined to be appropriate based on the public key. do. Details of device authentication will be described later.

The communication unit 130 is an interface for communicating via a network, and includes, for example, an antenna, an RF (radio frequency) circuit, and a baseband circuit. The communication unit 130 operates under the control of the control unit 110, for example. Further, the communication unit 130 may include a processor for communication control that is different from the control unit 110.

The communication unit 130 may perform wireless communication using a method defined by IEEE802.11, for example. For example, the communication unit 130 performs communication using Wi-Fi (registered trademark). Furthermore, the communication unit 130 may perform wireless communication using other methods. For example, the communication unit 130 performs communication using Bluetooth (registered trademark), NFC (Near Field Communication), UWB (Ultra Wide Band), or the like.

The sensor 140 is a sensor that performs various types of sensing. The sensor 140 may be a camera, a motion sensor such as an acceleration sensor or a gyro sensor, a GPS receiver, or a photoelectric sensor having a light emitting part and a light receiving part. Alternatively, it may be another sensor. Further, the sensor 140 may include two or more of these sensors. The sensor 140 may be used when storing the authentication information 121 described above in the storage unit 120 in advance. For example, sensor 140 is a camera that captures an image of the user's face. Further, the sensor 140 may be a sensor for acquiring the user's personal information. For example, the control unit 110 may obtain health state information, which will be described later, based on the sensor 140, and may perform control to transmit the health state information to the external device 200 as personal information.

Further, the terminal device 100 may include a display section and an operation section. The display unit is an interface that displays various information, and may be a liquid crystal display, an organic EL display, or another type of display. The operation unit may be a button or the like provided on the terminal device 100, or may be a touch panel configured integrally with the display unit.

FIG. 3 is a diagram showing a configuration example of the external device 200. External device 200 includes a control section 210, a storage section 220, a communication section 230, and a sensor 240. However, the configuration of the external device 200 is not limited to that shown in FIG. 3, and various modifications such as omitting some configurations or adding other configurations are possible. For example, when the external device 200 is a moving body 300, the components such as the handle 350 and seat 360 shown in FIG. 1, an accelerator pedal, and a brake pedal (not shown) may be added. Further, when the external device 200 is an intercom 400 as described later using FIG. 7, configurations such as a call button 450, a speaker 460, a microphone 470, etc., which will be described later, may be added.

The control unit 210 executes various controls regarding the external device 200. For example, the control unit 210 performs a process of acquiring biometric information using the sensor 240, controls communication with the terminal device 100 via the communication unit 230, performs device authentication of the terminal device 100, and the like. Details of the processing performed by the control unit 210 will be described later.

The control unit 210 of this embodiment is configured by hardware including at least one of a circuit that processes digital signals and a circuit that processes analog signals. For example, the hardware can be configured by one or more circuit devices mounted on a circuit board or one or more circuit elements.

Further, the control unit 210 may be realized by a processor such as a CPU, GPU, or DSP. The external device 200 of this embodiment includes a memory that stores information and a processor that operates based on the information stored in the memory. For example, the memory stores instructions that can be read by a computer, and when the processor executes the instructions, the functions of the control unit 210 are realized as processing.

The storage unit 220 is a work area of the control unit 210 and stores various information. The storage unit 220 can be realized by various types of memory, and the memory may be a semiconductor memory such as SRAM, DRAM, ROM, or flash memory, a register, or a magnetic storage device. It may also be an optical storage device.

As shown in FIG. 3, the storage unit 220 may store terminal information 221. The terminal information 221 is information that identifies the device (terminal device 100) for which device authentication has been performed. The terminal information 221 may be the MAC address of the terminal device 100, a serial number, or other information. By storing the terminal information 221, it is possible to omit device authentication when reconnecting to a terminal device 100 that has a history of successful device authentication.

The communication unit 230 is an interface for communicating via a network, and includes, for example, an antenna, an RF circuit, and a baseband circuit. The communication unit 230 operates under the control of the control unit 210, for example. Further, the communication unit 230 may include a communication control processor different from the control unit 210.

The communication unit 230 may perform wireless communication compatible with the same method as the terminal device 100, for example. For example, the communication unit 230 performs communication using Wi-Fi, Bluetooth, NFC, UWB, or the like.

The sensor 240 is a sensor that detects biometric information of the user. The biometric information here may be information about the user's outline or facial parts, information about the iris, information about fingerprints, or other information. good. The sensor 240 may be, for example, a camera including an image sensor, or may be a fingerprint sensor. The fingerprint sensor can be realized using various sensors such as a sensor that detects capacitance, an optical sensor, and an ultrasonic sensor.

2. Flow of Processing Next, the flow of processing in this embodiment will be described in detail. FIG. 4 is a sequence diagram illustrating the processing of the terminal device 100 and the external device 200 in this embodiment. Below, as shown in FIG. 1, an example in which the external device 200 is a mobile object 300 will be described.

First, in step S101, the control unit 110 of the terminal device 100 registers authentication information 121 and personal information 122 in the storage unit 120. Note that the authentication information 121 may be acquired at a timing before step S109, and the personal information 122 may be acquired at a timing before step S110. Therefore, the specific timing at which each piece of information is registered is not limited to the timing shown in step S101.

For example, authentication information 121 and personal information 122 may be registered at different timings. Furthermore, when multiple types of personal information 122 are used as described later using FIG. 5, these may be acquired all at once, or may be acquired at different timings. Further, the personal information 122 may be information that is updated regularly.

As described above, the authentication information 121 is, for example, biometric information, and the specific content can be modified in various ways. The authentication information 121 may be information acquired using the sensor 140 of the terminal device 100, or may be information acquired using another device. For example, the control unit 110 may acquire biometric information detected in a device other than the terminal device 100 via the communication unit 130 and store it in the storage unit 120 as the authentication information 121.

FIG. 5 is a diagram showing a specific example of personal information. The personal information includes driver's license information, insurance card information, My Number card information, ID card information, health condition information, setting history information, age information, height information, weight information, and the like. However, FIG. 5 is an example of personal information, and some of this information may be omitted, or other information not shown in FIG. 5 may be added.

The license information is information regarding the user's license. The license information includes information such as a face photo, license number, name, address, date of birth, vehicles that can be driven, restrictions (glasses, etc.), and expiration date. For example, if the driver's license includes an IC chip or the like, the control unit 110 may acquire the driver's license information by scanning the driver's license using NFC or the like. Further, the driver's license information may be acquired by the user inputting the information using the operation unit of the terminal device 100. When registering driver's license information, the control unit 110 requests the input of the PIN number set at the time of issuance of the driver's license, and based on the request, performs a process of inquiring the issuer about the PIN number input by the user. Good too. The control unit 110 registers the license information when the password is correct, and refuses to register the license information when the password is incorrect. In this way, it is possible to prevent license information of persons other than the user from being registered in the terminal device 100.

The insurance card information includes information such as name, date of birth, gender, and health insurance association to which the person belongs. My number card information includes information such as name, date of birth, gender, address, and my number. My number, for example, is a number that uniquely identifies a user, and is information issued by the country. The ID card information is, for example, information regarding a card issued by an organization (company, organization, etc.) to which the user belongs, and includes information such as a facial photo, name, affiliation, position, and the like. When registering insurance card information, My Number card information, ID card information, etc., the control unit 110 also requests the input of the PIN set at the time of issuance, and performs a process of inquiring the issuer about the PIN entered by the user. You may do so.

Health status information is information representing the user's health status. The health status information may be biological information detected using a biological sensor, such as heart rate (pulse rate), respiratory rate, blood oxygen saturation, and activity level. Hereinafter, biometric information used as health status information will also be referred to as second biometric information to distinguish it from biometric information used for biometric authentication. Note that the biometric information for biometric authentication and the second biometric information may be the same type of information. Furthermore, the health status information is not limited to information detected using a biological sensor, and may include information such as hospital visit history and medication history.

The setting history information is information representing the setting history of the external device 200. When the external device 200 is a moving object 300 such as a car, various information accumulated through the use of the moving object 300, such as the position of the seat 360, the playback history of the car audio, the input history of the destination in the car navigation system, etc. Included in configuration history information. For example, assume that the terminal device 100 and some external device 200 were connected in the past, and when the user used the external device 200, setting history information was left in the storage unit 220 of the external device 200. For example, the control unit 110 may acquire setting history information from the external device 200 via the communication unit 130.

The age information, height information, and weight information are information representing the user's age, height, and weight, respectively. Further, the personal information may include other information such as hand and foot sizes, waist circumference, etc., as necessary. Further, the personal information may include behavior history information including stores visited by the user, and preference information specifying the user's preferences. Note that age information can be identified from date of birth in driver's license information, etc., and therefore may be included in driver's license information, etc.

As described above, personal information differs from user to user. Therefore, the personal information stored in the storage unit 120 of the terminal device 100 becomes information unique to the user of the terminal device 100.

In the method of this embodiment, a user approaches an external device 200 in order to use it while carrying the terminal device 100 in which authentication information 121 and personal information 122 are registered. For example, in order to drive the mobile object 300, the user moves to a range where the distance from the mobile object 300 is equal to or less than a predetermined distance threshold.

In step S102, the terminal device 100 and the external device 200 establish communication using the first communication method. The first communication method here is, for example, Bluetooth (for example, BLE: Bluetooth Low Energy), NFC, UWB, or the like. The above distance threshold may correspond to a distance where communication using the first communication method is possible (for example, a distance that radio waves reach with sufficient strength). Note that the communication sequence until communication is established differs depending on the method, but since each of the above methods is publicly known, detailed explanation of the communication sequence will be omitted.

Next, the external device 200 performs device authentication of the terminal device 100. Specifically, the storage unit 120 of the terminal device 100 stores in advance device authentication information 123 used for device authentication of the terminal device 100. Similar to the authentication information 121 and the personal information 122, the timing at which the device authentication information 123 is stored can be modified in various ways. The device authentication information 123 is, for example, a public key corresponding to a private key stored in the terminal device 100.

In step S103, the control unit 110 transmits signature information created using its own private key to the external device 200. For example, the control unit 110 creates encrypted data by encrypting some data with a secret key. The signature information in this embodiment is information that includes the encrypted data. Furthermore, the control unit 110 attaches a public key to be paired with the private key and an electronic certificate issued by a certificate authority (CA) to the created encrypted data, and transmits the encrypted data to the external device 200. Note that the electronic certificate and the public key may be configured as integrated data.

In step S104, the external device 200 performs device authentication. For example, the control unit 210 of the external device 200 inquires of the certification authority whether the electronic certificate received in step S103 is valid. If the digital certificate is valid, the validity of the public key has been confirmed. Therefore, the control unit 210 determines whether the encrypted data can be decrypted using the public key received in step S103. If the encrypted data can be properly decrypted, it can be confirmed that the terminal device 100 that is the sender is a legitimate device that has a private key that is a pair of public keys, so the control unit 210 determines that device authentication has been successful. It is determined that the

Note that the method for performing device authentication is not limited to this, and various modified implementations are known. In this embodiment, these known methods can be widely applied to the device authentication process in step S104. For example, processing that also serves as tampering detection may be executed in steps S103 and S104. For example, in step S103, the control unit 110 of the terminal device 100 obtains a hash value by applying a hash function to some original data, and creates an encrypted hash value by encrypting the hash value with a secret key. The control unit 110 transmits the original data, the encrypted hash value, the public key, and the electronic certificate to the external device 200. In step S104, the control unit 210 of the external device 200 obtains a first verification value by applying the hash function to the original data received in step S103. The control unit 210 also inquires of the certification authority whether the electronic certificate is valid, and if it is valid, the control unit 210 decrypts the encrypted hash value received in step S103 using the public key of the terminal device 100. A second verification value is obtained by The control unit 210 can perform device authentication of the terminal device 100 by determining whether the encrypted hash value can be decrypted. Further, the control unit 210 performs a process of comparing the first verification value and the second verification value. The control unit 210 can also confirm that the data has not been tampered with when the first verification value and the second verification value match.

If the device authentication is successful, in step S105, the external device 200 transmits connection information used in the second communication method to the terminal device 100. The connection information here includes information specifying the network of the external device 200. For example, the second communication method is a method compatible with Wi-Fi, and the information identifying the network is an SSID (Service Set Identifier). The connection information may also include a pre-shared key (password). For example, Wi-Fi communication between the terminal device 100 and the external device 200 may be encrypted by using a common key created based on a pre-shared key.

In step S106, communication using the second communication method, for example, Wi-Fi communication, is established between the terminal device 100 and the external device 200.

As shown in steps S102-S106, the communication unit 130 performs communication using the first communication method and communication using the second communication method, and the control unit 110 transmits device authentication information using the first communication method ( Step S103), when device authentication based on the device authentication information is successful in the external device 200, connection information for communicating with the external device 200 using the second communication method may be received (step S105). . In this way, it becomes possible to smoothly switch between the communication method used for device authentication and the communication method used for subsequent processing.

For example, the second communication method may have a faster communication speed than the first communication method. In the above example, Wi-Fi has a faster communication speed than BLE or the like. In this way, even if information with a relatively large amount of data is used as biometric information for biometric authentication, the time required for communication can be shortened, so biometric authentication can be performed smoothly. For example, if the biometric information is moving image data, the amount of data will be larger than when using still images, but even in such cases, biometric authentication can be performed smoothly and the amount of biometric information can be reduced. Since the number of biometric authentications increases, it is also possible to increase the accuracy of biometric authentication.

However, the communication method used during device authentication and the communication method used during biometric authentication may be the same, and switching the communication method is not essential.

Furthermore, encryption in communication using the second communication method is not limited to using a pre-shared key. For example, the device authentication information that the communication unit 130 transmits to the external device 200 in step S103 may include first encrypted information used in communication using the second communication method. The first encryption information may be, for example, the public key of the terminal device 100 used in the second communication method, or may be other information for generating the encryption key used in the second communication method. . For example, the terminal device 100 may transmit the first encrypted information and the electronic signature to the external device 200 in step S103 by creating an electronic signature using the first encrypted information as the original data. The first encrypted information is used, for example, to transmit information from the terminal device 100 to the external device 200. By performing processing based on the first encrypted information, the confidentiality when transmitting information from the terminal device 100 to the external device 200 can be increased.

Further, in step S105, the external device 200 may transmit to the terminal device 100, in addition to the information specifying the network, connection information including second encrypted information used in communication using the second communication method. The second encryption information may be, for example, the public key of the external device 200 used in the second communication method, or may be other information for generating the encryption key used in the second communication method. . The second encrypted information is used, for example, to transmit information from the external device 200 to the terminal device 100. By performing processing based on the second encrypted information, the confidentiality when transmitting information from the external device 200 to the terminal device 100 can be increased.

For example, the terminal device 100 and the external device 200 share information for creating an encryption key in the second communication method by exchanging keys using the first encryption information and the second encryption information. Good too. In this way, it is possible to generate an encryption key specific to Wi-Fi communication between the terminal device 100 and the external device 200, so it is possible to perform communication with higher security strength than when using a pre-shared key. become. Further, the first encrypted information and the second encrypted information in this embodiment may be information for increasing the security strength of communication in the second communication method, and the specific content and processing details for each encrypted information may be used. Various modifications are possible.

After establishing Wi-Fi communication, in step S107, the control unit 210 of the external device 200 activates the sensor 240 to acquire biometric information for biometric authentication. In step S108, the control unit 210 transmits the biometric information to the terminal device 100 via the communication unit 230.

That is, the control unit 110 of the terminal device 100 performs control to transmit the device authentication information 123 to the external device 200 via the communication unit 130 (step S103), and the device authentication based on the device authentication information 123 in the external device 200 is successful. In this case, biometric information may be acquired from the external device 200 (step S108). In this way, the external device 200 will not transmit biometric information to the terminal device 100 unless it is confirmed that the terminal device 100 is a valid device through device authentication. Therefore, it is possible to prevent the biological information acquired by the external device 200 from being sent to an inappropriate device.

Furthermore, the external device 200 of this embodiment may further include an interface section used when the user uses the external device 200. When the external device 200 is a mobile object 300, the interface section may be the steering wheel 350, an in-vehicle monitor used in a car navigation system, or other components used by the user when driving. It may be.

A sensor 240 provided in the external device 200 is placed at a position to detect biometric information of a user using the interface section. In the example of the moving body 300, the sensor 240 corresponds to a camera 340, for example. As shown in FIG. 1, the camera 340 is arranged at a position in the front portion of the moving body 300 (the windshield, the ceiling near the windshield, etc.) where it can image the driver's seat. For example, the camera 340 is placed in a position and posture that allows it to capture an image of the user's upper body or face when a user of standard build sits on a seat 360 that is a driver's seat. Although FIG. 1 shows an example in which the camera 340 is arranged in the front direction of the driver's seat, the camera 340 may also image the user in the driver's seat from an oblique direction. Further, when the sensor 240 is a fingerprint sensor, the fingerprint sensor may be provided on the engine start button, the steering wheel 350, or the like.

In this way, biometric information can be acquired for users who are actually using the external device 200. In other words, if the user is not ready to use the external device 200, the acquisition of biometric information (step S107) and the processes from step S108 onwards using the biometric information are not performed. For example, according to the method of this embodiment, a person who is located near the external device 200 but is not scheduled to operate the external device 200, for example, a person sitting in the passenger seat or the rear seat of the mobile object 300, is mistakenly targeted for biometric authentication. This can be suppressed. As a result, it is possible to prevent control from being performed using personal information of users other than the driver. Furthermore, even if the user is planning to drive, biometric information will not be acquired unless the user is in a state where the user is able to drive, so it is possible to prevent the mobile object 300 etc. from starting automatic control at an inappropriate timing. .

When biometric information is acquired from the external device 200, in step S109, the control unit 110 of the terminal device 100 uses the biometric information acquired in step S108 and the authentication information 121 registered in advance in step S101 to identify the user's biometric information. Perform authentication. For example, the control unit 110 performs a comparison process between biometric information and authentication information 121, and determines that biometric authentication has been successful when the degree of similarity is greater than or equal to a predetermined value, and determines that biometric authentication has failed when the degree of similarity is less than a predetermined value. You may judge. Note that various methods are known for information used as biometric information and specific processing contents of biometric authentication, and these can be widely applied in this embodiment.

If the biometric authentication is successful, in step S110, the control unit 110 transmits the list of personal information held in the storage unit 120 to the external device 200 via the communication unit 130. The personal information list transmitted in step S110 is a collection of names of personal information. For example, the personal information list may be a collection of texts such as "driver's license information," "health information," and "age information." Note that the process in step S110 may be omitted.

In step S111, the external device 200 performs a process of requesting the terminal device 100 for personal information used in control by the control unit 210. For example, when the process of step S110 is performed, the external device 200 may extract information necessary for control from the personal information listed in the personal information list, and transmit the extraction result to the terminal device 100.

In step S112, the control unit 110 performs a process of transmitting the personal information 122 stored in the storage unit 120 to the external device 200 based on a request from the external device 200.

As described above, the control unit 110 of the terminal device 100 acquires biometric information from the external device 200 via the communication unit 130 (step S108), and executes biometric authentication based on the authentication information 121 and the biometric information (step S108). S109), if it is determined that the biometric authentication is successful, control is performed to transmit the personal information 122 to the external device 200 via the communication unit 130 (step S112).

Further, when considering the external device 200, the control unit 210 transmits biometric information detected based on the sensor 240 to the terminal device 100 via the communication unit 230 (steps S107, S108), and When it is determined that biometric authentication based on the information has been successful (step S110), control is performed to request personal information from the terminal device 100 via the communication unit 230 (step S111).

In this way, by using biometric authentication, it is possible to prevent a user's personal information from being sent to an inappropriate device. Furthermore, in this embodiment, a sensor 240 disposed in the external device 200 instead of the terminal device 100 is used as a sensor for acquiring biological information. Therefore, it is also possible to omit the operation of the terminal device 100 for biometric authentication. For example, even if the terminal device 100 is kept in a pocket or bag and biometric authentication using the sensor 140 of the terminal device 100 is difficult, the processing from step S102 onward in FIG. 4 can be executed. It is possible. As a result, user convenience can be improved. Further, if the biometric authentication is successful, it means that the user of the terminal device 100 is within the detection range of the sensor 240 of the external device 200. Therefore, when the probability that the user will use the external device 200 is low, it is possible to prevent control using the user's personal information from being executed.

In step S113, the control unit 210 of the external device 200 executes control based on the personal information 122 acquired from the terminal device 100. For example, the control device 310 of the mobile object 300 may acquire license information from the terminal device 100. If the control device 310 determines that there is a history of violations or accidents based on the driver's license information, the control device 310 controls the accelerator pedal, brake pedal, steering wheel 350, etc. so that the driver can drive in a manner that reduces the likelihood of violations or accidents. Set the mode. Further, if an electronically controllable engine is installed, the control device 310 may directly control the engine without using an accelerator pedal or the like. For example, the control device 310 may set an upper limit value for at least one of speed and acceleration, and change the upper limit value based on license information. Alternatively, the control device 310 may perform control to obtain age information and set the upper limit values of speed and acceleration relatively low when the age is higher than a predetermined threshold.

Alternatively, the control device 310 may acquire setting history information from the terminal device 100. The control device 310 may perform various settings of the mobile object 300 based on the setting history information. The settings here include various settings such as seat 360 position settings, mirror position settings, display settings for the in-vehicle monitor (which may include meters such as speedometer), music playback settings, automatic connection settings with smartphones, etc. It is possible to include. In this way, setup at the time of riding is automatically executed, making it possible to improve convenience. For example, even if a vehicle shared by a family, a rental car, or the like is used as the mobile object 300, settings tailored to the driver can be easily realized.

Further, the control device 310 may acquire behavior history information and preference information from the terminal device 100. For example, the control device 310 estimates a place that the user is interested in (stores, leisure facilities, accommodation facilities, etc.) based on behavior history information and preference information, and recommends a visit to the place using a car navigation system or the like. Control may also be performed.

Further, the personal information of this embodiment may include information that changes in real time while using the external device 200, for example, while riding the mobile object 300. For example, personal information is health status information.

For example, the communication unit 130 may acquire the user's second biometric information from a biometric information acquisition unit included in the terminal device 100 or a biometric information detection device 500 connected to the terminal device 100. The biological information acquisition unit may be, for example, the sensor 140. Further, the second biological information here corresponds to health status information, and may be the sensor output itself, or may be information obtained based on the sensor output. The control unit 110 transmits the second biological information to the external device 200 via the communication unit 130.

In this way, it becomes possible to monitor the health condition of the user using the external device 200 in real time, and when an event is detected, to execute control corresponding to the event. For example, the control device 310 acquires the values of heart rate and blood pressure as health status information, and if it is detected that these values are out of the standard range, the control device 310 may control the mobile object 300 to make an emergency stop. good.

FIG. 6 is an example of a biological information detection device 500. The biological information detection device 500 may be, for example, a watch-type device worn on the user's arm. A method of detecting biological information such as pulse rate using the watch-type biological information detection device 500 is widely known, and in this embodiment, such information can be widely used as the second biological information. Note that the biological information detection device 500 and the terminal device 100 may be connected using either the first communication method (for example, BLE) or the second communication method (Wi-Fi), or may be connected using either of the first communication methods (for example, BLE) or the second communication method (Wi-Fi). They may be connected using different communication methods. Furthermore, the biological information detection device 500 may be a wearable device in the form of glasses, or a sheet-type device that is attached to the user's clothing or skin using a sticker or the like. Modifications are possible.

Note that the method of this embodiment is not limited to being applied to either the terminal device 100 or the external device 200. For example, the method of this embodiment can be applied to a communication system 10 that includes a terminal device 100 and an external device 200. The terminal device 100 stores authentication information 121 used for biometric authentication of the user and personal information 122 of the user. The external device 200 has a sensor 240 that detects biological information, and executes control based on the personal information 122. External device 200 transmits the biometric information acquired by sensor 240 to terminal device 100 (steps S107 and S108 in FIG. 4). The terminal device 100 executes biometric authentication based on the authentication information 121 and the biometric information received from the external device 200 (step S109), and if it is determined that the biometric authentication is successful, transfers the personal information 122 to the external device 200. Transmit (step S112). The external device 200 executes control based on the personal information 122 received from the terminal device 100 (step S113).

In this way, biometric authentication and transmission and reception of personal information are appropriately performed between the terminal device 100 and the external device 200. Since there is no need to operate the terminal device 100 during biometric authentication, a system that is highly convenient for the user can be realized. Further, the process described above using FIG. 4 does not necessarily require the use of a public communication network such as the Internet. This makes it possible to send and receive personal information using biometric authentication even in environments where Internet connectivity is difficult. Note that in the above example, communication between the external device 200 and the certification authority may be necessary when performing device authentication. Even in this case, there are few situations where the Internet or the like is needed, and there are fewer restrictions on communication. Further, depending on the method of device authentication, communication with a certification authority may not be necessary, so in this case, the Internet or the like is not essential for processing including device authentication. As a result, it becomes possible to easily realize the communication system 10 of this embodiment.

Further, part or all of the processing performed by the terminal device 100 of this embodiment may be realized by a program. The program according to this embodiment can be stored, for example, in a non-transitory information storage device (information storage medium) that is a computer-readable medium. The information storage device can be realized by, for example, an optical disk, a memory card, an HDD, or a semiconductor memory. The semiconductor memory is, for example, a ROM. The control unit 110 of the terminal device 100 performs various processes of this embodiment based on programs stored in the information storage device. That is, the information storage device stores a program for causing the computer to function as the control unit 110. A computer is a device that includes an input device, a processing section, a storage section, and an output section. Specifically, the program according to the present embodiment is a program for causing a computer to execute each step particularly related to the terminal device 100 among the steps described above using FIG. For example, the program here may be application software that operates on the terminal device 100, which is a smartphone, so-called a smartphone application.

Furthermore, the method of this embodiment can be applied to a communication control method. The communication control method includes a terminal device 100 that stores authentication information 121 used for biometric authentication of the user and personal information 122 of the user, a sensor 240 that acquires the biometric information, and an external device that executes control based on the personal information 122. This is a method of controlling a communication system 10 including a device 200. The communication control method includes a step of transmitting biometric information acquired by the sensor 240 from the external device 200 to the terminal device 100, a step of performing biometric authentication based on the authentication information 121 and the biometric information, and a step of determining whether the biometric authentication is successful. If determined, the process includes the steps of transmitting the personal information 122 from the terminal device 100 to the external device 200, and executing control based on the personal information 122 in the external device 200.

3. Modifications The example in which the external device 200 is a moving body 300 such as a car has been described above. However, the external device 200 in this embodiment is not limited to this.

FIG. 7 is a diagram showing another configuration example of the communication system 10 including the terminal device 100 and the external device 200. As shown in FIG. 7, external device 200 may be an intercom 400. FIG. 7 shows a first terminal of the intercom 400 that is provided outside the facility, for example near the entrance, and the first terminal includes a camera 440, a call button 450, a speaker 460, a microphone 470, and the like. Note that the camera 440 corresponds to the sensor 240 in FIG. 3. Intercom 400 also includes a second terminal provided inside the facility. The second terminal includes a monitor 480 that displays images captured by the camera 440, a speaker, a microphone, etc., as will be described later with reference to FIG. Note that intercom 400 includes a control device (not shown) corresponding to control section 210. The control device may be provided in each of the first terminal and the second terminal, for example.

Users in this embodiment include, for example, police officers, employees of security companies, visitors to infrastructure companies such as electricity and gas, and employees of local governments. These users may visit homes, businesses, etc. in the course of business. However, it is not easy for the person receiving the visit to determine whether the visitor is a person with a legitimate identity or a person falsifying his or her identity. Therefore, in this embodiment, a process is performed in which personal information that can prove the visitor's identity is transmitted to the intercom 400, which is the external device 200.

The flow of processing in this embodiment is the same as that in FIG. 4 described above. For example, in step S101, information such as an ID card is registered. The information to be registered may be a police notebook, an employee identification card issued by a company, or an employee identification card issued by a local government. When registering such personal information, the control unit 110 of the terminal device 100 determines whether the registered personal information is the legitimate information of the user by inquiring the issuer about the personal identification number or the like.

After completing the registration process, the user visits a facility where the intercom 400, which is the external device 200 according to the present embodiment, has been installed. As a result, the distance between the terminal device 100 and the external device 200 becomes equal to or less than the predetermined distance threshold, so that communication using the first communication method such as BLE is established (step S102). The subsequent device authentication is similar to steps S103 to S105 described above. As a result, the external device 200 can confirm that the terminal device 100 is a legitimate device, and can perform encrypted communication using the second communication method between the terminal device 100 and the external device 200. (Step S106).

Further, the sensor 240 in this modification is a camera 440 that captures an image in the front direction of the first terminal of the intercom 400, as shown in FIG. Camera 440 captures an image of a user operating the interface section of intercom 400. The interface section corresponds to, for example, a call button 450, a speaker 460, a microphone 470, and the like. For example, when a user who is a visitor presses the call button 450, or when the user is standing in front of the intercom 400 and having a conversation with a person in the facility using the speaker 460 and microphone 470, the user is imaged. The captured image is acquired as biometric information. In this way, when the user of terminal device 100 is a visitor standing in front of intercom 400, biometric authentication and transmission and reception of personal information 122 are performed. The specific process flow is the same as the example described above using steps S107-S112, so detailed explanation will be omitted.

In this embodiment, ID card information is transmitted to the external device 200, for example in step S112. As described above, the ID card information includes information such as a facial photo, name, and affiliation. The ID card information may also include image data obtained by scanning the ID card.

FIG. 8 is a diagram illustrating an example of control using the personal information 122 executed in step S113. Specifically, FIG. 8 is a diagram illustrating an example of control of the control unit 210 using ID card information, which is the personal information 122, and shows an image displayed on the monitor 480 of the second terminal of the intercom 400. This is an example. The control unit 210 displays the image captured by the camera 440 on the monitor 480. In this way, it becomes possible to present the visitor's face etc. to people inside the facility, similar to a normal intercom. Furthermore, in the present embodiment, the control unit 210 may display an object corresponding to the ID card information in a superimposed manner on the captured image. In the example of FIG. 8, an object OB1 representing ID card information is displayed in the area next to the user US included in the captured image.

For example, object OB1 may be image data obtained by scanning an ID card. In this way, the real-time moving image of the visitor and the visitor's ID card can be displayed in a manner that is easy to compare. As a result, it is possible to easily determine whether the visitor is a legitimate user. Furthermore, as described above, the control unit 110 of the terminal device 100 checks with the issuer when registering ID card information. For example, application software installed on the terminal device 100 executes a process of rejecting registration of personal information that has not been verified by the issuer. Therefore, it is possible to prevent the information displayed as the object OB1 from being forged information.

Although FIG. 8 shows an example of displaying the image data of the ID card, the control unit 210 of the external device 200 may display the name, face photo, affiliation, etc. included in the ID card information in a different manner. .

Although this embodiment has been described in detail as above, those skilled in the art will easily understand that many modifications can be made without substantively departing from the novelty and effects of this embodiment. . Therefore, all such modifications are intended to be included within the scope of the present disclosure. For example, a term that appears at least once in the specification or drawings together with a different term with a broader or synonymous meaning may be replaced by that different term anywhere in the specification or drawings. Furthermore, all combinations of this embodiment and modifications are also included within the scope of the present disclosure. Furthermore, the configurations and operations of the terminal device, external equipment, communication system, etc. are not limited to those described in this embodiment, and various modifications are possible.

10...Communication system, 100...Terminal device, 110...Control unit, 120...Storage unit, 121...Authentication information, 122...Personal information, 123...Device authentication information, 130...Communication unit, 140...Sensor, 200...External device, 210... Control unit, 220... Storage unit, 221... Terminal information, 230... Communication unit, 240... Sensor, 300... Mobile object, 310... Control device, 340... Camera, 350... Steering wheel, 360... Seat, 400... Intercom, 440...camera, 450...call button, 460...speaker, 470...microphone, 480...monitor, 500...biological information detection device, US...user, OB1...object

Claims (11)

a storage unit that stores authentication information used for biometric authentication of a user and personal information of the user;
a communication unit that communicates with an external device that executes control based on the personal information;
Acquire biometric information from the external device via the communication unit, execute the biometric authentication based on the authentication information and the biometric information, and when it is determined that the biometric authentication is successful, obtain the biometric information from the external device via the communication unit. a control unit that controls transmitting the personal information to the external device;
Terminal equipment including. In claim 1,
The storage unit includes:
storing device authentication information used for device authentication of the terminal device;
The control unit includes:
Control is performed to transmit the device authentication information to the external device via the communication unit, and when the device authentication based on the device authentication information is successful in the external device, the biometric information is acquired from the external device. Terminal device. In claim 2,
The communication department includes:
Performing communication using the first communication method and communication using the second communication method,
The control unit includes:
transmitting the device authentication information using the first communication method, and communicating with the external device using the second communication method when the device authentication based on the device authentication information is successful in the external device; A terminal device that receives connection information for. In claim 3,
The device authentication information is a terminal device including first encrypted information used in communication using the second communication method and signature information. In claim 3 or 4,
The connection information includes information for specifying a network of the external device, and second encrypted information used in communication using the second communication method. In any one of claims 1 to 5,
The communication department includes:
acquiring second biometric information of the user from a biometric information acquisition unit included in the terminal device or a biometric information detection device connected to the terminal device;
The control unit includes:
A terminal device that controls transmitting the second biological information to the external device via the communication unit. A sensor that detects biological information,
a communication unit that communicates with a terminal device that stores the user's personal information;
a control unit that performs control based on the personal information;
including;
The control unit includes:
The biometric information detected based on the sensor is transmitted to the terminal device via the communication unit, and when it is determined that biometric authentication based on the biometric information has been successful in the terminal device, the communication unit an external device that performs control to request the personal information from the terminal device via the external device; In claim 7,
further comprising an interface section used when the user uses the external device,
The sensor is
an external device placed at a position to detect the biometric information of the user who uses the interface unit; a terminal device that stores authentication information used for biometric authentication of a user and personal information of the user;
an external device that has a sensor that detects biological information and executes control based on the personal information;
including;
The external device transmits the biological information acquired by the sensor to the terminal device,
The terminal device executes the biometric authentication based on the authentication information and the biometric information received from the external device, and transmits the personal information to the external device when determining that the biometric authentication is successful. death,
The external device executes control based on the personal information received from the terminal device,
Communications system. storing authentication information used for biometric authentication of a user and personal information of the user;
communicating with an external device that executes control based on the personal information of the user;
acquiring biometric information from the external device, performing the biometric authentication based on the authentication information and the biometric information, and transmitting the personal information to the external device when it is determined that the biometric authentication is successful;
A program that causes a computer to perform a process. A communication system that includes a terminal device that stores authentication information used for biometric authentication of a user and personal information of the user, and an external device that has a sensor that acquires biometric information and executes control based on the personal information. A control method,
transmitting the biological information acquired by the sensor from the external device to the terminal device;
performing the biometric authentication based on the authentication information and the biometric information;
If it is determined that the biometric authentication is successful, transmitting the personal information from the terminal device to the external device;
Executing control based on the personal information in the external device;
Communication control method.

Images