JP2019097024A - Remote operation system, on-vehicle device, and remote operation method - Google Patents

Abstract

To provide a remote operation system, on-vehicle device, and remote operation method capable of reducing a load on a user in initial registration processing of a remote operation of a vehicle.SOLUTION: A remote operation system enables a remote operation of a vehicle 1 by a smart phone 60 by communication between an on-vehicle device 10 mounted on the vehicle 1 and the smart phone 60. The on-vehicle device 10 includes: a user biological information registration section 22 for registering user biological information 32 acquired when a user uses the vehicle 1; and an operator authentication section for acquiring operator biological information being the biological information of an operator of the smart phone 60, and permitting a remote operation of the vehicle 1 by the smart phone 60 when coincidence between operator biological information and user biological information is equal to or more than a predetermined level.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a remote control system, an in-vehicle apparatus, and a remote control method.

  Conventionally, a remote control system has been proposed which executes remote control of a vehicle in response to a remote control request from an operating terminal (see, for example, Patent Document 1). In the remote control system described in Patent Document 1, the on-vehicle device authenticates that the operator of the terminal device is the user of the vehicle based on the password or the biological information transmitted from the operation terminal.

JP 2007-280110 A

As described above, when the on-vehicle device performs authentication of the operator of the operation terminal used for remote control of the vehicle, information of the operator used for the authentication (password, biometric information (fingerprint, vein, face, iris, etc.), etc.) It is necessary to execute a process (initial registration process) of registering in advance in the in-vehicle apparatus. Then, if the initial registration process is troublesome, there is a disadvantage that it is difficult for the user to use the remote control of the vehicle by the operation terminal.
The present invention has been made in view of the above background, and it is an object of the present invention to provide a remote control system, an in-vehicle apparatus, and a remote control method capable of reducing the burden on the user in initial registration processing of remote control of a vehicle. Do.

  A first aspect of the remote control system according to the present invention is a remote control system that enables remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle, A user biometric information registration unit for registering user biometric information, which is biometric information of the user acquired when the user uses the vehicle, and the terminal when an instruction for remote operation of the vehicle is given in the terminal device; The operator's biometric information, which is biometric information of the operator of the device, is acquired to calculate the degree of coincidence between the operator's biometric information and the user's biological information, and the terminal device when the degree of coincidence is equal to or more than a predetermined level And an operator authentication unit for prohibiting the remote control of the vehicle by the terminal device when the remote control of the vehicle by the control unit is permitted and the degree of coincidence is less than the predetermined level. And said that you are.

  In addition, when the user biometric information registration unit registers the user biometric information acquired when the user uses the vehicle for rental, the user biometric information registration unit registers the user biometric information when the rental period has passed. It is good also as composition which erases.

  A second aspect of the remote control system according to the present invention is a remote control system that enables remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle. When the terminal device starts an application for performing remote control of the vehicle, when the terminal device receives a key signal including specific information of the vehicle transmitted from a remote control key of the vehicle, When a user biometric information registration unit that acquires biometric information of the operator of the terminal device and registers the acquired biometric information as user biometric information, and when the terminal device instructs the remote control of the vehicle Acquiring operator biometric information which is biometric information of the terminal device, calculating a degree of agreement between the operator biometric information and the user biometric information, and the agreement degree is a predetermined level When it is above, remote control of the above-mentioned vehicle by the above-mentioned terminal unit is permitted, and when the above-mentioned coincidence is less than the above-mentioned predetermined level, it has an operator authentication part which prohibits remote control of the above-mentioned vehicle by the above-mentioned terminal unit It is characterized by

  Further, when there are a plurality of users of the vehicle, the user biometric information registration unit acquires biometric information of the plurality of users and individually registers them as the user biometric information, and the operator authentication unit When the degree of coincidence between the operator biometric information and any of the user biometric information for the plurality of users is equal to or higher than the predetermined level, the remote control of the vehicle by the terminal device is permitted, and the operator biometric information When the degree of coincidence with any of the user biometric information for the plurality of users is less than the predetermined level, remote control of the vehicle by the terminal device may be prohibited.

  The user biometric information and the operator biometric information may include face image and fingerprint information, and the operator authentication unit may determine that the matching degree of the face image between the user biometric information and the operator biometric information is the first. When the condition is satisfied that the fingerprint of the user biometric information and the operator biometric information of the user biometric information and the operator biometric information is at least the second predetermined level. The remote control of the vehicle may be permitted, and when the condition is not satisfied, the remote control of the vehicle by the terminal device may be prohibited.

  Next, a first aspect of the in-vehicle apparatus according to the present invention is an in-vehicle apparatus mounted in a vehicle and enabling communication with the terminal device to enable remote control of the vehicle by the terminal device, wherein the user is the vehicle A user biometric information registration unit for registering user biometric information which is biometric information of the user acquired when using the device, and an operation of the terminal device when an instruction for remote operation of the vehicle is given in the terminal device The operator's biometric information which is the biometric information of the person is acquired, the degree of agreement between the operator's biometric information and the user's biometric information is calculated, and when the degree of agreement is a predetermined level or more, the vehicle by the terminal device And an operator authentication unit for prohibiting the remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level.

  Further, a second aspect of the in-vehicle apparatus according to the present invention is an in-vehicle apparatus mounted in a vehicle and enabling remote control of the vehicle by the terminal device by communication with the terminal device, the user being the first for the vehicle The user's biometric information is acquired when using the user's biometric information, and the user's biometric information registration unit registers the acquired biometric information as user's biometric information, and the terminal device instructs the remote control of the vehicle When the operator biometric information which is biometric information of the operator of the terminal device is acquired, the matching degree between the operator biometric information and the user biometric information is calculated, and the matching degree is equal to or higher than a predetermined level An operator authentication unit for permitting remote operation of the vehicle by the terminal device and prohibiting remote operation of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level. Characterized in that it comprises a.

  Next, a first aspect of the remote control method according to the present invention is a remote control method which enables remote control of the vehicle by the terminal device through communication between the terminal device and an on-vehicle device mounted on the vehicle. A user biometric information registration step of registering user biometric information which is biometric information of the user acquired when the user uses the vehicle, and when the terminal device instructs the remote control of the vehicle Acquiring operator biometric information which is biometric information of an operator of the terminal device, calculating a degree of coincidence between the operator biometric information and the user's biological information, and when the degree of coincidence is equal to or more than a predetermined level An operator authentication step for permitting remote control of the vehicle by the terminal device and prohibiting remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level Characterized in that it contains and.

  Further, in the user biometric information registration step, when the user biometric information acquired when the user uses the vehicle for rental is registered, when the term of the rental has passed, the user biometric information The registration may be deleted.

  A second aspect of the remote control device according to the present invention is a remote control method that enables remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle. When the terminal device starts an application for performing remote control of the vehicle, when the terminal device receives a key signal including specific information of the vehicle transmitted from a remote control key of the vehicle, A user biometric information registration step of acquiring biometric information of an operator of the terminal device and registering the acquired biometric information as user biometric information, and when the terminal device instructs the remote control of the vehicle The operator biometric information which is biometric information of the terminal device is acquired, the degree of coincidence between the operator biometric information and the user's biometric information is calculated, and the degree of coincidence is a predetermined level And an operator authentication step of permitting remote control of the vehicle by the terminal device when it is above, and prohibiting remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level. It is characterized by

  In the user biometric information registration step, when there are a plurality of users of the vehicle, biometric information of the plurality of users is acquired and individually registered as the user biometric information, and in the operator authentication step When the degree of coincidence between the operator biometric information and any of the user biometric information for the plurality of users is equal to or higher than the predetermined level, the remote control of the vehicle by the terminal device is permitted, and the operator biometric information When the degree of coincidence with any of the user biometric information for the plurality of users is less than the predetermined level, remote control of the vehicle by the terminal device may be prohibited.

  Further, the user biometric information and the operator biometric information include face image and fingerprint information, and in the operator authentication step, the degree of coincidence of the face image between the user biometric information and the operator biometric information is the first. When the condition is satisfied that the fingerprint of the user biometric information and the operator biometric information of the user biometric information and the operator biometric information is at least the second predetermined level. The remote control of the vehicle may be permitted, and when the condition is not satisfied, the remote control of the vehicle by the terminal device may be prohibited.

  According to the remote control system, the in-vehicle apparatus, and the remote control method of the present invention, the user's biometric information can be registered without the user of the vehicle being aware. Therefore, the burden on the user in the initial registration process of the remote control of the vehicle can be reduced.

Explanatory drawing of registration of the user biometric information in 1st Embodiment. The block diagram of a vehicle-mounted apparatus. Smart phone configuration diagram. Explanatory drawing of the display screen of a remote control application. Configuration diagram of remote control keys. 6 is a flowchart of registration processing of user biometric information in the first embodiment. The transition diagram of the process in the case of authenticating an operator by the vehicle-mounted apparatus side. The transition diagram of the process in the case of authenticating an operator by the smart phone side. Explanatory drawing of registration of the user biometric information in 2nd Embodiment. 10 is a flowchart of registration processing of user biometric information in the second embodiment. Explanatory drawing of registration of the user biometric information in 3rd Embodiment. The flowchart of the registration process of the user biometric information in 3rd Embodiment.

[1. Outline of the First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 shows an outline of registration of user biometric information and remote control of a vehicle according to the first embodiment. Referring to FIG. 1, the remote control system of the present invention includes a smartphone 60 (corresponding to a terminal device of the present invention) carried by a user P1 of the vehicle 1 and an on-vehicle device 10 mounted on the vehicle 1 ing.

  In order to enable remote control of the vehicle 1 by the smartphone 60 possessed by the user P1, as shown in A of FIG. 1, when the user P1 uses the vehicle 1 by purchasing or renting the vehicle 1, the on-vehicle device 10 A process (initial registration process) of registering the biometric information (user biometric information) of the user P1 is performed.

  In the store S selling or renting the vehicle 1 in order to perform initial registration processing, the person in charge (salesman) P2 executes the user registration application (application program) by the personal computer 202, and the camera 200 displays the face of the user P1. Take an image. Data 210 of the face image of the user P1 is transmitted from the personal computer 202 to the in-vehicle apparatus 10, and the feature value extracted from the face image is registered as user biometric information of the user P1 (stored in the memory of the in-vehicle apparatus 10) .

  A fingerprint or voiceprint of the user P1 may be used as the user biometric information of the user P1 instead of or together with the face image. In this case, the fingerprint sensor 201 and the microphone 203 are prepared in the store S, the fingerprint and voiceprint of the user P1 are input, and the fingerprint and voiceprint information is transmitted from the personal computer 202 to the on-vehicle apparatus 10 to perform registration.

  As shown in B of FIG. 1, when the user P1 operates the smartphone 60 to remotely operate the vehicle 1, the face of the user P1 is imaged by the camera 101 of the smartphone 60 and extracted from the face image The feature amount is transmitted to the on-vehicle apparatus 10 as operator biometric information. Then, the in-vehicle device 10 authenticates that the operator of the smartphone 60 is the user P1 of the vehicle 1 when the matching degree between the user biometric information and the operator biometric information is equal to or higher than a predetermined level (for example, 90%). , Remote control of the vehicle 1 is permitted.

  The condition that the user P1 is in possession of the remote control key 150 may be set as a condition for permitting the remote operation of the vehicle 1 by the smartphone 60. Moreover, when using a fingerprint as user's biometric information of the user P1, the fingerprint information detected by the fingerprint sensor 93 of the smart phone 60 is transmitted to the in-vehicle apparatus 10, and authentication by the fingerprint is performed. Moreover, when using a voiceprint as biometric information of the user P1, voiceprint information detected by the microphone of the smartphone 60 is transmitted to the on-vehicle apparatus 10, and authentication by the voiceprint is performed.

[2. Configuration of remote control system]
Referring to FIG. 2, the in-vehicle apparatus 10 is an electronic circuit unit configured by a CPU 20, a memory 30, various interface circuits (not shown), and the like. The CPU 20 functions as the remote control unit 21, the user biometric information registration unit 22, and the operator authentication unit 23 by executing the control program 31 of the in-vehicle apparatus 10 stored in the memory 30.

  A vehicle ECU (Electronic Control Unit) 2 that controls the overall operation of the vehicle 1, an image processing unit 50, an operation unit 40, a fingerprint sensor 41, a display unit 42, a speaker 43, a microphone 44, and communication The part 45 is connected.

  A front camera 51, a right camera 52, a left camera 53, and a rear camera 54 for capturing an image of the surroundings of the vehicle 1 are connected to the image processing unit 50. Furthermore, an in-vehicle camera 55 is connected to the image processing unit 50. The in-vehicle camera 55 picks up an area including the driver in the vehicle compartment of the vehicle 1. The image processing unit 50 performs imaging with each of the cameras 51 to 55 in accordance with control signals output from the in-vehicle device 10 and the vehicle ECU 2, performs various processes on the captured image, and processes the in-vehicle device 10 and the vehicle ECU 2 Output to

  The vehicle ECU 2 controls the operation of the vehicle mechanism unit 3 (drive mechanism, braking mechanism, steering mechanism, etc.), and the front camera 51, the right side camera 52, the left side camera 53, and the rear camera output from the image processing unit 50. The automatic driving control for operating the vehicle mechanism unit 3 is executed based on the information or the like based on the 54 captured images. The communication unit performs wireless communication with the smartphone 60 and the remote control key 150 of the vehicle 1.

  When remote control signal transmitted from smartphone 60 is received via communication unit 45, remote control unit 21 operates vehicle mechanism unit 3 or the like via vehicle ECU 2 according to the content of an instruction by the remote control signal. Perform remote control. The remote control unit 21 is, for example, remote automatic storage for causing the vehicle 1 to travel by automatic control and stop at the parking space by remote control, and remote automatic storage for causing the vehicle 1 to travel by automatic control and exit from the parking space, The remote air conditioning system performs heating and cooling of the passenger compartment by operating an air conditioner (not shown) of the vehicle 1 and a car finder which blinks lights of the vehicle 1 and outputs a notification sound.

  The user biometric information registration unit 22 acquires the face image of the user P1 of the vehicle 1 and extracts the feature amount of the face image. Then, the user biometric information registration unit 22 stores the feature quantity extracted from the face image as the user biometric information 32 in the memory 30 (registration of user biometric information).

  When the operator authentication unit 23 receives operator biometric information indicating the feature amount of the face image of the operator of the smartphone 60 captured by the smartphone 60 via the communication unit 45, the operator biometric information and the user biometric information The degree of coincidence with the information 32 is calculated. Then, when the degree of coincidence is equal to or higher than a predetermined level (for example, 90%), the operator authentication unit 23 authenticates that the smartphone 60 is the user P1 and permits remote operation of the vehicle 1 by the smartphone 60. Do. On the other hand, when the degree of coincidence is less than the predetermined level, the operator authenticating unit 23 determines that the authentication is not possible, and prohibits the remote operation of the vehicle 1 by the smartphone 60.

  Referring to FIG. 3, the smartphone 60 is configured of a CPU 70, a memory 80, various interface circuits (not shown), and the like. Connected to the CPU 70 are a touch panel 90 including a display panel 91 and a touch switch 92 disposed on the surface of the display panel 91, a fingerprint sensor 93, a speaker 94, a microphone 95, a communication unit 96, and an image processing unit 100. .

  The camera 101 is connected to the image processing unit 100, and the image processing unit 100 performs imaging with the camera 101 according to a control signal output from the CPU 70, performs various processing on the captured image, and outputs the processing result to the CPU 70. Do.

  The CPU 70 functions as a remote control unit 71 by executing a remote control application (application program) stored in the memory 80. Further, as described later, when the smart phone 60 executes registration of user biometric information and authentication of the operator, the CPU 70 executes the remote control application to perform user biometric information registration unit 72 and operator authentication. It functions as the unit 73.

  When the remote control application 81 is executed, the remote control unit 71 displays an initial screen on the touch panel 90 as shown in C of FIG. 4. The remote control unit 71 displays a storage instruction key 110, a delivery instruction key 111, a vehicle state diagnosis key 112, and an initial setting key 113 on the initial screen. When the initial setting key 113 is touched, the remote control unit 71 displays the initial registration screen shown in D on the touch panel 90.

  The remote control unit 71 displays the face key 120, the vehicle key number key 121, the fingerprint key 122, and the voice recognition key 123 on the initial registration screen. Furthermore, the remote control unit 71 displays registration display buttons 124 to 127 indicating registration states (OK: registered, NG: unregistered) of facial feature amounts, vehicle key numbers, fingerprints, and voices on the initial setting screen. Do.

  The user biometric information registration unit 72 responds to touch operations of the face key 120, the vehicle key number key 121, the fingerprint key 122, and the voice recognition key 123, and the biometric information (features of face, fingerprint, and voiceprint) of the user P1 or A process of registering a vehicle key number of remote control key 150 set to a unique value to vehicle 1 is performed. In addition, regarding biometric information, the process which registers user biometric information is also performed by 1st-3rd embodiment mentioned later, without being based on operation by the user P1.

  For example, when the user P1 performs touch operation on the face key 120, the user biometric information registration unit 72 captures an image of the face of the user P1 with the camera 101, extracts the feature amount of the face image, and stores it in the memory 80. In addition, when the user P1 touches the fingerprint key 122, the user biometric information registration unit 72 detects fingerprint information of the user P1 by the fingerprint sensor 93, extracts a fingerprint feature amount, and stores it in the memory. When the user P1 touches the voice recognition key 123, the user biometric information registration unit 72 inputs the voice of the user P1 with the microphone 95, extracts the feature amount of the voice, and stores it in the memory 80.

  When the user P1 performs touch operation on the vehicle key number key 121, the user biometric information registration unit 72 may touch the screen prompting transmission of data including the vehicle key number by the input of the vehicle key number of the remote control key 150 or the operation of the remote control key 150. Displayed on 90. Then, when user P1 inputs a vehicle key number or operates remote control key 150 to transmit data including the vehicle key number, user biometric information registration unit 72 stores the key number of remote control key 150 in memory 80. . The user biometric information registration unit 72 transmits the biometric information of the user P1 stored in the memory 80 to the in-vehicle apparatus 10.

  In addition, user biometric information registration section 72 is OK (registered) / NG (not registered) of each registration display button 124-127 according to registered / unregistered of user biometric information and vehicle key number of remote control key 150. Switch the display of.

  When the remote control application 81 is activated by the smartphone 60, the operator authentication unit 73 has registered any user biometric information (biometric information by face, fingerprint or voiceprint) and a vehicle key number. A process of authenticating whether the operator of the smartphone 60 is the user P1 of the vehicle 1 is performed. Specifically, when the operator authentication unit 73 receives a signal including the vehicle key number stored in the memory 80 from the remote control key possessed by the operator, the operator authentication unit 73 acquires biometric information of the operator and performs user registration Calculate the degree of agreement with the information. Then, when the degree of coincidence is equal to or higher than the predetermined level, the operator authenticating unit 73 authenticates that the operator of the smartphone 60 is the user P1.

  In the present embodiment, authentication of the operator is performed using a face image. This authentication is performed by either the smartphone 60 or the in-vehicle device 10 as described later. Then, when the operator of the smartphone 60 is authenticated as the user P1 of the vehicle 1, the remote control unit 71 responds to the operation of the storage instruction key 110, the delivery instruction key 111, and the vehicle state diagnosis key 112. An instruction signal for remote control is transmitted to the vehicle 1.

  For example, when the storage instruction key 110 is operated, the remote control unit 71 transmits an instruction signal instructing the on-vehicle device 10 of the vehicle 1 to park the vehicle 1 in the parking space by automatic operation control. . In response to the instruction signal, the in-vehicle device 10 instructs the vehicle ECU 2 to execute the automatic storage process, and the vehicle ECU 2 operates the vehicle mechanism unit 3 to execute the automatic storage process.

  Further, when the delivery instruction key 111 is operated, the remote control unit 71 instructs the on-vehicle device 10 of the vehicle 1 to execute an automatic delivery process for causing the vehicle 1 to leave the parking space through the automatic operation control. To send an instruction signal. In response to the instruction signal, the in-vehicle device 10 instructs the vehicle ECU 2 to execute the automatic withdrawal process, and the vehicle ECU 2 operates the vehicle mechanism unit 3 to execute the automatic withdrawal process.

  Further, when the vehicle state diagnosis key 112 is operated, the remote control unit 71 transmits an instruction signal instructing transmission of vehicle state data indicating the state of the vehicle 1 to the in-vehicle device of the vehicle 1. In response to the instruction signal, the in-vehicle device 10 acquires the condition diagnosis information (remaining battery level, remaining amount of gasoline, maintenance history, etc.) of the vehicle 1 from the vehicle ECU 2 and transmits data indicating the condition diagnosis information to the smartphone 60 . The smartphone 60 having received this data displays the state diagnosis information on the touch panel 90.

  Referring to FIG. 5, remote control key 150 includes key controller 151 (composed of CPU, memory, interface circuit, etc.), operation switch 152, fingerprint sensor 153, display unit 154, communication unit 155, and the like. .

  The key controller 151 holds data of a key number (specific information of the vehicle 1) uniquely set for the vehicle 1. Then, authentication by the key number is performed to establish wireless communication with the vehicle 1, and in response to the operation of the operation switch 152, a remote control signal instructing locking or unlocking of the vehicle 1 is transmitted to the vehicle 1. . When the remote control signal is received, the ECU 2 of the vehicle 1 executes processing such as locking and unlocking of the vehicle 1 in accordance with an instruction from the remote control signal.

  The key controller 151 also supports fingerprint authentication, and the user P1 of the vehicle 1 can detect his / her fingerprint with the fingerprint sensor 153 and register it. In this case, the key controller 151 reads the fingerprint of the operator of the remote control key 150 by the fingerprint sensor 153, and when the degree of coincidence with the fingerprint data of the registered user P1 is a predetermined level or more, the vehicle 1 by the remote control key 150 Allow remote control of

[3. Registration of User Biometric Information in First Embodiment]
A registration process of user biometric information (a feature amount extracted from a face image in this embodiment) executed by the user biometric information registration unit 22 of the in-vehicle apparatus 10 will be described according to the flowchart shown in FIG. The process according to the flowchart of FIG. 6 corresponds to the user biometric information registration step in the remote control method of the present invention.

  As described above with reference to A of FIG. 1, when the user P1 purchases or rents the vehicle 1 at the shop S of the vehicle seller or rental company, the person in charge P2 of the shop S is the user P1. The face is imaged by the camera 200 and taken into the personal computer 202 (terminal device). Then, the person in charge P2 transmits the face image data 210 from the personal computer 202 to the in-vehicle apparatus 10 of the vehicle 1.

  In step S1 of FIG. 6, when the user biometric information registration unit 22 receives data 210 of the face image of the user P1 transmitted from the personal computer 202 of the store S, the process proceeds to step S2. In step S2, the user biometric information registration unit 22 extracts the feature amount from the face image data 210.

  In the subsequent step S3, the user biometric information registration unit 22 stores the extracted feature amount as user biometric information 32 in the memory 30 (registration of user biometric information). In the next step S5, the user biometric information registration unit 22 determines whether the rental vehicle is used. Then, the user biometric information registration unit 22 proceeds to step S10 when the vehicle is used for rental, and proceeds to step S6 when the vehicle is not used for rental (when the vehicle is purchased).

  In step 10, the user biometric information registration unit 22 receives, from the personal computer 202 of the store S, data of the rental deadline of the vehicle 1 by the user P1. Then, when the rental time limit of the vehicle 1 has passed in step S11, the user biometric information registration unit 22 proceeds to step S12 to erase the user biometric information 32 stored in the memory 30 (of the user biometric information Registration cancellation). Thereby, the use of the vehicle 1 by the user P1 after the rental time limit can be prohibited.

  The registration of the user biometric information in the first embodiment is performed by transmitting data 210 of the face image of the user P1 from the personal computer 202 of the store S to the in-vehicle device 10 when the user P1 purchases or rents a vehicle. It will be. Therefore, it is not necessary for the user P1 to perform an operation of intentionally registering the user biometric information, and the burden on the user P1 in the initial registration process can be reduced.

[4. User authentication process by in-vehicle device]
A process of authenticating the user P1 on the in-vehicle apparatus 10 will be described according to the transition diagram shown in FIG. The transition diagram of FIG. 7 is an explanatory diagram in which operations and processes executed by the operator of the smartphone 60, the smartphone 60, and the in-vehicle device 10 are represented in time series by the common time axis t. The processing by the operator authentication unit 73 of the in-vehicle apparatus 10 in the transition diagram of FIG. 7 corresponds to the operator authentication step in the remote control method of the present invention.

  When the remote control application is activated in the smartphone 60, the smartphone 60 and the in-vehicle apparatus 10 perform a pairing process to establish communication. In step S20, the remote control unit 71 of the smartphone 60 images the face of the operator of the smartphone 60 with the camera 101. In the following step S21, the remote control unit 71 extracts the feature amount from the image of the face, and stores the extracted feature amount in the memory 80 as operator biometric information. Then, the remote control unit 71 transmits the operator biometric information to the in-vehicle apparatus 10.

  In step S30, the operator authentication unit 23 of the in-vehicle apparatus 10 reads out the user biometric information 32 stored in the memory 30. Then, the operator authentication unit 23 calculates the degree of coincidence between the user biometric information 32 and the operator biometric information received from the smartphone 60 in step S31.

  In the next step S32, the operator authenticating unit 23 determines whether the degree of coincidence between the user biometric information 32 and the operator biometric information is equal to or higher than a predetermined level. Then, when the degree of coincidence is equal to or higher than a predetermined level (for example, 90%) (authentication success), the operator authentication unit 23 continues communication between the smartphone 60 and the in-vehicle device 10 to remotely control the vehicle 1 by the smartphone 60. Allow the operation.

  On the other hand, when the matching degree between the user biometric information 32 and the operator biometric information is less than the predetermined level, the operator authenticating unit 23 transmits an authentication impossible notification to the smartphone 60. In the smartphone 60 having received the authentication non-permission notification, the remote control unit 71 displays a screen indicating that the authentication is non-permission on the touch panel 90 in step S22, and outputs a guidance voice for non-authentication from the speaker 94 ( Notification of non-authentication).

  In the subsequent step S23, the remote control unit 21 shuts off the communication between the smartphone 60 and the in-vehicle device 10. Thereby, when the operator of the smartphone 60 is a person other than the user P1 of the vehicle 1, the remote operation of the vehicle 1 by the smartphone 60 is prohibited.

[5. User authentication process by smartphone]
Next, according to the transition diagram shown in FIG. 8, the process in the case where the smart phone 60 authenticates the user P1 will be described. The transition diagram of FIG. 8 is an explanatory diagram in which operations and processes executed by the smartphone operator, the smartphone 60, and the in-vehicle device 10 are represented in time series by the common time axis t. In addition, the process by the operator authentication part 73 of the smart phone 60 in the transition diagram of FIG. 8 is corresponded to the operator authentication step in the remote control method of this invention.

  When the remote control application is activated in the smartphone 60, the smartphone 60 and the in-vehicle apparatus 10 perform a pairing process to establish communication. Subsequently, the operator authentication unit 73 of the smartphone 60 transmits a transmission request signal for requesting transmission of user biometric information to the in-vehicle apparatus 10. In the on-vehicle apparatus 10 having received the transmission request signal, the remote control unit 21 reads out the user biometric information 32 stored in the memory 30 and transmits the user biometric information 32 to the smartphone 60.

  Subsequently, the operator authentication unit 73 of the smartphone 60 images the face of the operator of the smartphone 60 with the camera 101 in step S40. In the next step S41, the operator authenticating unit 73 extracts a feature amount from the face image, and stores the extracted feature amount in the memory 80 as operator biometric information. In the subsequent step S42, the operator authenticating unit 73 calculates the degree of coincidence between the user biometric information and the operator biometric information.

  In the next step S43, the operator authenticating unit 73 determines whether the degree of coincidence between the user biometric information 32 and the operator biometric information is equal to or higher than a predetermined level (for example, 90%). Then, when the degree of coincidence is equal to or higher than the predetermined level (authentication success), the operator authentication unit 73 continues the communication between the smartphone 60 and the in-vehicle device 10 to enable remote operation of the vehicle 1 by the smartphone 60. .

  On the other hand, when the matching degree between the user biometric information 32 and the operator biometric information is less than the predetermined level, the operator authenticating unit 73 displays a screen indicating that the authentication is not possible on the touch panel 90 in step S44. , The guidance voice of non-authentication is output from the speaker 94 (notification of non-authentication).

  In the subsequent step S45, the operator authentication unit 73 cuts off the communication between the smartphone 60 and the in-vehicle device 10. Thereby, when the operator of the smartphone 60 is a person other than the user P1 of the vehicle 1, the remote operation of the vehicle 1 by the smartphone 60 is prohibited.

[6. Registration of User Biometric Information in Second Embodiment]
The registration of user biometric information in the second embodiment will be described with reference to FIGS. 9 and 10. Referring to FIG. 9, in the second embodiment, as indicated by C, when the user P1 of the vehicle 1 uses the vehicle 1 for the first time, the in-vehicle device 10 captures the face of the user P1 with the in-vehicle camera 55 Then, the feature amount is extracted from the face image 56.

  Then, the in-vehicle apparatus 10 registers the feature quantity extracted from the face image 56 as user biometric information (saves in the memory 30 of the in-vehicle apparatus 10). Thereby, as shown in D, as in the first embodiment described above, it is possible to perform authentication of the user P1 with a face image, and to permit remote operation of the vehicle 1 by the smartphone 60.

  FIG. 10 is a flowchart of registration processing of user biometric information according to the second embodiment, which is executed by the user biometric information registration unit 22 of the on-vehicle apparatus 10. The process according to the flowchart of FIG. 10 corresponds to the user biometric information registration step in the remote control method of the present invention.

  In step S50, the user biometric information registration unit 22 determines whether the vehicle P1 is first used by the user P1. Here, the first use of the vehicle 1 by the user P1 means a case where the user P1 gets on the vehicle 1 for the first time after completing the procedure of purchasing or renting the vehicle 1, and performs the start operation.

  Then, when the user P1 uses the vehicle for the first time, the user biometric information registration unit 22 proceeds to step S51 and images the face of the user P1 with the in-vehicle camera 55. In the following step S52, the user biometric information registration unit 22 extracts the feature amount from the face image of the user P1, and stores the extracted feature amount in the memory 30 as the user biometric information 32 in step S53 (registration of user biometric information ). Thus, the operator authentication unit 23 can perform authentication of the smartphone 60 using the user biometric information 32 stored in the memory 30.

  The registration of the user biometric information in the second embodiment is performed by imaging the face of the user P1 when the user P1 uses the vehicle for the first time. Therefore, it is not necessary for the user P1 to perform an operation of intentionally registering the user biometric information, and the burden on the user P1 in the initial registration process can be reduced.

  When the fingerprint or voiceprint of the user P1 is used as the biometric information, the user biometric information registration unit 22 detects the fingerprint of the user P1 by the fingerprint sensor 41 when the user P1 uses the vehicle 1 for the first time, or The voiceprint of the user P1 is detected by the microphone 44. Then, the user biometric information registration unit 22 stores fingerprint and voiceprint information in the memory 30 as user biometric information.

[7. Registration of User Biometric Information in Third Embodiment]
The registration of user biometric information in the third embodiment will be described with reference to FIGS. 11 and 12. With reference to FIG. 11, in the third embodiment, registration processing of user biometric information (information of a face image in the present embodiment) executed by the smartphone 60 and the in-vehicle apparatus 10 will be described.

  Referring to FIG. 11, in the third embodiment, as shown in E, when the user P1 of the vehicle 1 holds the remote control key 150 of the vehicle 1 and the smartphone 60 first starts the remote control application Then, the camera 101 captures an image of the face of the user P1. Then, the feature amount is extracted from the face image of the user P1 by the smartphone 60, and the extracted feature amount is transmitted to the on-vehicle apparatus 10 as the user biometric information 32.

  The in-vehicle device 10 registers the user biometric information 32 received from the smartphone 60 (stored in the memory 30 of the in-vehicle device 10). Thereby, as shown in F, as in the first embodiment and the second embodiment described above, it is possible to perform authentication of the user P1 with a face image and permit remote control of the vehicle 1 by the smartphone 60. It becomes.

  FIG. 12 is a flowchart of the registration process of user biometric information according to the third embodiment, and the process of steps S60 to S66 on the left side is executed by the remote control unit 71 of the smartphone 60. Further, the processing of steps S70 to S71 on the right side is executed by the user biometric information registration unit 22 of the in-vehicle apparatus 10. The process according to the flowchart of FIG. 12 corresponds to the user biometric information registration step in the remote control method of the present invention.

  At step S60, when there is a first start operation of the first remote control application, the remote control unit 71 of the smartphone 60 advances the process to step S61 to start the remote control application. In the following step S62, the user biometric information registration unit 72 determines whether or not a key signal including a key number uniquely set for the vehicle 1 is received from the remote control key 150.

  When the user biometric information registration unit 72 receives the key signal including the key number, the process proceeds to step S63, and the camera 101 captures an image of the face of the user P1. In the subsequent step S64, the remote control unit 71 extracts the feature amount from the captured face image, and stores the extracted feature amount as the user biometric information 32 in the memory 80. In the next step S65, the remote control unit 71 transmits the user biometric information 32 to the in-vehicle apparatus 10.

  On the other hand, when the key signal including the key number uniquely set for the vehicle 1 is not received from the remote control key 150 in step S62, the remote control unit 71 proceeds the process to step S66. In this case, the process of steps S63 to S65 is not executed, and the process of steps S70 to S71 by the user biometric information registration unit 22 of the on-vehicle apparatus 10 described later is not executed either, so the user biometric information is not registered.

  When the user biometric information registration unit 22 of the in-vehicle apparatus 10 receives the user biometric information 32 from the smartphone 60 in step S70, the process proceeds to step S71. Then, in the subsequent step S71, the user biometric information registration unit 22 stores the user biometric information 32 in the memory 30 (registration of user biometric information).

  The registration of user biometric information in the third embodiment is performed by imaging the face of the user P1 when the user P1 first activates the remote control application. Therefore, it is possible to reduce the burden on the user P1 in the initial registration process without requiring the user P1 to intentionally register the user biometric information.

  When the fingerprint or voiceprint of the user P1 is used as the biometric information, the remote control unit 71 of the smartphone 60 detects the fingerprint of the user P1 by the fingerprint sensor 93 when the user P1 starts the remote control application for the first time. Or, the voiceprint is detected by the microphone 95. Then, the remote control unit 71 of the smartphone 60 transmits fingerprint and voiceprint information as user biometric information to the in-vehicle apparatus 10, and the user biometric information registration unit 22 stores the fingerprint and voiceprint user registration information in the memory 30.

[Other embodiments]
In the above embodiment, the user biometric information registration unit 22 of the in-vehicle apparatus 10 stores and registers the user biometric information 32 in the memory 30 of the in-vehicle apparatus 10. However, the user biometric information registration unit 72 of the smartphone 60 The user biometric information 32 may be stored in the memory 80 of the smartphone 60. In this case, when authenticating the user P1 on the in-vehicle apparatus 10 side, the user biometric information 32 is transmitted from the smartphone 60 to the in-vehicle apparatus 10.

  Although the user biometric information 32 is stored in the memory 30 of the in-vehicle apparatus 10 in the above embodiment, the user biometric information 32 is stored in the server as a configuration in which the in-vehicle apparatus 10 can communicate with the server via the communication network. You may do it. According to this configuration, when authenticating the operator of the smartphone 60, the operator authentication unit 23 of the in-vehicle apparatus 10 downloads the user biometric information 32 from the server. Further, when authenticating the operator of the smartphone 60, the operator authentication unit 73 of the smartphone 60 downloads user biometric information from the server.

  In the above embodiment, the smartphone 60 is shown as the terminal device of the present invention, but the terminal device of the present invention may be any terminal device that can communicate with the in-vehicle device 10; It may be a telephone or the like.

  Although the feature amount of the face image is used as the user biometric information in the above embodiment, the feature amount of the face image and the fingerprint may be used. In this case, when the matching degree of the feature amount of the face image is the first predetermined level or more and the matching degree of the fingerprint is the second predetermined level or more between the user biometric information and the operator biometric information, the smartphone The 60 operators may be authenticated as the user P1.

  Although the case where the user of the vehicle 1 is one was illustrated in the said embodiment, when there are two or more users of the vehicle 1, by the user biometric information registration part 22 of the vehicle-mounted apparatus 10 or the user biometric information registration part 72 of the smart phone 60. , Individually register user biometric information of each user. Then, the operator authentication unit 23 of the in-vehicle apparatus 10 or the operator authentication unit 73 of the smartphone 60 has a predetermined matching degree between the operator biometric information detected from the operator of the smartphone 60 and any user biometric information registered. When it is above the level, the operator is authenticated as the user of the vehicle 1.

  2 and 3 are schematic diagrams showing the functional configurations of the in-vehicle device 10 and the smartphone 60 according to the main processing contents, in order to facilitate understanding of the present invention. The configuration of the smartphone 60 can also be classified into more components depending on the processing content. Also, one component can be classified to perform more processing. Also, the processing of each component may be performed by one hardware or may be performed by a plurality of hardware. In addition, processing of each component may be realized by one program or may be realized by a plurality of programs.

  The control program 31 executed by the CPU 20 in the in-vehicle apparatus 10 and the remote control application 81 executed by the CPU 70 in the smartphone 60 are downloaded from an external server via, for example, a communication network, and then the memory 30 such as RAM. , 80 and may be executed by the CPUs 20 and 70. Alternatively, the program may be directly loaded from an external server to the memory 30, 80 such as a RAM via the communication network and executed by the CPU 20, 70. Alternatively, it may be loaded from a storage medium connected to the in-vehicle device 10 or the smartphone 60 onto the memory 30, 80 such as a RAM.

  The processing units of the flowcharts shown in FIGS. 6, 10 and 12 are divided according to the main processing contents in order to facilitate understanding of the processing by the on-vehicle apparatus 10 and the smartphone 60. The present invention is not limited by the method and name of division of the processing unit. The processing of the in-vehicle device 10 and the smartphone 60 can be further divided into more processing units according to the processing content. Also, one processing unit can be divided to include more processes. Further, the processing order of the above-described flowcharts is not limited to the illustrated example as long as similar processing results can be obtained.

1 Vehicle (own vehicle)
2 Mechanism part 5 Driving support device 10 Control unit 20 CPU
21 Current position detection unit 22 Map information acquisition unit 23 Surrounding condition detection unit 24 Automatic operation reception unit 25 Automatic operation section recognition unit 26 Non-automatic operation section recognition unit 27 Automatic operation control unit 28 Navigation unit 30 Memory 31 Control program 40 Operation unit 42 speaker 43 camera 44 image processing unit 51 gyro sensor 52 GPS receiver 53 FM multiplex receiver 54 beacon receiver 55 vehicle communication unit 56 network communication unit 70 communication network 71 information server 80 broadcast station 90 roadside machine 100 vehicle 200 general road 201 Bridge girder 210 Expressway 300 Expressway 305 Boundary point 310 General road 350 Boundary point

Claims (12)

A remote control system that enables remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle,
A user biometric information registration unit that registers user biometric information that is biometric information of the user acquired when the user uses the vehicle;
When an instruction for remote operation of the vehicle is issued in the terminal device, operator biometric information, which is biometric information of the operator of the terminal device, is acquired to match the operator biometric information with the user biometric information. Calculating the degree, and permitting the remote control of the vehicle by the terminal device when the degree of coincidence is greater than or equal to a predetermined level, and remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level A remote control system comprising: a prohibited operator authentication unit.   If the user biometric information registration unit registers the user biometric information acquired when the user uses the vehicle for rental, the user biometric information registration unit erases the registration of the user biometric information when the rental period has passed. The remote control system according to claim 1, characterized in that: A remote control system that enables remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle,
When the terminal device starts an application for performing remote control of the vehicle, the terminal device receives a key signal including specific information of the vehicle transmitted from a remote control key of the vehicle; A user biometric information registration unit that acquires biometric information of an operator of the device and registers the acquired biometric information as user biometric information;
In the terminal device, when an instruction for remote control of the vehicle is issued, the operator biometric information which is biometric information of the terminal device is acquired, and the matching degree between the operator biometric information and the user biometric information is obtained. Calculate the remote control of the vehicle by the terminal device when the degree of coincidence is equal to or higher than a predetermined level, and prohibit the remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level A remote control system comprising an operator authentication unit. When there are a plurality of users of the vehicle, the user biometric information registration unit acquires biometric information of the plurality of users and registers them individually as the user biometric information.
When the degree of coincidence between the operator biometric information and any of the user biometric information for the plurality of users is equal to or higher than the predetermined level, the operator authentication unit performs remote control of the vehicle by the terminal device. When the permission degree and the matching degree between the operator biometric information and any of the user biometric information for the plurality of users are less than the predetermined level, the remote control of the vehicle by the terminal device is prohibited. The remote control system according to any one of claims 1 to 3, wherein: The user biometric information and the operator biometric information include face image and fingerprint information,
The operator authentication unit determines that the degree of coincidence of the face image between the user biometric information and the operator biometric information is equal to or higher than a first predetermined level, and between the user biometric information and the operator biometric information. When the condition that the degree of matching of the fingerprint is the second predetermined level or more is satisfied, the remote control of the vehicle by the terminal device is permitted, and when the condition is not satisfied, the vehicle of the vehicle by the terminal device The remote control system according to any one of claims 1 to 4, wherein remote control is prohibited. An on-vehicle device mounted on a vehicle and enabling remote control of the vehicle by the terminal device through communication with the terminal device,
A user biometric information registration unit that registers user biometric information that is biometric information of the user acquired when the user uses the vehicle;
When an instruction for remote operation of the vehicle is issued in the terminal device, operator biometric information, which is biometric information of the operator of the terminal device, is acquired to match the operator biometric information with the user biometric information. Calculating the degree, and permitting the remote control of the vehicle by the terminal device when the degree of coincidence is greater than or equal to a predetermined level, and remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level An on-vehicle apparatus comprising: a prohibited operator authentication unit; An on-vehicle device mounted on a vehicle and enabling remote control of the vehicle by the terminal device through communication with the terminal device,
A user biometric information registration unit that acquires biometric information of the user when the user uses the vehicle for the first time, and registers the acquired biometric information as user biometric information;
In the terminal device, when an instruction for remote operation of the vehicle is issued, the operator biometric information which is biometric information of the operator of the terminal device is acquired, and the operator biometric information and the user biometric information A degree of coincidence is calculated, and when the degree of coincidence is equal to or higher than a predetermined level, remote control of the vehicle by the terminal device is permitted, and when the degree of coincidence is less than the predetermined level, remote control of the vehicle by the terminal device And an operator authentication unit for prohibiting the on-vehicle device. A remote control method for enabling remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle,
A user biometric information registration step of registering user biometric information which is biometric information of the user acquired when the user uses the vehicle;
When an instruction for remote operation of the vehicle is issued in the terminal device, operator biometric information, which is biometric information of the operator of the terminal device, is acquired to match the operator biometric information with the user biometric information. Calculating the degree, and permitting the remote control of the vehicle by the terminal device when the degree of coincidence is greater than or equal to a predetermined level, and remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level A remote control method characterized by including an operator authentication step to prohibit.   In the user biometric information registration step, when the user biometric information acquired when the user uses the vehicle for rental is registered, registration of the user biometric information is performed when the rental time limit has passed. The remote control method according to claim 8, wherein the deletion is performed. A remote control method for enabling remote control of the vehicle by the terminal device by communication between the terminal device and an on-vehicle device mounted on the vehicle,
When the terminal device starts an application for performing remote control of the vehicle, the terminal device receives a key signal including specific information of the vehicle transmitted from a remote control key of the vehicle; A user biometric information registration step of acquiring biometric information of an operator of the device and registering the acquired biometric information as user biometric information;
In the terminal device, when an instruction for remote control of the vehicle is issued, the operator biometric information which is biometric information of the terminal device is acquired, and the matching degree between the operator biometric information and the user biometric information is obtained. Calculate the remote control of the vehicle by the terminal device when the degree of coincidence is equal to or higher than a predetermined level, and prohibit the remote control of the vehicle by the terminal device when the degree of coincidence is less than the predetermined level And an operator authentication step. In the user biometric information registration step, when there are a plurality of users of the vehicle, biometric information of the plurality of users is acquired and individually registered as the user biometric information,
In the operator authentication step, when the matching degree between the operator biometric information and any of the user biometric information for the plurality of users is equal to or higher than the predetermined level, the remote control of the vehicle by the terminal device is performed. When the permission degree and the matching degree between the operator biometric information and any of the user biometric information for the plurality of users are less than the predetermined level, the remote control of the vehicle by the terminal device is prohibited. The remote control method according to any one of claims 8 to 10, wherein The user biometric information and the operator biometric information include face image and fingerprint information,
In the operator authentication step, the degree of coincidence of the face image between the user biometric information and the operator biometric information is equal to or higher than a first predetermined level, and between the user biometric information and the operator biometric information When the condition that the degree of matching of the fingerprint is the second predetermined level or more is satisfied, the remote control of the vehicle by the terminal device is permitted, and when the condition is not satisfied, the vehicle of the vehicle by the terminal device The remote control method according to any one of claims 8 to 11, wherein remote control is prohibited.

Images