JP2013036251A - Vehicle opening/closing body operation device and system with on-vehicle camera and portable information terminal, and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a remote vehicle owner to unlock an opening/closing body for an occupant of the vehicle without requiring a communication from the occupant intending to get on the vehicle to the vehicle owner or possession of a sub-key by the occupant when the vehicle owner is remote from the vehicle.SOLUTION: An inventive vehicle opening/closing body operation device 10 includes: an on-vehicle camera 11 for acquiring images outside a vehicle; unlocking request starting means 12 for generating an unlocking request signal of the vehicle opening/closing body; transmitting and receiving means 13 for receiving the unlocking request signal and transmitting unlocking request message and the images to a predetermined portable terminal device 4, and receiving unlocking propriety response message from the portable terminal device 4; and control means 14 for controlling the locking state of the vehicle opening/closing body on the basis of the unlocking propriety response message.

Description

  The present invention relates to a vehicle opening / closing body operating device and system using an in-vehicle camera and a portable information terminal, and a control method thereof.

  Conventionally, techniques related to remote operation of vehicles have been developed. For example, in Patent Document 1, by linking a sensor unit and a control unit in a vehicle and a mobile phone, a vehicle owner in a remote place confirms the status of the vehicle by the mobile phone or remotely controls the vehicle. A vehicle control device and a remote control system are disclosed. In this apparatus and system, the vehicle owner in a remote place calls the above function with a mobile phone and activates it, or when the security sensor detects an abnormality in the vehicle, the above function is activated and the vehicle owner carries it accordingly. Control the vehicle from the telephone.

  Patent Document 2 discloses a vehicle state monitoring system that can take a picture of an intruder when a suspicious person enters the vehicle and notifies the vehicle owner's mobile phone of the photograph. When this vehicle state monitoring system detects a moving object moving in the vehicle, the vehicle state can be automatically captured by the in-vehicle camera and transmitted to the vehicle owner.

  In Patent Document 3, a vehicle owner with a master key grants part or all of a predetermined operation authority from a mobile phone of the vehicle owner to another person with a subkey, resulting in a decrease in security performance in the vehicle. An electronic key system for a vehicle that suppresses the noise and enhances user convenience is disclosed.

JP 2003-304339 A JP 2004-331051 A JP 2009-102943 A

  By the way, after parking the vehicle, the vehicle owner with the vehicle key and the occupant without the key may take different actions, and the occupant may return to the vehicle first. Here, if the occupant wants to get into the vehicle or puts only the luggage on the vehicle, the occupant has to contact the vehicle owner using some means of contact such as his / her mobile phone, etc. The crew had to wait outside the vehicle.

  According to the apparatus and system of Patent Document 1, the vehicle monitoring and control functions are performed by calling from a mobile phone of a remote vehicle owner or by detecting an abnormality with a security sensor. Therefore, when the vehicle owner is remote from the vehicle, in order for the occupant to get into the vehicle at the timing that the occupant intends, the vehicle owner has to contact the vehicle owner by some means. But the crew couldn't get on.

  According to the system of Patent Document 2, since a vehicle is monitored and controlled after someone has entered the vehicle, it is possible to determine whether a passenger is waiting outside the vehicle or whether a suspicious person is hesitant. Judgment from the owner could not be made. Therefore, the occupant could not get on before the vehicle owner who is remote.

  According to the system of Patent Document 3, signal processing is performed between the vehicle owner's mobile phone and the occupant's subkey, which is remote from the vehicle, so that the vehicle is controlled. Always had to carry a subkey. Therefore, a passenger who does not carry a subkey or a passenger who originally does not have a subkey (for example, a customer, a colleague, a friend, etc. who traveled on that day only) could not get on before the vehicle owner who is remote.

  Therefore, even when the vehicle owner is remote from the vehicle, the present invention does not require the vehicle owner to contact the vehicle owner or to hold the subkey by the vehicle occupant. It is an object of the present invention to provide a vehicle opening / closing body operating device and system capable of unlocking an opening / closing body such as a door.

The vehicle opening / closing body operating device according to the present invention includes an in-vehicle camera for acquiring an image outside the vehicle, an unlocking request starting means for generating an unlocking request signal for the vehicle opening / closing body, and a predetermined portable terminal that receives the unlocking request signal A transmission / reception means for transmitting an unlock request message and the video to the machine and receiving an unlock enable / disable response message from the mobile terminal, and for controlling the lock state of the vehicle opening / closing body based on the unlock enable / disable response message The control means is provided.
As described above, since the vehicle owner who is remote from the vehicle confirms the occupant near the vehicle with the image and performs unlocking, the remote vehicle owner does not have a subkey or the like according to his own judgment. Opening and closing bodies such as doors can be unlocked for passengers. Furthermore, the person's range in which the vehicle owner can permit the door lock to be unlocked can be flexibly expanded or reduced depending on the situation.

Here, the unlock request activation means is configured to generate different unlock request signals corresponding to a plurality of vehicle opening / closing bodies, and the in-vehicle camera is around the vehicle opening / closing body corresponding to the generated unlock request signals. The control means may be configured to control the lock state of the vehicle opening / closing body corresponding to the generated unlock request signal.
As described above, since the opening / closing body to be controlled in the locked state is specified on the vehicle side, the remote vehicle owner does not need to select the opening / closing body, and the control configuration can be simplified.
Further, the unlock request activation means is a switch or sensor provided on the door handle of the vehicle opening / closing body so that the unlock request signal is generated by pressing the switch or detecting the approach or contact of the human body to the sensor. May be.
As described above, since the activation of the unlocking request is associated with the operation of the door handle or the like, the operability for the passenger is improved with a simple configuration.
Further, the unlock request activation means may be a detection means configured to generate an unlock request signal when the door handle cable of the vehicle opening / closing body is pulled.
In this way, because the door handle cable pulling is used as a trigger for the unlocking request, the remote vehicle owner is not only able to operate the door properly by the Service-to-Other but also by the Service-to-Self. An unlock request can be transmitted, and security is improved.

Furthermore, you may make it provide the process state notification means which shows the process state by a control means toward the vehicle exterior.
When the person who performed the unlocking request operation is an occupant by this processing state notification means, the occupant can know whether the vehicle or the vehicle owner is responding to the unlocking request operation, When the person who has performed the unlocking request operation is a suspicious person, the suspicious person can sense that he / she is receiving some kind of monitoring, and can expect the effect of giving up the intrusion into the vehicle. Moreover, you may provide the alarm means which raises an alarm according to the command from a portable terminal device. The security effect can be further enhanced by the alarm means.
Furthermore, a recording means for recording a video by the in-vehicle camera in response to a command from the mobile terminal may be provided. By subsequently utilizing the video recorded by the recording means, the investigation regarding the suspicious person can be performed reliably.

A vehicle opening / closing body operating system of the present invention includes the above-described vehicle opening / closing body operating device and a portable terminal, and displays an image from the in-vehicle camera and an option for determining whether the opening / closing body can be unlocked on the screen of the portable terminal. .
According to said structure, the remote vehicle owner can judge and implement unlocking | release of an opening-closing body in a simple aspect in a portable terminal device.

In the control method for the vehicle opening / closing body operating system according to the present invention, the system includes a vehicle opening / closing body operating device and a portable terminal provided with the unlock request activation means, the in-vehicle camera, the transmission / reception means and the control means. A step of generating an unlocking request signal for the vehicle opening / closing body by the lock request starting means, a step of acquiring a video outside the vehicle by the in-vehicle camera, a mobile terminal that receives the unlocking request signal and receiving the unlocking request message and the video from the transmitting / receiving means Vehicle based on the unlocking propriety response message by the control means, the step of transmitting the video on the display unit of the portable terminal, the step of transmitting the unlocking propriety response message from the portable terminal to the transmitting / receiving means, A step of controlling the lock state of the opening and closing body.
As described above, the vehicle owner who is remote from the vehicle checks the occupant near the vehicle with the image and unlocks it, so that the remote vehicle owner can determine the Therefore, an opening / closing body such as a door can be unlocked. Furthermore, the person's range in which the vehicle owner can permit the door lock to be unlocked can be flexibly expanded or reduced depending on the situation.

Here, in the generating step, the unlock request activation means generates different unlock request signals corresponding to the plurality of vehicle opening / closing bodies, and in the step of acquiring the video, the in-vehicle camera generates the unlock request signal In the step of photographing and controlling the periphery of the vehicle opening / closing body corresponding to, the lock state of the vehicle opening / closing body corresponding to the generated unlock request signal may be controlled.
In this way, since the opening / closing body whose control state is to be controlled is specified on the vehicle side, it is not necessary for the remote vehicle owner to select the opening / closing body, and the control can be simplified.

It is a figure which shows schematic structure of the vehicle opening / closing body operating system of this invention. It is a block diagram of the vehicle opening / closing body operating system of the present invention. It is a flowchart which shows the control method of the vehicle opening / closing body operating system of this invention. It is a figure which shows an example of the screen of the portable terminal in the vehicle opening / closing body operating system of this invention. It is a figure which shows an example of the screen of the portable terminal in the vehicle opening / closing body operating system of this invention. It is a figure which shows an example of the screen of the portable terminal in the vehicle opening / closing body operating system of this invention. It is a figure which shows an example of the screen of the portable terminal in the vehicle opening / closing body operating system of this invention.

[Schematic configuration of vehicle opening / closing body operation system]
FIG. 1 shows a schematic configuration of a vehicle opening / closing body operating system 1 (hereinafter referred to as “system 1”) according to an embodiment of the present invention. The system 1 includes a vehicle 2, a wireless network 3, and a portable terminal 4 of the vehicle owner. The vehicle 2 includes an in-vehicle camera 5, a door handle 7 provided on a door (opening / closing body) 6, and a transceiver 8. The door handle 7 is provided with a switch 7a (for example, a door handle switch). As an alternative to the switch 7a, a sensor that detects an approaching action or a contact action of a human body may be provided. The transceiver 8 is assumed to be capable of information communication with the portable terminal 4 via the network 3, and the arrangement thereof is not limited to the illustrated position. The wireless network 3 includes a base station (not shown) and the like, and is a network that enables communication according to all communication standards. The portable terminal 4 includes any portable information terminal capable of wireless communication, such as a mobile phone, a smartphone, and a tablet PC.

  As an overview of the system 1, for example, after the vehicle owner parks the vehicle 2, the vehicle owner with the vehicle key and the occupant without the key (hereinafter referred to as “occupant”) take different actions, and the occupant first Assume that the vehicle returns to the vehicle. The door 6 is locked. When the occupant presses the switch 7a, the in-vehicle camera 5 acquires an image near the door 6. It is assumed that at least the face portion of the occupant is photographed in this video. The in-vehicle camera 5 may acquire an image before the occupant presses the switch 7a, or may be activated by a pressing operation of the switch 7a. The transceiver 8 transmits the video acquired by the in-vehicle camera 5 together with the unlock request message, that is, the video of at least the occupant's face via the network 3 in response to the operation of the occupant pressing the switch 7a. Transmit to the mobile terminal 4.

  The mobile terminal 4 receives the unlock request message from the vehicle 2, activates the corresponding application, and unlocks the door 6 based on the video displayed on the screen 4 a of the mobile terminal 4 to the vehicle owner. To determine whether or not. Here, when the vehicle owner permits the unlocking of the door 6, when an operation indicating permission to unlock the door 6 is performed by the vehicle owner, the portable terminal 4 sends an unlocking permission response message via the network 3. To the transceiver 8. The vehicle 2 receives the unlock permission response message and unlocks the door 6. Thus, the occupant can get on the vehicle 2 before the remote vehicle owner.

  On the other hand, it is assumed that a person who is not an occupant (for example, a suspicious person) presses the switch 7 a of the door handle 7 after the vehicle owner parks the vehicle 2. Similarly to the above, the in-vehicle camera 5 acquires the image near the door 6, and the transceiver 8 transmits the image from the in-vehicle camera 5 together with the unlock request message to the portable terminal 4 of the vehicle owner. The mobile terminal 4 receives the unlock request message from the vehicle 2, activates the corresponding application, and unlocks the door 6 based on the video displayed on the screen 4 a of the mobile terminal 4 to the vehicle owner. To determine whether or not. Here, the vehicle owner does not permit the unlocking of the door 6. The portable terminal 4 transmits an unlock rejection response message to the transceiver 8 when an operation indicating that the door 6 is unlocked is performed by the vehicle owner. The vehicle 2 receives the unlock rejection response message and maintains the door 6 locked. Furthermore, the vehicle owner may be able to remotely operate alarm means (not shown) by the portable terminal 4. Thereby, it is possible to prevent a suspicious person from entering the vehicle 2 in advance. Further, the video by the in-vehicle camera 5 may be recorded in a recording means (not shown) so that it can be used for later investigation.

[Control configuration of vehicle opening / closing body operating device]
FIG. 2 is a block diagram showing the configuration of the vehicle opening / closing body operating device 10 (hereinafter referred to as “device 10”) and the portable terminal 4 mounted on the vehicle 2 in the system 1. In FIG. 2, the vehicle 2 in FIG. 1 includes an opening / closing body 6-1 (for example, a left front door), an opening / closing body 6-2 (for example, a left rear door), an opening / closing body 6-3 (for example, a right front door), A body 6-4 (for example, a right rear door) and an opening / closing body 6-5 (for example, a back door) are provided, and these opening / closing bodies are collectively referred to as “opening / closing body 6”. In this embodiment, each opening / closing body is a door, but it may be a bonnet or a trunk, or a power window of the door. In addition, the device 10 does not necessarily have to be applied to all opening / closing bodies (doors). For example, the device 10 may not be applied to the right front door on the driver's seat side.

  The apparatus 10 includes vehicle-mounted cameras 11-1, 11-2,... 11-n (collectively referred to as “vehicle-mounted camera 11”), unlock request activation means 12-1, 12-2,. n (collectively these are referred to as “unlock request activation means 12”), a transmission / reception means 13, and a control means 14. The apparatus 10 can also include a processing state notifying unit 15, an alarm unit 16, and a recording unit 17. In the apparatus 10, the in-vehicle camera 11, the unlock request activation unit 12, the transmission / reception unit 13, the control unit 14, the processing state notification unit 15, the alarm unit 16, the recording unit 17, and the opening / closing body lock units 18-1 and 18-2. ... 18-n (collectively referred to as “opening / closing body locking portion 18”) are connected to each other via a control bus so as to communicate with each other. In FIG. 2, each unit is shown as being connected by wire, but may be connected wirelessly.

  The in-vehicle camera 11 is a camera that can acquire an image around the vehicle 2. For example, an in-vehicle camera may be provided in the vicinity of each opening / closing body 6 (door). In addition, the in-vehicle cameras 11-1 and 11-2 are mounted on the lower portions of the left and right side mirrors, and from the in-vehicle camera 11-1, the opening / closing body on the left side of the vehicle (front door and rear door in the case of four doors) You may make it acquire an image | video around the opening-and-closing body of the vehicle right side from the vehicle-mounted camera 11-2. Alternatively, a wide-angle in-vehicle camera 11 may be installed in the vicinity of the dashboard, in the room mirror section, etc., and images around all doors may be acquired simultaneously. Alternatively, the in-vehicle camera 11 with a variable shooting direction may be installed in the vicinity of the dashboard, in the room mirror section, or the like, and the images around all the doors may be scanned and acquired. In this case, the scanning in the shooting direction of the in-vehicle camera 11 may be performed to the left and right at a predetermined speed or a predetermined cycle, and as will be described later, the direction of the unlock request activation means 12 that issued the unlock request message You may make it suitable for. Further, a dedicated in-vehicle camera may be provided for the apparatus 10 so that the occupant can photograph the occupant himself.

  The unlock request activation means 12 detects the intention of boarding the human body and generates an unlock request signal according to the detection result. For example, like the switch 6a in FIG. 1, the unlock request activation means 12 can be a door switch provided in each door handle. The unlock request activation means 12 may be a sensor that detects that a human body has approached or contacted the door handle. Further, the unlock request activation unit 12 may be a detection unit that detects that the door handle is pulled. In this case, the detection means may be any means that can detect that the door handle system cable has been pulled. As a result, even when a bona fide user (that is, an occupant) pulls the door handle, a malicious user (i.e., a suspicious person) tries to open the door by unauthorized means without touching the door handle. A request signal can be generated.

  Further, the unlock request activation unit 12 may be a human sensor such as an infrared sensor that detects that a human body has approached the vehicle. In this case, the human sensor may be disposed in the vicinity of each opening / closing body, or a small number of wide-angle human sensors may be provided. When the unlocking request starting means 12 is an infrared sensor, it is detected that the human body has stayed at a predetermined position around the vehicle for a predetermined time, so that a person who intends to get on and a person who simply passes around the vehicle. It is desirable to be able to distinguish.

  The transmission / reception means 13 transmits the unlock request message and the video acquired by the vehicle-mounted camera 11 to the vehicle owner's portable terminal 4 via the network 3, and the unlocking permission response from the portable terminal 4 via the network 3. Any device that can receive a message is acceptable. The acquired video is preferably transmitted to the mobile terminal 4 in real time, but may be buffered in the transmission / reception means 13 or the network 3 and may be accompanied by some delay. Alternatively, the still image may be transmitted periodically or whenever there is a request from the portable terminal 4.

The control unit 14 includes a CPU, a memory, and an interface (IF) with each component, and controls the in-vehicle camera 11, the transmission / reception unit 13, the processing state notification unit 15, the alarm unit 16, the recording unit 17, and the opening / closing body locking unit 18. To do.
The control means 14 receives the unlock request signal from the unlock request activation means 12 and activates the in-vehicle camera 11 or keeps the in-vehicle camera 11 operated (always) before receiving the unlock request signal. Upon receiving the unlock request signal, the control unit 14 generates an unlock request message, and causes the transmission / reception unit 13 to transmit the unlock request message and the video of the in-vehicle camera 11 to the portable terminal 4.
The control means 14 controls (unlocks or keeps the lock) the open / close body lock unit 18 in response to the unlock permission / inhibition response message (unlock permission response message or unlock rejection response message) from the portable terminal 4.

  The opening / closing body locking portion 18 locks or unlocks each opening / closing body 6 based on a control signal from the control means 14. The opening / closing body lock unit 18 may feed back the locked / unlocked state to the control means 14.

  Here, as a first example, in-vehicle cameras 11-1 to 11-5 that photograph the periphery of each of the open / close bodies 6-1 to 6-5 are provided, and the unlock request activation means 12- 1-12-5 shall be provided. The images acquired by the on-vehicle cameras 11-1 to 11-5 are images V1 to V5, respectively, and the unlock request signals generated from the unlock request means 12-1 to 12-5 are the unlock request signals S1. ~ S5.

  In this example, for example, when the unlock request signal S1 is output from the unlock request activation means 12-1 corresponding to the opening / closing body 6-1, the control means 14 displays the unlock request message and the video of the in-vehicle camera 11-1. V1 is transmitted from the transmission / reception means 13 to the portable terminal 4. When the transmission / reception means 13 receives the unlock permission response message from the portable terminal 4, the control means 14 performs the unlocking process of the opening / closing body lock unit 18-1 corresponding to the unlock request signal S1. On the other hand, when the transmission / reception means 13 receives an unlock rejection response message for rejecting unlocking from the portable terminal 4, the control means 14 maintains the locking of the opening / closing body lock unit 18-1 corresponding to the unlock request signal S1. However, if it is not locked, a locking process is performed.

  Further, as a second example, one movable in-vehicle camera 11 having a photographing range of all opening / closing bodies is provided, and unlock request activation means 12-1 to 12-5 are provided for each opening / closing body. To do. The video V is acquired by the in-vehicle camera 11, and unlock request signals S1 to S5 are generated from the unlock request means 12-1 to 12-5, respectively.

  In this example, for example, when the unlock request signal S1 is output from the unlock request activation means 12-1 corresponding to the opening / closing body 6-1, the control means 14 moves the vehicle-mounted camera 11 around the opening / closing body 6-1. It drives so that it may become an imaging | photography range, and transmits the unlocking request message and the image | video V from the transmission / reception means 13 to the portable terminal device 4. FIG. When the transmission / reception means 13 receives the unlock permission response message from the portable terminal 4, the control means 14 performs the unlocking process of the opening / closing body lock unit 18-1 corresponding to the unlock request signal S1. On the other hand, when the transmission / reception means 13 receives an unlock rejection response message for rejecting unlocking from the portable terminal 4, the control means 14 maintains the locking of the opening / closing body lock unit 18-1 corresponding to the unlock request signal S1. However, if it is not locked, a locking process is performed.

  Further, as a third example, in-vehicle cameras 11-1 to 11-5 that photograph the periphery of each of the open / close bodies 6-1 to 6-5 are provided, or one movable in-vehicle system that uses the entire open / close body as an imaging range. Assume that a camera 11 is provided, and one unlock request activation means 12 including a wide-angle (multi-pixel) human sensor is provided as the unlock request activation means. It is assumed that the pixels of the human sensor have directivity on the open / close bodies 6-1 to 6-5. In this case, if the unlock request activation means 12 outputs the unlock request signals S1 to S5 corresponding to each pixel of the human sensor, the same processing as in the first or second example can be performed. .

  In each of the above examples, the configuration in which the corresponding opening / closing body locking unit is unlocked based on the location where the unlock request signal is generated is shown. However, the control means 14 determines which opening / closing body unlock request has been made. However, the unlocking of all the opening / closing bodies may be controlled collectively without determining. That is, when an unlock request signal is output from any one of the unlock request activation means and an unlock permission response message is received from the portable terminal 4, the control means 14 unlocks all the opening / closing body lock parts. You may make it process. In this case, the images V1 to V5 of the in-vehicle cameras 11-1 to 11-5 may be sequentially displayed on the screen 4a of the mobile terminal 4, or a scan image of one in-vehicle camera is displayed for several seconds. Alternatively, a panoramic image of one in-vehicle camera may be displayed. Further, the unlock request messages are set to RQ1 to RQ5 in response to the unlock request signals S1 to S5, and the opening / closing body for which the unlock request is activated is displayed on the portable terminal 4 based on the unlock request message. You may make it display on the part 24. FIG.

  The processing state notification means 15 indicates the operation state of the device 10 to the passenger or the like who has performed the unlock request operation. The processing state display means 15 notifies the processing state (progress of processing) in the control means 14 toward the outside of the vehicle by light, sound, partial operation of the vehicle, and the like. The processing status display means 15 includes means for displaying an image on a display or the like. Thereby, when the person who performed the unlock request | requirement operation | movement is a passenger | crew, the passenger | crew can know whether the vehicle 2 or the vehicle owner is reacting to the unlock request | requirement operation | movement. In addition, when the person who has performed the unlocking request operation is a suspicious person, the suspicious person can sense that he / she is receiving some kind of monitoring, and can expect the effect of giving up entering the vehicle.

  The processing state notification means 15 can be a plurality of lamps arranged at positions that can be visually recognized from the outside of the vehicle when notification is made by light. For example, when three lamps are used, the processing state notifying unit 15 turns off all the lamps in the initial state, and after the unlocking request starting unit 12 outputs the unlocking request signal or from the transmitting / receiving unit 13. The first lamp is turned on after the lock request message is transmitted, the second lamp is turned on after the transmission / reception means 13 receives the unlock permission response message from the portable terminal 4, and the opening / closing body lock unit 18 is unlocked. The third lamp may be turned on after the processing. Further, the processing state notification means 15 may be a single lamp arranged at a position where it can be visually recognized from the outside of the vehicle. In this case, the lamp is turned off in the initial state, and after the unlock request activation means 12 outputs the unlock request signal, or after the unlock request message is transmitted from the transmission / reception means 13, the lamp is turned on in the first cycle. The lamp is blinked, and after the transmission / reception means 13 receives the unlocking permission response message from the portable terminal 4, the lamp blinks in a second period (for example, a period longer than the first period), and the opening / closing body locking unit 18 is unlocked. The lamp may be turned on after the processing.

  The processing state notifying means 15 can be a beep sound generating means when notifying by sound. In this case, the processing state notifying unit 15 outputs the first voice (for example, the first voice) after the unlock request starting unit 12 outputs the unlock request signal or after the unlock request message is transmitted from the transmission / reception unit 13. And a second sound (for example, an intermittent sound of the second period) after the transmission / reception means 13 receives the unlocking permission response message from the portable terminal 4, and the opening / closing body lock unit A third sound (for example, one continuous sound) may be output after 18 is unlocked. The processing status display means 15 may be voice guidance means. In this case, the processing state notifying unit 15 outputs the first voice (“unlock request request” after the unlock request starting unit 12 outputs the unlock request signal or after the unlock request message is transmitted from the transmitting / receiving unit 13. Is output ", and the second transmission sound (sound such as" Unlocking permission has been issued ") is output after the transmission / reception means 13 receives the unlock permission response message from the mobile terminal 4. Then, after the opening / closing body locking unit 18 is unlocked, the third sound (sound such as “you can get on”) may be output.

  The processing state notifying means 15 may be a door mirror (movement) when notifying by a part of the operation of the vehicle. In this case, after the unlock request activation means 12 outputs the unlock request signal or after the unlock request message is transmitted from the transmission / reception means 13, the stored door mirror is opened and the transmission / reception means 13 is connected to the portable terminal 4. The door mirror that has been opened may be closed after receiving the unlocking permission response message from, or after the opening / closing body locking unit 18 is unlocked.

  The warning means 16 is for performing a warning operation when the vehicle owner determines that the person who activated the unlocking request is a suspicious person. If the vehicle owner determines from the video displayed on the screen 4 a of the mobile terminal 4 that the suspicious person is trying to enter the vehicle, the vehicle owner can transmit an alarm command from the mobile terminal 4. When the transmission / reception means 13 receives an alarm command, the control means 14 activates an alarm operation by the alarm means 16. The alarm operation of the alarm means 16 can be, for example, a horn by a horn, lighting or blinking of various lights (headlights, vehicle width lights, taillights, or interior lights), engine activation, car stereo operation start, and the like.

The recording means 17 is a means for recording the video of the suspicious person, particularly when the vehicle owner determines that the person who activated the unlocking request is a suspicious person, based on the judgment of the vehicle owner. . If the vehicle owner determines from the video displayed on the screen 4 a of the portable terminal 4 that the suspicious person is trying to enter the vehicle, the vehicle owner can transmit a recording command from the portable terminal 4. When the transmission / reception means 14 receives the recording command, the control means 14 records the video from the in-vehicle camera 11 in the recording means 17 (ie, recording).
In this embodiment, the video from the in-vehicle camera is recorded in the recording means 17 of the vehicle 2, but the video may be stored in the memory 22 of the portable terminal 4 or a remote server.

The portable terminal 4 includes a transmission / reception unit 21, a CPU 22, a memory 23 and a display unit 24.
When the transmission / reception unit 21 receives the unlock request message from the transmission / reception means 13 of the apparatus 10, the CPU 22 calls and activates the application for this system stored in the memory 23, and displays it on the display unit 24 (screen 4a). indicate. In the present embodiment, it is assumed that the display unit 24 is composed of a touch screen and also serves as an input / output interface (I / O). An instruction by the screen operation of the vehicle owner is input from the display unit 24 and transmitted to the transmission / reception means 13 of the apparatus 10 via the transmission / reception unit 21.

[Control method of vehicle opening / closing body operating system]
FIG. 3 is a flowchart showing a control method of the system 1 including the apparatus 10 described above. In the following description, the above “occupant” and “suspicious person” are collectively referred to as “third party”.

In step S01, the unlock request activation means 12 detects a third party's intention to board and outputs an unlock request signal. For example, in FIG. 1, the unlock request signal is generated when a third party pushes the switch 7 a of the door handle 7.
In step S02, the in-vehicle camera 11 starts photographing in response to the unlock request signal. Note that, as described above, the in-vehicle camera may have already taken a picture regardless of the unlock request signal.
In step S <b> 03, the transmission / reception unit 13 transmits the unlock request message and the video of the in-vehicle camera to the portable terminal 4 according to the instruction of the control unit 14.

In step S <b> 04, the mobile terminal 4 activates the vehicle remote control application in response to the unlock request message, and displays the video of the in-vehicle camera on the display unit 24. Note that the vehicle owner may determine whether to start the application.
In step S05, the application causes the vehicle owner to determine whether or not the third party displayed on the display unit 24 is an occupant (that is, whether or not the occupant is permitted to unlock). The process proceeds to step S06 if Yes (when the unlocking permission response message is transmitted), or proceeds to step S09 if No (when the unlocking rejection response message is transmitted).

  In step S06, the unlock permission response message is transmitted from the portable terminal 4 to the transmission / reception means 13 of the apparatus 10, and in step S07, the control means 14 unlocks the opening / closing body locking unit 18, and the system ends in step S08. Once confirmed, the process ends.

  In step S09, an unlocking rejection response message is transmitted from the portable terminal 4 to the transmission / reception means 13 of the apparatus 10, and in step S10, the control means 14 maintains the locked state of the opening / closing body locking unit 18, and the process proceeds to step S11. move on.

  In step S11, the application further causes the vehicle owner to determine whether to activate an alarm or whether to record a video from the in-vehicle camera. In step S11, in the case of Yes, an alarm command or a recording command is transmitted from the transmission unit 21 of the portable terminal 4 to the transmission / reception unit 13, and in step S12, the control unit 14 causes the alarm unit 16 to perform an alarm operation or record. The video of the in-vehicle camera is recorded on the means 17. In addition, when the warning by the warning means 16 is activated, the recording by the recording means 17 may be performed together. In step S11, if No or when the alarm operation or the recording operation ends, the system end is confirmed in step S13 and the process ends.

[Examples of screens on mobile terminals]
4A to 4D show examples of application screens used in the portable terminal 4 in the system 1. FIG. 4A to 4D, as an example of the mobile terminal device 4, a smartphone including a screen 4 a that can be touch-operated is illustrated.

  When the application for the system 1 is activated, as shown in FIG. 4A, an image 40 of the in-vehicle camera 11 and an option display 41 for determining whether to unlock are displayed on the screen 4a. When the vehicle owner selects (ie, touches) the unlocking permission “Yes” in the option display 41, as shown in FIG. 4B, a confirmation display 42 indicating that the in-vehicle camera 11 has been selected and the unlocking is displayed. The Thereafter, as shown in FIG. 4C, an option display 43 asking for termination of the application is displayed. Note that the video 40 of the in-vehicle camera 11 may not be displayed simultaneously with the option display 43. When the end “Yes” of the option display 43 is selected, the application ends. In addition, in FIGS. 4A and 4B, it may be displayed which opening / closing body is the target of the unlocking request.

  If the vehicle owner selects the unlock rejection “No” on the option display 41, as shown in FIG. 4D, the option of whether to trigger an alarm, whether to record, and whether to terminate the application A display 44 is displayed. When the alarm activation “alarm ON” is selected in the option display 44, the alarm operation by the alarm means 16 is performed in the vehicle 2. During the alarm operation, “alarm ON” in the option display 44 changes to “alarm OFF”, and the alarm operation ends when the vehicle owner selects “alarm OFF”. On the other hand, when the start of recording “recording ON” is selected in the option display 44, the recording operation by the recording unit 17 is performed in the vehicle 2. During recording, “Recording ON” in the option display 44 changes to “Recording OFF”, and the recording ends when the vehicle owner selects “Recording OFF”. In this embodiment, in the option display 44, the alarm activation “alarm ON” and the recording start “recording ON” are selectable independently. However, when the alarm activation “alarm ON” is selected, the alarm display “automatic alarm ON” is automatically selected. Recording may also be started. When the application end “system end” is selected in the option display 44, the application ends. Further, the alarm and recording may be automatically ended when a predetermined time has elapsed.

When the vehicle-mounted camera 11 is movable, the shooting direction of the vehicle-mounted camera 11 may be moved in the direction in which the vehicle owner's finger moves on the video 40 in the above application. Thereby, the behavior of a third party can be tracked for a longer time. Moreover, you may enable it to adjust the imaging | photography range and in-focus state of the vehicle-mounted camera 11 by screen operation of a vehicle owner.
Furthermore, in the above-mentioned application, not only an option display for alarm activation and recording start, but also an option display for whether or not to report to the police may be provided. When the report to the police is selected by this option, the 110th report can be made with the video 40 of the in-vehicle camera displayed.

  Further, in the option display regarding the alarm activation of the application, the threat level of the alarm may be displayed. For example, if a suspicious third party appearing in the video 40 is only fooling around the vehicle, the vehicle owner is in the vicinity, such as playing music on a car stereo, turning on the car radio, starting the engine, etc. It is preferable that a warning with a relatively low threat level is activated so as to make it recognized. On the other hand, when a suspicious third party appearing in the video 40 is trying to enter the vehicle, it is preferable that a high threat level alarm such as a horn by horn is activated. According to this system, such a threat level can be determined by a remote vehicle owner.

  As described above, according to the embodiment of the present invention, when the vehicle owner is remote from the vehicle, the passenger who intends to ride does not need to contact the vehicle owner or possess the subkey by the passenger. The vehicle owner can unlock the opening / closing body for the passenger. In particular, whether or not the door lock can be unlocked can be determined by the vehicle owner himself / herself based on the video around the vehicle (particularly the video of the face of a third party) transmitted from the in-vehicle camera in almost real time. By using such a so-called face-path system, an authentication process for electronically identifying a third party becomes unnecessary. As a result, a suspicious third party cannot impersonate an occupant by an electronic fraud (an illegal copy of an electronic key, an illegal acquisition of an ID, etc.) and get on the vehicle by an illegal means. Conversely, since an electronic key, ID, or the like given in advance when the door lock is released is not necessary, a person's range in which the vehicle owner can permit the door lock to be unlocked can be flexibly expanded or reduced depending on the situation. .

  In addition, even if a suspicious third party tries to invade the vehicle, remote control from the vehicle owner can not only maintain the door lock but also trigger an alarm and record the suspicious person's behavior. Security can be improved. That is, according to the present embodiment, unlike the automatic security system, the vehicle operation at the time of detection of a suspicious person can be selected according to the situation according to the situation of the vehicle owner himself. Is possible.

1. 1. Vehicle opening / closing body operation system Vehicle 3. 3. Wireless network Mobile terminal 4a. Screen 5. In-vehicle camera Opening and closing body 7. Door handle 7a. Switch 8. Transceiver 10. Vehicle opening / closing body operating device 11. In-vehicle camera 12. Unlock request activation means 13. Transmission / reception means 14. Control means 15. Process status notification means 16. Alarm means 17. Recording means 18. Opening / closing body lock part 21. Transmitter / receiver 22. CPU
23. Memory 24. Display unit 40. Video 41, 42, 44. Choice display 43. Confirmation display

Claims (10)

A vehicle opening / closing body operating device,
In-vehicle camera for capturing images outside the vehicle,
Unlock request activation means for generating an unlock request signal for the vehicle opening and closing body;
A transmission / reception means for receiving the unlock request signal and transmitting the unlock request message and the video to a predetermined mobile terminal, and receiving an unlock enable / disable response message from the mobile terminal, and the unlock enable / disable A vehicle opening / closing body operating device comprising control means for controlling the locked state of the vehicle opening / closing body based on a response message.   The unlock request activation means is configured to generate different unlock request signals corresponding to a plurality of vehicle opening / closing bodies, and the in-vehicle camera is arranged around the vehicle opening / closing body corresponding to the generated unlock request signals. The vehicle opening / closing body device according to claim 1, wherein the vehicle opening / closing body device is configured to take a picture and to control a locked state of the vehicle opening / closing body corresponding to the generated unlock request signal.   The unlock request activation means is a switch or a sensor provided on a door handle of the vehicle opening / closing body, and the unlock request signal is generated by detecting the pushing operation of the switch or the approach or contact of the human body to the sensor. The vehicle opening / closing body operating device according to claim 1 or 2.   The unlocking request starting means is detection means configured to generate the unlocking request signal when a door handle cable of the vehicle opening / closing body is pulled. The vehicle opening / closing body operating device.   The vehicle opening / closing body operating device according to any one of claims 1 to 4, further comprising a processing state notifying unit that indicates a processing state by the control unit toward the outside of the vehicle.   The vehicle opening / closing body operating device according to any one of claims 1 to 5, further comprising alarm means for issuing an alarm in response to a command from the portable terminal.   The vehicle opening / closing body operating device according to any one of claims 1 to 6, further comprising recording means for recording an image from the in-vehicle camera in response to a command from the portable terminal.   A vehicle opening / closing body operating device according to any one of claims 1 to 6 and the portable terminal, wherein an image from the in-vehicle camera and whether the vehicle opening / closing body can be unlocked are displayed on a display unit of the portable terminal. A vehicle opening / closing body operating system in which choices to be determined are displayed. A control method of a vehicle opening / closing body operating system including an unlocking request activation means, a vehicle-mounted camera, a transmission / reception means and a control means, and a mobile terminal operating system,
Generating an unlocking request signal for a vehicle opening / closing body by the unlocking request activation means;
Acquiring a video outside the vehicle by the in-vehicle camera;
Receiving the unlock request signal, and transmitting the unlock request message and the video from the transmitting / receiving means to the mobile terminal;
Displaying the video on a display unit of the mobile terminal;
A control method comprising the steps of: transmitting an unlockability response message from the portable terminal to the transmission / reception means; and controlling the lock state of the vehicle opening / closing body based on the unlockability response message by the control means. In the generating step, the unlock request activation means generates different unlock request signals corresponding to a plurality of vehicle opening / closing bodies,
In the obtaining step, the in-vehicle camera images the periphery of the vehicle opening / closing body corresponding to the generated unlock request signal,
The control method according to claim 9, wherein in the controlling step, a locked state of the vehicle opening / closing body corresponding to the generated unlock request signal is controlled.

Images