JP2016036067A - Smart Parking Assist system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an inexpensive and easy-to-introduce smart parking assist system, which assists drive operation of a driver while driving by using a portable terminal, and acts as a security device while parking.SOLUTION: A smart parking assist system 10 includes a main unit 11 having a plurality of cameras 13 and a plurality of sensors 14, and a subunit 12 having a subunit body 50 consisting of a portable terminal such as a smart phone having a monitor screen 56 and a key tag 51 transmitting a distance determination signal. When the distance between the main unit and key tag, determined by the distance determination signal, is equal to a predetermined distance or less, the smart parking assist system operates in a parking assist mode for assisting the drive operation of a driver by displaying the image on the periphery of a vehicle, captured by means of a camera, on the monitor screen, and a security mode for monitoring the situation on the periphery of a vehicle by transmitting a captured image to the subunit body is activated when the predetermined distance is exceeded.SELECTED DRAWING: Figure 1

Description

  The present invention uses a smartphone, a mobile phone, a tablet-type terminal device or a similar mobile terminal device, assists the driver in driving the vehicle, and monitors the vehicle when parked The present invention relates to a smart parking assist system that assists the operation of a security device.

2. Description of the Related Art In recent years, automobiles have a parking assist system that supports a driver's driving operation. The parking assist system includes at least one camera, a monitor that displays an image captured by the camera, a control device that controls the captured image to be displayed on the monitor most effectively, and a situation around the vehicle. It consists of a sensor to detect, and is formed to support fine driving operations such as parking and stopping and width adjustment to the road shoulder. As a result, the parking assist system can assist the driving operation of the driver, in particular, driving operation such as parking / stopping by the back and parallel parking to narrow the road shoulder.
In addition, automobiles have a security system that monitors the vehicle body and the periphery of the vehicle while parked. The security system captures a plurality of sensors that detect objects within a predetermined range around the vehicle, at least one camera that captures an intruder, and triggering the detection of the intruder by the sensor. It consists of a control device that controls the sensor and camera. Moreover, you may provide the alarm device linked with a sensor preferably. As a result, the security system can prevent accidents such as hitting and escaping and theft such as vandalism.

On the other hand, various functions can be added to mobile terminal devices, particularly smartphones and tablet-type terminal devices, by installing application software as well as calling functions.
Here, the car audio system by wireless communication transmission of utility model registration No. 3179256 is provided with a smartphone connected to the in-vehicle car audio system via a wireless communication line, and the smartphone and the back camera are connected to each other on the monitor screen of the smartphone. It discloses disclosing an image by a back camera.

Utility Model Registration No. 3179256

The conventional parking assist system as described above is often a genuine product installed in a car from the beginning. In the case of the genuine product, the key and the control device of the parking assist system are paired, for example, the security system is operated together with the door locking, or the parking assist system is activated when the engine is started. . The key has an IC chip and wireless communication means, and can perform various functions such as keyless entry, keyless engine start, or immobilizer for locking and unlocking the door using short-range wireless communication. Is formed.
However, when installing a parking assist system as described above in an automobile, it is necessary to install the parking assist system, set up work such as associating the parking assist system with a key, install a monitor, or wire sensors. Of course, it is very troublesome and costly to work, for example, it is very difficult to write information about the parking assist system attached to the IC chip, or attach a wireless communication means to the genuine key and pair it with the parking assist system It is difficult to. Therefore, unlike a genuine parking assist system, a retrofit parking assist system is generally a model in which functions that are not paired with a key are greatly limited as described above. That is, it is hard to say that the retrofit parking assist system can be operated easily.

  Therefore, the problem to be solved by the present invention is to use a portable terminal device to assist a driver's driving operation during driving and to work as a security device during parking and to be introduced at low cost and easily. It is to provide a smart parking assist system that can be used.

The smart parking assist system according to claim 1 is composed of a main unit and a subunit that are communicably connected to each other via a wireless communication line.
The main unit includes at least one camera capable of photographing the periphery of the vehicle or the inside of the vehicle,
Having main control means for controlling image processing relating to an image photographed by the camera;
The subunit includes display means having a monitor screen capable of displaying the image;
Sub-control means for controlling image processing related to the image displayed by the display means;
The main unit and the subunit have bidirectional communication means capable of bidirectional communication with each other related to the wireless communication line in the main control means and the sub control means, respectively.
When taking an image with the camera,
The main unit converts the image into electronic image data,
An image signal related to the image data is transmitted from the main unit to the subunit over the wireless communication line,
The image data is converted into the image by the subunit that has received the image signal,
A smart parking assist system configured to reproduce and display the image on the monitor screen,
The wireless communication line is
When a distance between the main unit and the subunit is equal to or less than a predetermined distance, a short-range wireless communication line in charge of communication between the main unit and the subunit;
When the predetermined distance is exceeded, a long-distance wireless communication line in charge of communication in charge of communication between the main unit and the subunit,
The sub unit is provided with a transmission means for periodically transmitting a distance determination signal to the main unit,
Based on the distance determination signal, the main unit has a distance determination means for determining a distance from the subunit, and the short distance wireless communication line or the long distance wireless communication based on a determination result of the distance determination means. Providing a line selection means for selecting the wireless communication line of any one of the lines;
While the distance determination signal transmitted from the transmission means is received by the main unit, the distance determination means determines that the distance between the main unit and the subunit is equal to or less than a predetermined distance,
When the main unit cannot receive the distance determination signal, the distance determination unit determines that the distance between the main unit and the subunit exceeds a predetermined distance,
When the distance between the main unit and the subunit is a predetermined distance or less,
The line selection means selects the short-range wireless communication line,
Through the short-range wireless communication line, image data related to the image captured by the camera is transmitted to the subunit,
The subunit that has received the image data reproduces and displays an image based on the image data on the monitor screen without substantial delay,
The main unit and the subunit operate in a parking assist mode that assists the driving operation of the driver by displaying an image of the vehicle periphery captured by the camera on the monitor screen,
When the distance between the main unit and the subunit exceeds a predetermined distance,
The line selection means selects the long distance wireless communication line,
Through the long-distance wireless communication line, image data related to the image captured by the camera is transmitted to the subunit,
The subunit that has received the image data displays an image based on the image data on the monitor screen,
The main unit and the subunit are operated in a security mode for monitoring the situation around the vehicle or inside the vehicle or the vehicle body by displaying an image around the vehicle or inside the vehicle imaged by the camera on the monitor screen,
Depending on the distance between the main unit and the subunit,
The parking assist mode and the security mode are automatically switched.

  A smart parking assist system according to a second aspect is the invention according to the first aspect, wherein the transmission means is provided in a key tag formed separately from a subunit main body of the subunit.

The smart parking assist system according to claim 3 is the invention according to claim 1, wherein the main unit is provided with an external recording medium,
The main control means is provided with recording means for recording and storing image data relating to an image captured by the camera in the security mode in the external recording medium.

  According to a fourth aspect of the present invention, there is provided the smart parking assist system according to the first aspect of the invention, wherein the camera is a back camera that faces the rear of the vehicle.

  According to a fifth aspect of the present invention, in the smart parking assist system according to the first aspect, the camera is a front camera that faces the front of the vehicle.

  According to a sixth aspect of the present invention, in the smart parking assist system according to the first aspect, the camera is a camera capable of photographing the entire interior of the vehicle.

The smart parking assist system according to claim 7 is the invention according to claim 1, wherein the smart parking assist system includes a detection unit having a sensor,
According to the detection signal output from the detection means,
When the main unit is in one of the parking assist mode and the security mode, the main unit performs a predetermined operation, respectively.

  According to an eighth aspect of the present invention, in the smart parking assist system according to the seventh aspect of the present invention, the sensor is a corner sensor that detects an obstacle in the vicinity of the corner of the vehicle body.

  According to a ninth aspect of the present invention, in the smart parking assist system according to the seventh aspect, the sensor is an infrared sensor that detects a heat source in the vehicle.

  According to a tenth aspect of the present invention, there is provided the smart parking assist system according to the seventh aspect, wherein the sensor is a field sensor that detects a moving object that has entered a predetermined range around the vehicle.

  According to an eleventh aspect of the present invention, in the smart parking assist system according to the seventh aspect, the sensor is a door sensor that detects opening and closing of the door of the vehicle body.

  A smart parking assist system according to a twelfth aspect is the invention according to the seventh aspect, wherein the sensor is an impact sensor that detects an impact applied to the vehicle body.

According to the smart parking assist system according to the present invention, a wireless communication line is selected from a short-distance wireless communication line or a long-distance wireless communication line depending on the distance between the main unit and the subunit. Depending on the selected wireless communication line, the main unit and sub-unit can reproduce and display the images captured by the camera such as the back camera with almost no delay, and confirm the rear when parked or stopped Parking assist mode that assists the driver's driving operation such as driving, or the security mode in which the image around the vehicle body, inside the vehicle body or the vehicle body is monitored by the sensor, and the captured image is transmitted from the main unit to the sub unit if there is an abnormality I did it.
This makes it possible to easily introduce a smart parking assist system that assists the driving operation of the driver during driving and acts as a security device during parking and stopping at a low cost.

It is a block diagram which shows the outline of a structure of the smart parking assist system which concerns on a present Example. It is a block diagram which shows the outline of the attachment position of the smart parking assist system which concerns on a present Example. It is a block diagram which shows the outline of a structure of the smart parking assist system which concerns on a present Example. It is a perspective view which shows the outline of a structure of the subunit main body of the smart parking assist system based on a present Example. It is a perspective view which shows the outline of a structure of the key tag of the smart parking assist system which concerns on a present Example. It is explanatory drawing which shows the relationship between the main unit of the smart parking assistance system which concerns on a present Example, and a key tag. It is explanatory drawing which shows an example of the image imaged with the back camera which the smart parking assist system which concerns on a present Example has. It is explanatory drawing which shows an example of the image imaged with the front camera which the smart parking assist system which concerns on a present Example has. It is explanatory drawing which shows an example of the image displayed on the monitor screen of the smart parking assist system which concerns on a present Example. It is a perspective view which shows the outline of a structure of the indoor camera of the smart parking assist system which concerns on a present Example. It is explanatory drawing which shows an example of the image imaged with the indoor camera which the smart parking assist system which concerns on a present Example has. It is explanatory drawing which shows the attachment position of the corner sensor which the smart parking assist system which concerns on a present Example has. It is a flowchart explaining the outline when the smart parking assist system according to the present embodiment operates in the parking assist mode. It is a flowchart figure explaining the outline when the smart parking assist system which concerns on a present Example operate | moves in security mode. It is a flowchart figure explaining the outline of operation | movement of the subunit main body of the smart parking assist system which concerns on a present Example.

  Embodiments of a smart parking assist system according to the present invention will be described with reference to the accompanying drawings. FIG. 1 is a configuration diagram showing an outline of a configuration of a smart parking assist system according to the present embodiment. FIG. 2 is a configuration diagram illustrating an outline of an attachment position when the smart parking assist system according to the present embodiment is mounted on a vehicle. FIG. 3 is a block diagram showing an outline of the configuration of the smart parking assist system according to the present embodiment.

As shown in FIG. 1, the smart parking assist system 10 includes a main unit 11 and a subunit 12, and a plurality of cameras 13 and sensors 14.
As shown in FIG. 2, the main unit 11 is installed in an inconspicuous place such as under the seat and the back of the dashboard. The subunit 12 includes a smartphone, a mobile phone, a tablet terminal device, or a similar mobile terminal device, and the mobile terminal device is installed on a dashboard or in the vicinity of a meter panel where a driver can easily see. The The camera 13 is attached to various parts of the vehicle body so that the lens is directed to the shooting range in accordance with the shooting range. FIG. 2 shows a back camera 70 provided near the upper corner of the rear license plate, a front camera 71 provided near the upper corner of the front license plate, and an indoor camera 72 provided near the rearview mirror. Is illustrated. Various sensors 14 are also attached to various parts of the vehicle body in accordance with each application.

  As shown in FIGS. 1 and 2, the main unit 11 and the subunit 12 are formed separately. The main unit 11 and the subunit 12 are connected to each other via a wireless communication line 15 so as to communicate with each other.

The wireless communication line 15 includes a short-range wireless communication line 16 and a long-range wireless communication line 17.
The short-range wireless communication line 16 is a communication line that connects the main unit 11 and the subunit 12 so that they can communicate wirelessly when the subunit 12 is within a predetermined communicable range centered on the main unit 11.
In the case of the present embodiment, the short-range wireless communication line 16 is a wireless communication line through which a signal compliant with the Bluetooth (registered trademark) standard is transmitted, and the radius is approximately 25 m around the main unit 11. The communication range with the unit 12 is set. The communication standard is not limited to Bluetooth (registered trademark), and the communicable range can be widened or narrowed by adjusting the wireless output of the main unit 11 or the subunit 12.

The long-distance wireless communication line 17 is a communication line that connects the main unit 11 and the subunit 12 so that they can communicate wirelessly when there is no subunit 12 within a predetermined communicable range centering on the main unit 11.
In the case of the present embodiment, the long-distance wireless communication line 17 is a so-called mobile phone line based on a 3G communication standard based on the CDMA system or a communication system based on the LTE (Long Term Evolution) standard. Note that the present invention is not limited to this, and a mobile phone line capable of higher speed communication may be used. By using a conventional cellular phone line, the introduction cost can be reduced.

  As shown in FIG. 3, the main unit 11 includes an image input unit 20, a sensor input unit 21, a communication unit 22, a power supply unit 23, and a control unit 24. Preferably, the audio input / output unit 25 includes a microphone 25a and a speaker 25b, and the remote control input unit 26 includes a remote-control light receiver 26a.

The image input unit 20 is formed such that image data relating to an image captured by the camera 13 is input from the camera 13. The image input unit 20 includes a decoder unit 27 that decodes image data input from the camera 13 and an encoder unit 28 that encodes the decoded image data into communication image data that conforms to a predetermined communication standard. . The communication image data encoded by the encoder means is output to the control unit 24, subjected to image processing to be described later, and transmitted to the subunit 12.
Thereby, it is possible to compress the large-capacity image data transmitted from the camera 13 and transmit it to the subunit.
Further, when a plurality of cameras 13 are additionally installed, the image data is once decoded by the decoder means 27 even when the image data standards relating to the images captured by the cameras 13 are different. Thereafter, the encoder means 28 can unify the communication image data in accordance with a predetermined communication standard. Accordingly, the camera 13 can be easily incorporated into the smart parking assist system 10 without worrying about the image data standard related to the image captured by the camera 13 attached later.

The sensor input unit 21 includes a detection unit 29 having a signal input terminal 29a to which a detection signal from the sensor 14 is input.
The detection unit 29 is configured to output a trigger signal to the control unit 24 based on the detection signal input from the sensor 14. The trigger signal is a signal for giving a trigger to the control unit 24 so that the control unit 24 causes the camera 13 and the audio output unit 25 to perform a predetermined operation as described later.

  The communication unit includes main bidirectional communication means 30 capable of bidirectional communication with each other via the subunit 12 and the wireless communication line 15. The main bidirectional communication unit 30 includes a main short-range communication unit 31 and a main long-distance communication unit 32, and is configured to be switchable. The switching of the communication means will be described later.

The main short-range communication means 31 is configured to be able to communicate with the subunit 12 wirelessly via the short-range wireless communication line 16.
The main short-range communication means 31 is configured to transmit communication image data captured by the camera 13 and encoded by the image input unit 20 to the subunit 12.
The main short-range communication means 31 is configured to be able to receive a distance determination signal transmitted from the subunit 12 in order to measure the distance between the main unit 11 and the subunit 12. While the distance determination signal can be received by the main short-range communication means 31, the control unit 24 determines that the subunit 12 is within the communicable range of the short-range wireless communication line 16 centered on the main unit 11. Is done. The determination of the distance between the main unit 11 and the subunit 12 will be described later.
Further, the main short-range communication means 31 is connected to the voice input / output unit 25. Therefore, the main short-range communication means 31 is formed so as to be able to transmit the audio signal input from the audio input / output unit 25 via the microphone 25a or the external microphone connected to the audio input terminal 25c to the subunit 12. The audio signal received from the external audio speaker connected to the speaker 15b or the audio output terminal 25d via the audio input / output unit 25 can be output. Thereby, when there is an incoming call to the mobile terminal device included in the subunit 12, it is possible to talk hands-free.

The main long-distance communication means 32 has a communication device 33, a card slot 34, and a clock 35.
The communication device 33 is formed so as to be connected to the subunit 12 through a long-distance wireless communication line 17, which is a mobile phone line, so as to be able to communicate wirelessly.
The card slot 34 is formed so that a SIM card can be inserted. A SIM (Subscriber Identity Module) card is an IC card in which contractor information for using a cellular phone line, which is a long-distance wireless communication line 17, is recorded, and a contractor (user) is identified based on the contractor information. Used to identify.
With the communication device 33 and the SIM card, the main unit 11 itself can be used as a mobile terminal, and long-distance wireless communication can be performed with the mobile terminal device included in the subunit 12 via the long-distance wireless communication line 17.

  The clock 35 is formed so as to be able to acquire time information from a time server on the Internet via the long-distance wireless communication line 17. The clock 35 can correct the clock in the main unit 11 based on the acquired time information. The clock 35 is formed so as to apply time information to the communication image data as a time stamp. Thereby, it is possible to record the accurate shooting time or transmission time in the image data captured by the camera 13 or the communication image data transmitted from the main unit 11 to the subunit 12.

The power supply unit 23 includes a main power input unit 36 that receives power from a battery power source of an automobile, a sub power input unit 37 that receives power from an accessory power source, an engine lock unit 38, and a room lamp lighting unit 39.
The main power input means 36 has a main power input terminal 36a connected to the battery power source of the automobile. The image input unit 20, the sensor input unit 21, the communication unit 22, the control unit 24, and the recording on the external recording medium 44 It is configured to supply power to the means.

The sub power input means 37 has a sub power input terminal 37a and a sub power output terminal 37b. The sub power supply input means 37 is configured to be able to supply the power input from the accessory power supply via the sub power input terminal 37a to the subunit main body 50 of the subunit 12 from the sub power output terminal 37b. Accordingly, the subunit main body 50 can be used without worrying about the battery running out. Further, since the auxiliary power input means 37 can supply power to the portable terminal device via the accessory power supply, it is possible to prevent the power from being supplied while the engine is stopped.
The sub power output terminal 37b according to the present embodiment is included in a USB connector that is standardized so that power can be supplied. However, the sub power output terminal 37b is not limited to a USB connector, and is a connector including a terminal that can supply power. I just need it.

  The engine lock means 38 is configured to output a starter cut signal for cutting a signal flowing to the starter of the engine through the signal output terminal 38a in accordance with the engine lock control signal input from the control unit 24. The starter cut signal can open and close a relay switch installed between the cell motor and the engine starter. When the relay switch is opened, the signal flowing from the cell motor to the engine starter is cut off, so that the engine lock means 38 can lock the engine of the vehicle and prevent the vehicle from being stolen.

  The room lamp lighting means 39 outputs a room lamp lighting signal via the signal output terminal 39a so that the room lamp in the vehicle blinks in a predetermined lighting pattern according to the room lamp control signal input from the control unit 24. It is formed as follows. As a result, the main unit 11 can blink the room lamp, threaten against the vandalism and the car theft, and prevent the car vandalism and the car theft. Further, by blinking the room lamp in a predetermined blinking pattern, it is possible to notify the surroundings that an impact has been applied to the vehicle body or that the vehicle has been tampered with.

The control unit 24 includes main control means 40 that controls image processing related to an image captured by the camera 13.
In the image processing, for example, shooting information including a time stamp or the like is added to communication image data input from the image input unit 20, noise is removed from an image based on the communication image data, or the image is a wide-angle image. Is a process of trimming an image having a predetermined angle of view.

  The main control means 40 is configured to control the operation of the camera 13 based on the trigger signal input from the sensor input unit 21. Thereby, when the sensor 14 detects the detection target and the detection signal is input to the control unit 24 via the sensor input unit 21, the control unit 24 can activate the camera 13 and take a picture.

  Further, the main control means 40 is based on the distance determination signal 41 input from the communication unit 22 and the distance determination means 41 for determining the distance between the main unit 11 and the subunit 12, and based on the determination result, Line selection means 42 for selecting one of the radio communication lines 15 of the distance radio communication line 16 and the long-distance radio communication line 17 is provided.

The distance determination unit 41 is configured to receive a distance determination signal transmitted from the subunit 12 and received by the main short-range communication unit 31.
When the subunit 12 is within a predetermined communicable range centered on the main unit 11, the main short-range communication means 31 continues to receive the distance determination signal while the distance determination signal is being input. Therefore, the distance determination unit 41 always receives a distance determination signal with a predetermined period.
At this time, the distance determination means 41 is determined to determine that the distance between the main unit 11 and the subunit 12 is equal to or less than a predetermined distance, and to output the result of the determination to the line selection means 42 as a determination correct signal. Has been.
When the distance determination signal cannot be received by the main short-range communication unit 31 and no distance determination signal is input to the distance determination unit 41, the distance determination unit 41 is located between the main unit 11 and the subunit 12. Is determined to have exceeded a predetermined distance, and the result of the determination is output to the line selection means 42 as a determination rejection signal.

The line selection unit 42 selects the short-range wireless communication line 16 based on the determination result of the distance determination unit 41 while the determination correct signal is input. When the determination rejection signal is input, the line selection unit 42 A line selection signal is output to the communication unit 22 so as to select the line 17.
Thereby, according to the distance between the main unit 11 and the subunit 12, more specifically, when the subunit 12 is separated from the vehicle by a predetermined distance or more, the wireless communication line 15 between the main unit 11 and the subunit 12 is obtained. And the communication method related to the wireless communication line 15 can be automatically changed.

Furthermore, when the distance determination means 41 is outputting a determination correct signal, the main control means 40 displays an image captured by the camera 13 on the monitor screen of the subunit main body 50 to assist the driver's driving operation. It is configured to control the camera 13 and sensor 14 of the main unit 11 and the communication unit 22 so as to operate in the mode.
On the other hand, when the distance determination unit 41 outputs a determination rejection signal, the main control unit 40 responds to the sensor 14 having a reaction and photographs the vicinity of the vehicle or the inside of the vehicle with a predetermined camera and parks and stops. The camera 13 and the sensor 14 of the main unit 11 and the communication unit 22 are controlled so as to operate in a security mode for monitoring the surroundings and the inside of the vehicle.
Thereby, the mode can be automatically switched according to the distance between the main unit 11 and the subunit 12.

The voice input / output unit 25 includes a microphone 25a and a speaker 25b. The audio input / output unit 25 has a microphone input terminal 25c in association with the microphone 25a, and has an audio output terminal 25d in association with the speaker 25b. The voice input / output unit 25 is connected to the main short-range communication unit 31.
As a result, an audio signal related to audio input from the microphone 25a or an external microphone connected to the microphone input terminal 25c can be transmitted to the subunit 12 via the short-range wireless communication line 16, and the speaker 25 or audio The external speaker via the output terminal 25d can output audio based on the audio signal transmitted from the subunit 12 via the short-range wireless communication line 16.
Therefore, when there is an incoming call to the mobile terminal device included in the subunit 12, it is possible to talk hands-free.

  Further, the main control means 40 may be provided with a sound source means for generating an alarm sound, an operation confirmation sound or similar sounds, and the generated sound may be output from the speaker 25b or the sound output terminal 25d. The audio output terminal 25d is formed so as to be connectable to an external speaker or an external audio input terminal of an in-vehicle audio system. When the audio output terminal 25d is connected to the in-vehicle audio system, the above-described call audio, alarm sound, and operation confirmation sound can be output from the in-vehicle audio system.

  The remote control input unit 26 has a remote control light receiver 26a. The remote control light receiver 26a is formed to receive an infrared signal from a remote control 26b formed separately from the main unit 11. The remote operation signal superimposed on the infrared signal is transmitted to the main control means 40, and the main unit 11 and the subunit 12 can be remotely operated based on the remote operation signal.

Further, preferably, an indicator lamp 43 may be provided in the main unit 11. The indicator lamp 43 is composed of a light emitting device such as an LED. The main control unit 40 includes a light emitting unit 44 that blinks the indicator lamp 43. The light emitting means 44 is formed to blink the indicator lamp 43 in a predetermined pattern corresponding to each operation state or operation mode based on the operation state or operation mode of the main unit 11.
Thereby, the user of the smart parking assist system 10 can check the operation of the main unit 11.

  Further, preferably, an external storage medium 45 may be provided in the main unit 11. The external storage medium 45 includes a hard disk drive, a flash memory, or a similar readable / writable storage medium. The external storage medium 45 is connected to recording means 46 included in the main control means 40. The recording unit 46 records the backup of the program related to the smart parking assist system 10 according to the present embodiment and the operation record of the program in the external storage medium 45 in an updatable manner, and temporarily records the image captured by the camera 13. It is formed to do. Thereby, even if the subunit 12 is damaged, it can be easily recovered. Further, by recording and saving an image in the external storage medium 45 separately from the image to be transmitted to the subunit main body 50 side in the security mode, a backup when transmission fails can be taken. Can be sent multiple times.

  The subunit 12 includes a subunit main body 50 and a key tag 51 formed separately from the subunit main body 50. The subunit main body 50 includes a smartphone, a mobile phone, a tablet terminal device, or a mobile terminal device similar to these.

As shown in FIG. 3, the subunit main body 50 includes a display unit 52, a communication unit 53, and a control unit 54.
Further, as shown in FIG. 4, the subunit main body 50 is fixed by a cradle 50a having a suction cup on the lower surface. As shown in FIG. 2, the subunit main body 50 fixed to the cradle 50a is formed to be attachable on the dashboard.
The attachment method is not limited to the cradle 50a, and it may be attached to an appropriate place on the vehicle body by a clip, a bracket or any other method.

  The display unit 52 includes display means 55 having a monitor screen 56. The display unit 55 captures an image based on the communication image data captured by the camera 13 and transmitted from the main unit 11 according to a control signal from the main control unit 40 of the main unit 11 in a predetermined display pattern on the monitor screen 56. It is formed to display.

The communication unit 53 includes sub bidirectional communication means 57 capable of bidirectionally communicating with each other via the main unit 11 and the wireless communication line 15. The sub bidirectional communication means 57 includes a sub short distance communication means 58 and a sub long distance communication means 59.
The sub short-range communication means 58 is formed to perform bidirectional communication with the main short-range communication means 31 of the main unit 11 via the short-range wireless communication line 16. Thereby, the subunit 12 can receive the communication image data from the main unit 11.
The sub long-distance communication unit 59 is formed to perform bidirectional communication with the main long-distance communication unit 32 of the main unit 11 via the long-distance wireless communication line 17. Further, the sub long-distance communication means 59 is formed so as to be able to realize a function as a mobile phone that the subunit main body 50 originally has. When the subunit main unit 50 is used as a mobile phone, an audio signal is transmitted / received to / from the main unit 11 via the sub short distance communication means 58 and a hands-free call is made using the voice input / output means 25. Can do. Thereby, the driving operation can be assisted so that the driver does not cause an accident except for the cause of an accident such as a side-view driving by using a mobile phone during driving.

Switching between the sub short distance communication means 58 and the sub long distance communication means 59 is performed by either the short distance wireless communication line 16 or the long distance wireless communication line 17 selected by the distance determination means 41 and the line selection means 42 of the main control means 40. This is performed following the start of communication from the main unit 11 via one of them.
Further, when the main unit 11 is activated, and the sub unit 12 is within the communicable range related to the distance determination signal of the main unit 11, the short-range wireless communication line 16, the main short-range communication means 31, and the sub-short-range communication The main unit 11 is configured to immediately respond to a distance determination signal transmitted from the subunit 12 via the means 58. As a result, the main unit 11 and the subunit 12 are automatically subjected to processing related to pairing, and the smart parking assist system 10 can be started up at high speed.

The control unit 54 includes sub-control means 60 that performs control to process an image based on the communication image data received via the communication unit 53 so that the image can be displayed on the monitor screen 56 of the display unit 52. The sub-control means 60 divides the monitor screen 56 into left and right according to the control signal from the main unit 11 received by the communication unit 53, for example, displays different images, or displays the image inside the vehicle and the image around the vehicle. An image is formed so as to be displayed effectively so as to be displayed alternately.
The sub-control means 60 may be distributed as application software that can be obtained by downloading through a mobile phone line or the Internet.

  As shown in FIG. 5, the key tag 51 includes a cylindrical key tag main body 65 and an annular key ring 66, and is formed so that it can be used like a key holder. Thereby, it can attach to the subunit main body 50 as a strap, and can be used as a key holder which attaches the key of a motor vehicle. Therefore, the driver can carry the key tag 51 with the key or subunit main body 50.

The key tag 51 has transmission means 67 for transmitting a distance determination signal in the key tag main body 65.
The transmission means 67 is configured to transmit a distance determination signal via the short-range wireless communication line 16.
The distance determination signal is a signal formed based on a communication standard based on the Bluetooth (registered trademark) standard, and is formed so as to be transmitted at a predetermined cycle. The intensity of the signal is adjusted to be reachable when the distance between the key tag 51 and the main unit 11 is about 25 m. The signal intensity can be adjusted to an arbitrary intensity by adjusting the output of the transmitting means 67.
When the distance determination signal is within the communicable range that can be received by the main short-range communication means 31 of the main unit 11, the short-range wireless communication line 16 is used, and parking assist that assists the driving operation of the driver. When the smart parking assist system 10 operates in the mode and is outside the communicable range, the long-distance wireless communication line 17 is used, and the smart parking assist system 10 is monitored in the security mode for monitoring the surroundings of the vehicle, the inside of the vehicle, or the state of the vehicle body. Can work.

Therefore, the mode can be automatically switched according to the distance between the key tag 51 carried with the driver and the automobile on which the main unit 11 is mounted.
That is, as shown in FIG. 6, when the driver approaches the communicable range of the distance determination signal with respect to the vehicle on which the main unit 11 is mounted, the parking assist mode can be automatically activated.
On the other hand, when the driver gets out of the vehicle and leaves the communicable range, the security mode can be automatically activated. As a result, forgetting to switch the mode can be prevented, and the smart parking assist system 10 can be easily used.

Further, since the key tag 51 is formed separately from the subunit main body 50, the battery consumption of the subunit main body 50 can be suppressed.
In the present embodiment, the transmission means 67 used for determining the distance between the main unit 11 and the subunit 12 is provided in the key tag 51 provided separately from the subunit main body 50. However, the present invention is not limited to this. Instead, the transmission means 67 may be provided in the subunit main body 50. In this case, the transmitting unit 67 may be distributed as application software that can be obtained by downloading through a mobile phone line or the Internet, as in the case of the sub-control unit.

The camera 13 is a digital camera having an image sensor that electronically converts captured images to form image data. Image data formed by the camera 13 is transmitted to the main unit 11 through a wired or wireless communication line. Since the smart parking assist system 10 according to the present embodiment includes a plurality of cameras 13, images captured by the cameras 13 arranged at various locations on the vehicle body are collected in the image input unit 20 of the main unit 11.
The camera 13 according to the present embodiment includes a back camera 70 capable of photographing the rear of the vehicle body, a front camera 71 capable of photographing the front of the vehicle body, and an indoor camera 72 capable of photographing the front from a position close to the vehicle interior and the viewpoint of the driver. Become.

  The rear camera 70 is attached to the rear of the vehicle body, preferably, in the vicinity of the number plate attachment portion or the trunk lid, as shown in FIG. The shooting range of the back camera 70 is preferably a blind spot behind the vehicle body when viewed from the driver's seat, as shown in FIG. Thereby, for example, when parked or stopped, the vehicle body can be aligned with the frame line of the parking lot, or the vehicle body can be put straight into the garage. Further, since rearward shooting is possible, it may be used as a drive recorder for shooting the rear of the vehicle body while traveling. As a result, it is possible to take a picture of the number of the rear vehicle when it is likely that a rear-end collision will occur from behind or when it is hit by a car behind it.

The front camera 71 is mounted in the vicinity of the lower front center of the vehicle body, preferably in the gap between the number plate mounting portion and the front grille as shown in FIG. As shown in FIG. 8, the photographing range of the front camera 71 is preferably a blind spot at the front lower part of the vehicle body when viewed from the driver's seat. Thereby, for example, the vehicle body can be parked and stopped at the limit of the stop line, and at the time of parallel parking, it is possible to approach or avoid the other vehicle or obstacle in front of the vehicle body. In addition, by widening the lens of the front camera 71 mounted at the forefront of the car body, it is possible to check the left and right safety when going out of the alley from the alley and to drive a vehicle that jumps out of the alley with poor visibility while driving It may be used as a recorder.
Images captured by the back camera 70 and the front camera 71 are output to the control unit 24 via the image input unit 20. The main control means 40 of the control unit 24 embeds time data in the communication image data relating to the input image, and performs image processing for synchronizing the images of the back camera 70 and the front camera 71 in time. Communication image data related to the image after the image processing is transmitted to the subunit main body 50 via the communication unit 22. On the monitor screen 56 of the sub unit main body 50, as shown in FIG. 9, the image of the back camera 70 and the image of the front camera 71 transmitted from the main unit 11 are displayed side by side. As a result, the driver can see the blind spots before and after the vehicle body.

The indoor camera 72 is attached to the ceiling of the vehicle body, preferably in the vicinity of the room mirror attaching portion as shown in FIG.
As shown in FIG. 10, the in-vehicle camera has a front lens 73 that is directed to the front of the vehicle body on one end surface of a cylindrical indoor camera 72 so that the angle can be adjusted. A room lens 74 directed to the interior of the vehicle is arranged so that the angle can be adjusted. An image captured on the front lens 73 side and an image captured on the room lens 74 side are collected in the main body of the indoor camera 72 and are transmitted to the main unit 11 from there. As a result, the in-vehicle camera 72 is formed so as to be able to photograph the front of the vehicle body and the interior of the vehicle as shown in FIG.
Preferably, a sub monitor 75 may be provided on the trunk of the body of the indoor camera 72 so that an image captured by the indoor camera 72 is reproduced and displayed.

The indoor camera 72 related to the front lens 73 can also be used as a drive recorder during traveling, and can take a picture of what is approaching the vehicle body when parked. On the other hand, the indoor camera 72 related to the room lens 74 can take an image of the interior of the vehicle when the vehicle is rough. In addition, since the left and right sides of the vehicle body and the rear of the vehicle body can be projected through the room lens 74, the behavior of other vehicles traveling around the own vehicle can be photographed when used as a drive recorder while traveling. Can do.
The type of the camera 13 according to the present embodiment is not limited to this. For example, a side camera that captures the side of the vehicle body is added to the left and right sides of the vehicle body, or an indoor camera 72 is added to the back. You may make it install so that the back and the room | chamber interior can be image | photographed from the window upper part.

The sensor 14 is configured to transmit a detection signal to the detection means 29 of the main unit 11 when a detection target is detected. In response to the detection signal, the detection unit 29 outputs a trigger signal to the main control unit 40. The main control means 40 is configured to control the camera 13, the speaker 25b of the audio input / output unit 25, and the indicator lamp 43 to perform predetermined operations in response to the trigger signal.
As shown in FIGS. 1 and 3, the sensor 14 includes a corner sensor 80, an infrared sensor 81, a field sensor 82, a door sensor 83, and an impact sensor 84.

The corner sensor 80 is the sensor 14 provided at the corner of the vehicle body. The corner sensor 80 is configured to detect an obstacle approaching the vehicle body during a driving operation and to detect an object approaching during parking. The corner sensor 80 provided on the front bumper is a front sensor, and the corner sensor 80 provided on the rear bumper is a back sensor.
As shown in FIG. 12, the corner sensor 80 is provided with a left front sensor 80a and a right front sensor 80b in the vicinity of the corner corner of the front bumper, respectively, and the rear bumper has a first left in the vicinity of the corner corner. A back sensor 80c, a second left back sensor 80d, a first right back sensor 80e, and a second right back sensor 80f are arranged.
By providing the two back sensors 80c and 80d on the left side of the corner of the rear bumper and the two back sensors 80e and 80f on the right side, it is possible to detect obstacles more sensitively when backing. .

  The infrared sensor 81 is the sensor 14 provided in the vicinity of the rearview mirror. The infrared sensor 81 is formed so as to detect a heat source in the vehicle. Thereby, it is possible to detect a moving object with heat such as a person or an animal that has entered the vehicle, and it is also possible to detect heat such as when it is ignited in the vehicle.

  The field sensor 82 is the sensor 14 disposed in the vicinity of the rearview mirror together with the infrared sensor 81. The field sensor 82 is formed so as to detect the movement of air in the vehicle. As a result, for example, when a window glass is broken or a door is illegally opened, and the air flow changes during parking, it can be detected.

  The door sensor 83 is a sensor 14 disposed at a position where the opening or closing of the door, the opening of the trunk, the hinge, or the like, for example, can be detected. Door sensor 83 is formed to detect the opening of the door.

  The impact sensor 84 is a sensor 14 that is formed to detect vibration and impact applied to the vehicle body. Thereby, it can be detected that the vandal on the vehicle breaks the window or that there has been a collision while parked.

  The smart parking assist system 10 having the above configuration operates as follows. The operation will be described with reference to the accompanying drawings.

  The smart parking assist system 10 is configured to switch modes depending on whether or not a driver is in the vehicle. This mode includes a parking assist mode for assisting the driver's driving operation by displaying an image around the vehicle captured by the camera 13 on the monitor screen 56 when the driver is in the vehicle, and a camera when the driver is not in the vehicle. 13 includes a security mode in which an image of the vehicle periphery or the vehicle imaged at 13 is transmitted to the subunit main body 50 at a remote location to monitor the vehicle periphery, the vehicle interior, or the vehicle body condition.

For switching the mode, a key tag 51 formed separately from the subunit main body 50 is used. As shown in FIG. 6, when the driver with the key tag 51 leaves the vehicle, it is determined that the driver is not in the vehicle and the security mode is activated, and the security mode is activated when the driver with the key tag 51 approaches the vehicle. Is automatically released and the parking assist mode is activated.
A switching method in which the smart parking assist system 10 automatically switches between the parking assist mode and the security mode according to the distance between the main unit 11 and the key tag 51 will be described below.

The transmission means 67 provided in the key tag 51 periodically transmits a distance determination signal that complies with the Bluetooth (registered trademark) standard. The distance determination signal periodically transmitted from the key tag 51 is a signal that can be received by the main short-range communication means 31 of the main unit 11. The main short-range communication unit 31 that has received the distance determination signal outputs the distance determination signal to the distance determination unit 41.
The distance determination means 41 to which the distance determination signal is input determines that the key tag 51 is within the communicable range of the short-range wireless communication line 16 centering on the main unit 11 and outputs a determination correct signal to the line selection means 42. To do.
The line selection means 42 to which the determination signal is input outputs a line selection signal for selecting the short-range wireless communication line 16 to the communication unit 22. The communication unit 22 to which the line selection signal is input starts short-range wireless communication with the communication unit 53 of the subunit 12 via the short-range wireless communication line 16.
Further, the main control means 40 is configured to set the mode in which the smart parking assist system 10, in particular, the main unit 11 and the subunit 12 operate, to the parking assist mode according to the line selection signal related to the short-range wireless communication line 16. Has been.

On the other hand, when the main near field communication unit 31 cannot receive the distance determination signal, the main near field communication unit 31 cannot output the distance determination signal to the distance determination unit 41.
The distance determination means 41 that has stopped inputting the distance determination signal determines that the key tag 51 is not within the communicable range of the short-range wireless communication line 16 centering on the main unit 11, and determines the determination rejection signal as the line selection means 42. Output to.
The line selection unit 42 to which the determination rejection signal is input outputs a line selection signal for selecting the long-distance wireless communication line 17 to the communication unit 22. The communication unit 22 to which the line selection signal is input starts long-distance wireless communication with the communication unit 53 of the subunit 12 via the long-distance wireless communication line 17.
The main control means 40 switches the mode in which the smart parking assist system 10, in particular, the main unit 11 and the subunit 12 operate, from the parking assist mode to the security mode according to the line selection signal related to the long-distance wireless communication line 17. Is formed.
Thus, when the key tag 51 approaches or leaves the main unit 11, the parking assist mode and the security mode are automatically switched according to the distance between the main unit 11 and the key tag 51.

  Next, the operation in each mode will be described with reference to the attached drawings. FIG. 13 is a chart for explaining the operation of the back camera 70 and the front camera 71 in the parking assist mode.

  Step 100 is a step of performing a process of starting the engine. In response to this, the main unit 11 of the smart parking assist system 10 connected to the battery power supply is activated. At this time, the communication unit 22 is formed so that the main short-range communication means 31 is activated. After the main short-range communication means 31 is activated, the routine proceeds to step 105.

  Step 105 is a step in which the main short-range communication means 31 performs a process of starting bidirectional communication with the sub short-range communication means 58 of the subunit main body 50 via the short-range wireless communication line 16. In step 105, a response signal to the distance determination signal is output from the main short-range communication means 31 to the sub short-range communication means 58, and automatically between the main unit 11 and the sub-unit body 50 registered in advance. A pairing process is performed. Thereby, the main unit 11 can recognize the subunit main body 50. After pairing is completed, the process proceeds to step 110.

Step 110 is a step of performing processing for determining the presence or absence of an interrupt request signal that requests to forcibly transmit an image. The interrupt request signal is sent from the main unit 11 when the application software related to the smart parking assist system 10 installed in the subunit main body 50 is activated or when a manual input operation is performed from the remote control 26b or the subunit main body 50. It is configured to be transmitted from the subunit main body 50 or the remote controller 26b to the main unit 11 so as to forcibly interrupt transmission / reception of signals related to normal image transmission processing to be performed.
When the interrupt request signal is normally transmitted and received, and the requested image is displayed on the subunit main body 50, the main unit 11 and the subunit main body 50 are normally connected via the short-range wireless communication line 16, It can be confirmed whether the smart parking assist system 10 is operating normally.
Here, it is asked whether or not there is an interrupt request signal. If there is no interrupt request signal, the process proceeds to step 115, and if there is, the process proceeds to step 155 for performing an interrupt process. This step 155 will be described later.

Step 115 is a step of performing a process of determining the presence or absence of a reaction of the corner sensor 80 in the sensor 14. The case where there is a reaction is when a detection signal from one of the corner sensors 80 is input to the detection means 29 of the sensor input unit 21. The sensor input unit 21 then proceeds to step 120 and the subsequent steps, and it is determined which of the front sensors 80a and 80b or the back sensors 80c, 80d, 80e, and 80f the detection signal is output from.
If it is determined that there is no reaction, the process proceeds to step 150.

Step 120 is a step of performing processing for confirming whether the sensor 14 having a feeling is the front sensors 80a and 80b. When the sensor input unit 21 determines that the detection signal input to the detection unit 29 is a reaction from the front sensors 80a and 80b, the sensor input unit 21 proceeds to step 125 and relates to the trigger signal output from the sensor input unit 21. A flag indicating that the front sensors 80a and 80b have a feeling is set in the trigger data.
If it cannot be confirmed whether the front sensors 80a and 80b are used, the process proceeds to step 140.

Step 125 is a step of performing processing for confirming whether the sensor 14 having a feeling is the back sensors 80c, 80d, 80e, and 80f following the front sensors 80a and 80b. When it is confirmed that the back sensors 80c, 80d, 80e, and 80f are detected, the process proceeds to step 130, and in addition to a flag indicating that the front sensors 80a and 80b are sensitive, a trigger signal output from the sensor input unit 21 A flag indicating that the back sensors 80c, 80d, 80e, and 80f have a feeling is set in the trigger data according to the above.
If the back sensors 80c, 80d, 80e, and 80f cannot be confirmed, the process proceeds to step 135.

In step 130, a trigger signal based on trigger data having a flag related to the front sensors 80a and 80b and a flag related to the back sensors 80c, 80d, 80e, and 80f is output to the control unit 24. 70 is a step of performing processing for controlling the front camera 70 and the front camera 71 for photographing.
The captured image is transmitted from the short-range communication means 31 of the main unit 11 to the subunit main body 50 via the short-range wireless communication line 16. As shown in the figure, the image transmitted to the subunit main body 50 includes an image from the front camera 71 and an image from the back camera 70 and is displayed on the monitor screen 56 of the display unit 52 of the subunit main body 50. . Thereby, both the image from the front camera 71 and the image from the back camera 70 can be displayed on the subunit main body 50.
At this time, the display means 52 displays the image from the front camera 71 and the image from the back camera 70 side by side, or periodically switches and displays the images on the front side and the back side. Alternatively, the image transmitted from the main unit 11 is displayed by an arbitrary display method such as displaying the back side image or the front side image so as to overlap a part of the back side image. Further, the image may be switched automatically, or may be switched manually so that either the front side image or the back side image is mainly displayed.
As described above, when the front sensors 80a and 80b and the back sensors 80c, 80d, 80e, and 80f react together in the parking assist mode and both images from the front camera 71 and the back camera 70 are displayed, When driving operation like parallel parking is considered.

Step 135 is a step in which a trigger signal based on trigger data having flags relating to the front sensors 80a and 80b is output to the control unit 24, and the control unit 24 controls the front camera 71 to perform photographing.
The captured image is transmitted from the short-range communication means 31 of the main unit 11 to the subunit main body 50 via the short-range wireless communication line 16. The image transmitted to the subunit main body 50 is composed of an image from the front camera 71 as shown in the figure, and is displayed on the monitor screen 56 of the display unit 52 of the subunit main body 50. Thereby, the image from the front camera 71 can be displayed on the subunit main body 50.
Thus, when the front sensors 80a and 80b react and the image of the front camera 71 is displayed in the parking assist mode, for example, the blind spots at the front lower part of the left and right corners of the front bumper are displayed on the front sensors 80a and 80b. It can be considered that when the road shoulder in the road reacts, the driving operation is performed such that the road shoulder is narrowed down and passed.

In step 120, when it is not possible to confirm whether the front sensors 80a and 80b are detected or not, in step 140, as in step 125, the sensor 14 having the feeling is the back sensors 80c, 80d, 80e, and 80f. This is a step for performing processing to confirm whether or not there is.
If the back sensors 80c, 80d, 80e, 80f can be confirmed, the process proceeds to step 145 and the trigger data related to the trigger signal output from the sensor input unit 21 is added to the back sensors 80c, 80d, 80e, 80f. Is flagged as having a feeling.
If the back sensors 80c, 80d, 80e, and 80f cannot be confirmed, the process proceeds to step 150.

In step 145, a trigger signal based on trigger data having flags relating to the back sensors 80c, 80d, 80e, and 80f is output to the control unit 24, and the control unit 24 performs processing for controlling the back camera 70 to perform photographing. It is a step.
The captured image is transmitted from the short-range communication means 31 of the main unit 11 to the subunit main body 50 via the short-range wireless communication line 16. As shown in the figure, the image transmitted to the subunit main body 50 is an image from the back camera 70 and is displayed on the monitor screen 56 of the display unit 52 of the subunit main body 50. Thereby, the image from the back camera 70 can be displayed on the subunit main body 50.
As described above, when only the back sensor 70 reacts and the image of the back camera 70 is displayed in the parking assist mode, for example, it is considered that a driving operation is performed such as backing up when entering a garage or parking. It is done.

After performing processing for transmitting an image from the main unit 11 to the subunit main body 50 via the short-range wireless communication line 16 in step 130, step 135, and step 145, the process returns to step 110 to return to the main power source 36. As long as the engine is supplied, that is, as long as the engine is running, it is configured to repeat.
Thus, in the parking assist mode, an image from the front camera 71 or the back camera 70 is transferred from the main unit 11 via the short-range wireless communication line 16, for example, Bluetooth (registered trademark) as in this embodiment. Thus, it can be transmitted to the subunit main body 50 and reproduced and displayed on the monitor screen 56 of the subunit main body 50.
Note that the playback display is preferably so-called video playback in which images captured by the camera 13 are continuously displayed at 30 frames per second. However, the playback display is not limited to this. For example, only when an obstacle is detected. Alternatively, several frames taken may be frame-by-frame played back, or the image that is closest to the obstacle may be displayed as a still image.

If there is no response from the corner sensor 80, and if any corner sensor 80 of the corner sensors 80 has been sensed but has not been confirmed, both of them are step 150. Migrate to
Step 150 is a step of processing to transmit an image captured by the back camera 70 from the main unit 11 to the subunit main body 50 via the short-range wireless communication line 16.
However, in the back camera 70, since the back sensors 80c, 80d, 80e, and 80f do not react, no image is actually taken. For example, data relating to a screen such as a blue screen is transmitted, and the display means 55 Processed to display in the background.
Thereby, on the monitor screen 56 of the subunit main body 50, for example, a map screen in the middle of car navigation can be displayed, while the corner sensor 80, the back camera 70, and the front camera 71 are put on standby in the background. I can leave. Therefore, when any of the corner sensors 80 detects an obstacle, an image can be transmitted quickly.

Next, the interrupt process will be described.
Step 155 is a step for shifting to the case where there is an interrupt request signal in Step 110, and images captured by the back camera 70 and the front camera 71 are transmitted from the main unit 11 via the short-range wireless communication line 16. A process for forcibly transmitting to the subunit main body 50 is performed.
The image displayed on the subunit main body 50 is displayed on the monitor screen 56 by the display means 55 as in the case of step 130. After the processing, the process proceeds to step 160.

Step 160 is a step for confirming whether or not the interrupt request signal has stopped.
When the interrupt request signal is stopped, the process proceeds to step 110, where it is determined whether or not there is a next interrupt request signal, and the process returns to the normal route that waits for the presence or absence of a reaction from the corner sensor 80.
If the interrupt request signal continues, the process returns to step 155 and is repeated until the interrupt request signal stops. Thereby, the subunit main body 50 can continuously reproduce and display the images captured by the back camera 70 and the front camera 71 in accordance with the interrupt request signal.

  In the parking assist mode, when at least one of the corner sensors 80 has a feeling and the control unit 24 outputs a trigger signal based on the detection signal, the trigger signal is input to the voice input / output unit 25. The alarm sound may be output from the speaker 25b or the audio output terminal 25d. For example, this can alert the driver when there is a risk of a rear-end collision while driving, or alert the driver when they are about to hit an obstacle in the blind spot behind the vehicle. .

The above is the operation in the parking assist mode of the smart parking assist system 10 in the present embodiment.
Next, a security mode that is switched when the key tag 51 is separated from the main unit 11 by a predetermined distance or more will be described with reference to the attached drawings. FIG. 14 is a chart for explaining the operation of each sensor 14 and camera 13 in the security mode.

  Step 200 is a step of performing a process of temporarily starting the security mode. When the key tag 51 is separated from the main unit 11 by a predetermined distance, approximately 25 m in this embodiment, a process of automatically switching from the parking assist mode to the security mode is performed. When this switching process is performed, the main communication unit 22 of the main unit 11 selects the long-distance communication means 32 that uses the long-distance wireless communication line 17.

Step 205 is a step in which a process for stopping the transition to the next process is performed for a predetermined time. Hereinafter, the step 205 is referred to as a first standby step. By providing the first standby step, it can be confirmed whether or not the key tag 51 temporarily goes out of the communicable range of the near field communication means 31 of the main unit 11. The predetermined waiting time for the first standby step can be arbitrarily set. In this embodiment, the waiting time is set to 30 seconds.
When the distance determination signal transmitted from the key tag 51 during the standby time can be received again by the short-range communication means 31, the temporarily activated security mode is canceled and the parking assist mode is returned again.
Thus, even if the vehicle is stopped within the reach of the driver, even if the driver temporarily leaves the vehicle outside the communicable range of the short-range communication means 31, the security mode is frequently It is possible to prevent automatic switching to
On the other hand, when the distance determination signal cannot be received again within the waiting time, the security mode that has been temporarily activated is configured to be fully activated. The processing related to the main activation is performed by the processing from step 210 onward.

Step 210 is a step for performing a process of locking the engine. By the process of step 210, the main control means 40 outputs an engine lock control signal to control the engine lock means 38 of the power supply unit 23.
The engine lock control signal indicates that the engine lock condition is that when the predetermined standby time has elapsed in the first standby step 205, the security mode that has been activated is fully activated and the parking assist mode is completely switched to the security mode. It is a signal that is output when it is satisfied.
The engine lock means 38 is configured to output a starter cut signal to a relay switch provided in the vicinity of the engine starter based on the engine lock control signal. When the starter cut signal turns off the relay switch, the engine starter is cut and the engine is locked.
After the engine lock process in step 210, the security mode shifts to the standby state. Simultaneously with the transition to the standby state, the process of step 215 is performed. Step 215 is a step of performing a process of notifying that the indicator lamp 43 is in a standby state by blinking the LED of the indicator lamp 43.

Step 220 is a step of performing a process of determining whether or not the security mode is continuing.
If the security mode continues, the process proceeds to step 225.
When the security mode is canceled, the process proceeds to step 270. This step 270 will be described later.

Step 225 is a step of performing a process of determining whether or not at least one of the sensors 14 included in the smart parking assist system 10 has reacted.
If there is a reaction, the process proceeds to step 230.
If there is no response, the process returns to step 220, and a process of maintaining the security mode is performed until any sensor 14 responds.

Step 230 and step 235 following step 230 are steps for performing a process of confirming whether the reaction of the sensor 14 is temporary or continuous, with a predetermined time interval.
Step 230 is a step of performing a process of waiting for a predetermined time, and is hereinafter referred to as a second standby step. The waiting time for the second standby step can be arbitrarily set. In this embodiment, the waiting time is set to 10 seconds. Thereby, for example, a malfunction of the sensor 14 such as a passing person or animal entering the detection range of the corner sensor 80 or the impact sensor 84 reacting when the vehicle body is shaken by the wind. Can be prevented.

Step 235 is a step of performing a process of confirming whether the response of the sensor 14 is continuous through the second standby step. After 10 seconds in the second standby step 230, if at least one sensor 14 still has a reaction, the process proceeds to step 240 to cancel the standby state.
When the response of the sensor 14 has disappeared after a predetermined waiting time has elapsed, a process of returning to step 220 is performed, and a process of maintaining the security mode is performed until there is a response of any sensor 14.
Here, in the present embodiment, it is not detected whether the sensor 14 has been responding all the time while waiting in the second standby step 230 or whether the response of the sensor 14 is intermittently interrupted. However, the present invention is not limited to this, and the standby state may be canceled in step 235 only when continuous detection is performed within a predetermined standby time.

Step 240 is a step of performing processing for warning an intruder. In the present embodiment, this warning process is performed by the loop lamp lighting means 39 to intimidate the intruder by blinking the room lamp in a predetermined blinking pattern. Note that the room lamp may be kept on without blinking the room lamp in a predetermined blinking pattern.
In the warning process, an alarm sound or a warning message is output from the speaker 25b or the audio output terminal 25d of the audio input / output unit 25, and the alarm sound or the warning message is played from the speaker 25b or an external speaker of the vehicle-mounted audio. Also good. After the warning process is performed, the room light lighting means 39 keeps the room lamp on and proceeds to step 245.

  Step 245 is a step of performing a process of waiting for a predetermined time in order to confirm the effect of the warning process of Step 240, and is hereinafter referred to as a third standby step. The waiting time in the third standby step can be arbitrarily set. In this embodiment, the standby time is set to 1 second. After the waiting time is over, the process proceeds to the next step 250.

  Step 250 is a step of performing processing for starting and photographing any one of the cameras 13 included in the smart parking assist system 10. Whether at least one of the back camera 70, the front camera 71, and the indoor camera 72 among the plurality of cameras 13 is activated depends on which sensor 14 of the sensed sensors 14 has detected. Associated.

The camera 13 and the sensor 14 in the security mode, for example, when the corner sensor 80 of the corner sensors 80 detects an obstacle, or the impact sensor 84 detects an impact applied to the vehicle body. When the back camera 70 or the front camera 71 is activated, the detection range is detected when the infrared sensor 81 or the field sensor 82 directed in the vehicle reacts or when the door sensor 83 detects the opening of the door. When it is associated, the indoor camera 72 is activated.
In step 250, all the cameras 13 may be activated and photographed.

The shooting process of step 250 is a process of shooting at least one still image. Preferably, a plurality of still images may be taken continuously.
In this embodiment, a shutter sound is output from the speaker 25b or the audio output terminal 25d of the audio input / output unit 25 simultaneously with the photographing process. Thereby, the intruder can be threatened, and further damage can be prevented by noticing that the intruder has taken the picture.
Further, in the present embodiment, a still image is taken. However, for example, a camera may be activated when an intruder is detected by at least one sensor in step 225 to take a moving image. The moving image shooting may be a time-lapse image in which frames shot every few seconds are dropped, or a normal moving image with continuous frames. When the photographing process is finished, the routine proceeds to step 255.

Step 255 is a step of performing processing for transmitting the captured image to the subunit main body 50 from the long-distance communication means 32 of the main unit 11 via the long-distance wireless communication line 17. By immediately transmitting the image photographed in step 250 to the subunit main body 50, it is possible to notify the driver who is away from the vehicle that the vehicle has been roughed or hit away.
In this embodiment, the long-distance communication means 32 transmits a still image or a frame drop image according to the line capacity of the mobile phone line used as the long-distance wireless communication line 17 or a compressed moving image. However, the present invention is not limited to this, and if the long-distance wireless communication line 17 is not burdened, a high-definition high definition (HD) video is transmitted for a long time. May be.

In this way, by immediately transmitting the captured image to the subunit main body 50 side, for example, even when an intruder destroys or removes the main unit 11 or the camera 13, the face and appearance of the criminal Etc. can be recorded.
Further, the image may be transmitted to the subunit main body 50 and the photographed image may be recorded on an external recording medium provided in the main unit 11.
Thereby, since the record which image | photographed the crime scene is preserve | saved in both the subunit main body 50 and the main unit 11, the tampering of imaging | photography time and an image can be prevented. After the process of transmitting the image to the subunit main body 50 is performed, the process proceeds to step 260.

  Step 260 is a step of performing a process of turning off the room light, and a subsequent step 265 is a step of performing a process of waiting for a predetermined time. Step 265 is hereinafter referred to as a fourth standby step. The waiting time of the fourth standby step can be arbitrarily set. In this embodiment, the waiting time is set to 30 seconds. After a predetermined waiting time has elapsed, the process returns to step 235 to confirm the continuity of the response of the sensor 14. If there is no response to the sensor 14 in step 235, the process returns to step 220 for confirming whether the standby state is maintained or not.

When the standby state is confirmed in step 220, if the standby state is released, the process proceeds to step 270.
Here, the standby state is released when the driver having the key tag 51 approaches the vehicle body and a distance determination signal transmitted from the key tag 51 is received by the short-range communication means 31 of the main unit 11. . At substantially the same time as the short distance communication means 31 receives the distance determination signal, the communication unit 22 performs a process of switching the communication means from the long distance communication means 32 to the short distance communication means 31.
Step 270 is a step of performing a process of turning off the LED of the indicator lamp 43, and in a subsequent step 275, a process is performed in which the engine lock means 38 connects the starter relay to release the engine lock. As a result, the security mode is canceled. Then, at step 280, for example, when the engine is started, the parking assist mode shown in FIG. 13 is activated.

The above is the operation on the main unit 11 side of the smart parking assist system 10.
Next, the operation of the subunit main body 50 will be described with reference to the attached drawings. FIG. 15 is a chart showing an operation state of application software installed in the subunit main body 50.

The subunit main body 50 includes a smartphone, a mobile phone, a tablet terminal device, or a similar mobile terminal device. In particular, in the present embodiment, a smartphone or a tablet terminal device is assumed.
These portable terminal devices can perform predetermined operations by installing application software. The application software is installed by downloading via the long-distance wireless communication line 17 or the Internet line, or the program recorded in the optical recording medium or the flash memory is installed via a personal computer, or directly in the portable terminal device. It is formed so as to be recorded and stored in the subunit main body 50 by installing through the card slot.

  After the application is installed, an initial setting for pairing for registering the subunit main body 50 in the main unit 11 is performed. In the initial setting, in the short-range communication unit 31 and the sub short-range communication unit 58, processing for associating each other is performed by a program compliant with the Bluetooth (registered trademark) standard. When meeting the communication means 59, a process of registering the mobile phone number recorded in the SIM card of the main unit 11 and the mobile phone number of the subunit main body 50 is performed. The association process and the registration process are configured to be performed manually or automatically.

  It is preferable that the installed application software is always kept executable and executable as software resident in the background of the subunit main body 50. By using the resident software, when either the parking assist mode or the security mode is activated, it is possible to quickly respond. Next, the operation of the application software will be described.

  Step 300 and step 305 following step 300 are steps for starting the application installed as described above. As a result of the activation process, the activation screen is displayed on the monitor screen 56 of the subunit main body 50 for a predetermined period of time while the application software is started up.

Step 310 is a step of performing processing for confirming whether or not the short-range wireless communication line 16 between the subunit main body 50 and the main unit 11 is opened.
If the short-range wireless communication line 16 is open, the process proceeds to step 315.
If the short-range wireless communication line 16 is not open, the process proceeds to step 385. Step 385 will be described later.

Step 315 is a step of performing processing for displaying a menu screen related to the activated application software on the monitor screen 56.
In step 320 following step 315, processing for confirming again whether or not the short-range wireless communication line 16 between the subunit main body 50 and the main unit 11 is opened is performed. Thereby, it can be confirmed whether the communication state between the subunit main body 50 and the main unit 11 is good.
If the short-range wireless communication line 16 is open, the process proceeds to step 325.
If the short-range wireless communication line 16 is not open, the process proceeds to step 385.

Step 325 is a step of performing a process of transmitting an interrupt request signal from the subunit main body 50 to the main unit 11 or a process of inputting an interrupt request signal from the remote control 26 b to the remote control input / output unit 26 of the main unit 11. . As a result, as described above with reference to FIG. 13, it is possible to perform interrupt processing by manual input of the subunit main body 50 or the remote controller 26b. When the subunit main body 50 responds to the interrupt request signal and transmits a response signal to the main unit 11, an image captured from the main unit 11 is transmitted.
An interrupt request signal is normally transmitted and received between the main unit 11 and the subunit main body 50 via the short-range wireless communication line 16, and an image is transmitted from the main unit 11 to the subunit main body 50 and displayed on the monitor screen 56. In this case, it can be confirmed that the smart parking assist system 10 is operating normally.
In addition, since the interrupt request signal can be transmitted automatically or manually, the connection status of the short-range wireless communication line 16 is automatically confirmed when the application is started up, and the short-range wireless communication line 16 is defective during use. In such a case, the connection status of the short-range wireless communication line 16 can also be confirmed manually.

Step 330 is a step in which a communication image signal related to the communication image data transmitted by the main unit 11 is received by the subunit main body 50 and an image based on the communication image data is displayed on the monitor screen 56. The monitor screen 56 is formed so that images captured by the back camera 70 and the front camera 71 are displayed. The display method of the display image is the same as that in steps 130 and 155 shown in FIG.
By performing such interrupt processing, in addition to visually confirming whether or not the short-range wireless communication line 16 between the sub unit main body 50 and the main unit 11 is normally connected, it is manually forced. The captured image can be displayed.
In addition, instead of images from both the front camera 71 and the back camera 70, only the front camera 71 or only the back camera 70 may be displayed, or an image captured by the indoor camera 72 may be displayed.

In step 320, in step 320, it is determined whether or not the subunit main body 50 has normally received an image from the main unit 11 via the short-range wireless communication line 16, that is, whether or not the smart parking assist system 10 is operating normally. After checking, if the image can be received normally, the process proceeds to the next process without waiting, and if the image cannot be received normally, the process related to the selection of waiting until the image can be received normally is performed. is there.
If the image can be normally received and the apparatus does not stand by, the image captured by the back camera 70 and the front camera 71 is displayed on the monitor screen 56 as it is, and the process proceeds to step 340.
If there is a problem with the reception of the image and the apparatus waits, the process returns to step 330 and waits so that the next image or the updated image transmitted from the main unit 11 can be received.
If the image can be received normally, the process proceeds to the next step without waiting, but if the image cannot be received normally and is waiting, the time is counted by the clock 35 of the main unit 11, When the image cannot be normally received within the predetermined time, the process may return to step 300 and restart.

Step 340 is a step of performing processing for stopping the interrupt request signal. When the sub unit main body 50 and the main unit 11 are normally connected via the short-range wireless communication line 16 and an image from the main unit 11 is normally received and can be displayed on the monitor screen 56 of the sub unit main body 50, the smart unit The parking assist system 10 is determined to be operating normally, and the interrupt request signal from the subunit main body 50 or the remote control 26b is stopped. Thus, the step of forcibly displaying the image captured by the camera 13 on the monitor screen 56 and confirming whether the smart parking assist system 10 is operating normally ends.
After the interrupt request signal stops, the process proceeds to step 345.

Step 345 is a step for performing a process of transferring the activated application software from the desktop to the background. Thereby, while the power of the subunit main body 50 is turned on, the application software can be made resident so that it can respond immediately when the communication image signal from the main unit 11 is received. After the transition process is completed, the application software shifts to a standby mode in which the subunit main body 50 waits for a communication image signal from the main unit 11.
Next, the standby mode will be described.

Step 350 is a step of performing processing for determining whether or not the application software is operating. If it is operating normally, the process proceeds to step 355.
On the other hand, if the subunit main body 50 or application software is defective and the application software is not operating normally, the subunit main body 50 or application software is restarted.
When the subunit main unit 50 or the application software is restarted, the resident state of the application software is released, and the short-range wireless communication line 16 between the subunit main unit 50 and the main unit 11 is also disconnected. Therefore, the process returns to step 310 to restart the application software and reconnect the short-range wireless communication line 16.

Step 355 is a step of performing processing for confirming whether or not the short-range wireless communication line 16 is maintained in a normal connection state after confirming that the application software is operating normally.
If the connection state is maintained, the process proceeds to step 360.
If the connection state is not maintained and the short-range wireless communication line 16 is disconnected, the process proceeds to step 385.

Step 360 is a step of performing processing for confirming whether or not the subunit main body 50 has received a communication image signal related to communication image data from the main unit 11.
If confirmed, the process proceeds to step 365.
If it cannot be confirmed, the process returns to step 350, and the operation status of the application software is repeatedly confirmed, and it is configured to wait until a communication image signal is received.

  Step 365 is a step of performing a process of starting application software that has already been activated and resides in the background on the monitor screen 56 of the subunit main body 50. As a result, the application software is displayed in the foreground, and preparation for displaying an image based on the communication image data on the monitor screen 56 is completed. When the application software starts up on the monitor screen 56, the process proceeds to step 370.

  Step 370 is a step of performing processing for displaying an image based on the communication image data transmitted from the main unit 11 on the monitor screen 56. Accordingly, an image captured by the front camera 71 or the back camera 70 can be displayed on the monitor screen 56 under the parking assist mode. The display method for displaying the image on the monitor screen 56 is not shown because it is shown in FIG.

Step 375 is a step of performing a process of determining whether or not the communication image data transmission from the main unit 11 has been completed.
When the transmission of the communication image data is completed, the process proceeds to step 380 following step 375, and processing for returning the application software to the background resident state is performed.
If the transmission of the communication image data has not ended, the process returns to step 370, and the process of displaying an image on the monitor screen 56 is repeated until the transmission of the communication image data ends.
After the application software is returned to the background of the subunit main body 50 in step 380, the process returns to step 350 and is held in the standby mode as software resident in the background of the subunit main body 50.

  In step 385, when the application software malfunctions in step 350 and restarts, and in steps 310, 320, and 355, the short-range wireless communication line 16 between the subunit main body 50 and the main unit 11 is disconnected. In this step, an error message is displayed on the monitor screen 56, and a recovery process is performed in which the application software is restarted or the short-range wireless communication line 16 is reconnected. As a result, the user can know the cause of the error. After performing the recovery process in step 385, the process proceeds to step 310, and is repeated from the start of the application software to step 350 related to the standby mode.

According to the smart parking assist system 10 described above, the driver can carry the key tag 51 provided separately from the subunit main body 50, so that the parking assist mode and the security mode can be automatically switched.
Thereby, the smart parking assist system 10 that assists the driving operation of the driver during driving and works as a security device during parking and stopping can be easily and inexpensively introduced.
Further, by providing the key tag 51 separately, the smart parking assist system 10 can be easily introduced without separately providing a sensor or the like for measuring the distance from the main unit 11 in the subunit main body 50 formed of the portable terminal device. be able to.

In the smart parking assist system 10, the subunit main body 50 is diverted to a smartphone, a mobile phone, a tablet-type terminal device, or a similar mobile terminal device. Thereby, there is no need to attach a new monitor to the vehicle body, the introduction cost can be reduced, and the labor of the attaching process can be saved.
The main unit 11 and the subunit main body 50 are connected via a short-range wireless communication line 16 compliant with the Bluetooth (registered trademark) standard in the parking assist mode that supports the driving operation of the driver. Accordingly, the subunit main body 50 can be easily attached to the vehicle body in association with the main unit 11 without performing special wiring work when the subunit main body 50 is mounted on the vehicle.
According to the present embodiment, the main unit 11 and the subunit main body 50 are connected by a communication method compliant with the Bluetooth (registered trademark) standard. For example, an existing in-vehicle audio system or car navigation system is used. In the case of supporting the Bluetooth (registered trademark), a monitor included in the in-vehicle audio system or the car navigation system can be used. In this case, the captured image may be recorded in an external storage medium of the in-vehicle audio system or the car navigation system in the security mode.

Further, according to the smart parking assist system 10 of the present embodiment, in the parking assist mode, the main unit 11 captures an image captured by the front camera 71 when the front sensors 80a and 80b among the corner sensors 80 react. When the back sensors 80c, 80d, 80e, and 80f react, images captured by the back camera 70 are displayed. When both the front sensors 80a and 80b and the back sensors 80c, 80d, 80e, and 80f react, the front camera 71 and Images captured by the back camera 70 are automatically switched and transmitted.
As a result, an image can be automatically displayed without any operation on the subunit main body 50 side, so that the driver can concentrate on driving operation without being distracted by the operation of the subunit main body 50. it can.

According to the smart parking assist system 10 of the present embodiment, the engine lock means 38 stops the operation of the engine starter and locks the engine in the security mode. As a result, compared to the case where the conventional car security device is provided with a dedicated door lock key that interlocks with the door lock in order to lock the engine, it is not necessary to provide the dedicated door lock key. Easy to install.
Further, in the security mode, when the sensor 14 detects an abnormality, the image around the vehicle or in the vehicle is displayed as a still image or a frame dropping video from the main unit 11 to the subunit main body 50 via a long-distance wireless communication that is a mobile phone line. It was made to transmit via the communication line 17. As described above, in the case of a still image or a frame dropping moving image, the data volume to be transmitted can be suppressed, so that a captured image can be transmitted immediately. As a result, the driver who notices the abnormality detection on the side of the subunit main body 50 can immediately respond to the detected abnormal situation, so that damages such as vandalizing and running away can be minimized.

  In the security mode, the room light was turned on for shooting. As a result, the camera 13 can capture a clear image, and at night, by turning on the room light, it is possible to threaten a person who has entered or is about to enter the vehicle. Furthermore, since the shutter sound is made to sound with the lighting of the room light, the intruder can be intimidated, and it can be expected that the damage is minimized by knowing that the intruder has been photographed.

Smart parking assist system ... 10,
Main unit ... 11, Sub unit ... 12, Camera ... 13, Sensor ... 14, Wireless communication line ... 15,
Short-distance wireless communication line ... 16, long-distance wireless communication line ... 17,
Image input unit 20, sensor input unit 21, communication unit 22, power supply unit 23, control unit 24,
Audio input / output unit 25, microphone 25a, speaker 25b, audio input terminal 25c, audio output terminal 25d,
Remote control input unit 26, light receiver 26a, remote control 26b,
Decoder means ... 27, encoder means ... 28,
Detection means 29, detection signal input terminal 29a,
Main bidirectional communication means ... 30, main short-range communication means ... 31, main long-range communication means ... 32, communication device ... 33, card slot ... 34, clock ... 35,
Main power source 36, sub power source 37, engine lock means 38, room lamp lighting means 39,
Main control means 40, distance determination means 41, line selection means 42,
Indicator lamp ... 43, issuing means ... 44, external storage medium ... 45, recording means ... 46,
Sub unit body ... 50, Cradle ... 50a, Key tag ... 51,
Display unit 52, communication unit 53, control unit 54
Display means ... 55, monitor screen ... 56,
Sub bidirectional communication means 57, sub short distance communication means 58, sub long distance communication means 59,
Sub-control means 60,
Key tag body 65, key ring 66, transmission means 67,
Back camera ... 70, Front camera ... 71, Indoor camera ... 72, Front lens ... 73, Room lens ... 74, Sub monitor ... 75,
Corner sensor 80, front sensor 80a, 80b, back sensor 80c, 80d, 80e, 80f, infrared sensor 81, field sensor 82, door sensor 83, impact sensor 84.

Claims (12)

Consists of a main unit and sub-units connected to each other via a wireless communication line,
The main unit includes at least one camera capable of photographing the periphery of the vehicle or the inside of the vehicle,
Having main control means for controlling image processing relating to an image photographed by the camera;
The subunit includes display means having a monitor screen capable of displaying the image;
Sub-control means for controlling image processing related to the image displayed by the display means;
The main unit and the subunit have bidirectional communication means capable of bidirectional communication with each other related to the wireless communication line in the main control means and the sub control means, respectively.
When taking an image with the camera,
The main unit converts the image into electronic image data,
An image signal related to the image data is transmitted from the main unit to the subunit over the wireless communication line,
The image data is converted into the image by the subunit that has received the image signal,
A smart parking assist system configured to reproduce and display the image on the monitor screen,
The wireless communication line is
When a distance between the main unit and the subunit is equal to or less than a predetermined distance, a short-range wireless communication line in charge of communication between the main unit and the subunit;
When the predetermined distance is exceeded, a long-distance wireless communication line in charge of communication in charge of communication between the main unit and the subunit,
The sub unit is provided with a transmission means for periodically transmitting a distance determination signal to the main unit,
Based on the distance determination signal, the main unit has a distance determination means for determining a distance from the subunit, and the short distance wireless communication line or the long distance wireless communication based on a determination result of the distance determination means. Providing a line selection means for selecting the wireless communication line of any one of the lines;
While the distance determination signal transmitted from the transmission means is received by the main unit, the distance determination means determines that the distance between the main unit and the subunit is equal to or less than a predetermined distance,
When the main unit cannot receive the distance determination signal, the distance determination unit determines that the distance between the main unit and the subunit exceeds a predetermined distance,
When the distance between the main unit and the subunit is a predetermined distance or less,
The line selection means selects the short-range wireless communication line,
Through the short-range wireless communication line, image data related to the image captured by the camera is transmitted to the subunit,
The subunit that has received the image data reproduces and displays an image based on the image data on the monitor screen without substantial delay,
The main unit and the subunit operate in a parking assist mode that assists the driving operation of the driver by displaying an image of the vehicle periphery captured by the camera on the monitor screen,
When the distance between the main unit and the subunit exceeds a predetermined distance,
The line selection means selects the long distance wireless communication line,
Through the long-distance wireless communication line, image data related to the image captured by the camera is transmitted to the subunit,
The subunit that has received the image data displays an image based on the image data on the monitor screen,
The main unit and the subunit are operated in a security mode for monitoring the situation around the vehicle or inside the vehicle or the vehicle body by displaying an image around the vehicle or inside the vehicle imaged by the camera on the monitor screen,
Depending on the distance between the main unit and the subunit,
A smart parking assist system, wherein the parking assist mode and the security mode are automatically switched.   The smart parking assist system according to claim 1, wherein the transmission unit is provided in a key tag formed separately from a subunit main body of the subunit. The main unit is provided with an external recording medium,
2. The smart parking assist according to claim 1, wherein the main control unit is provided with a recording unit that records and saves image data related to an image captured by the camera in the security mode in the external recording medium. system.   The smart parking assist system according to claim 1, wherein the camera is a back camera directed toward the rear of the vehicle.   The smart parking assist system according to claim 1, wherein the camera is a front camera that faces the front of the vehicle.   The smart parking assist system according to claim 1, wherein the camera is a camera capable of photographing at least the entire interior of the vehicle. The main unit is provided with detection means having a sensor,
According to the detection signal output from the detection means,
2. The smart parking assist system according to claim 1, wherein the main unit performs a predetermined operation when the main unit is in one of the parking assist mode and the security mode.   The smart parking assist system according to claim 7, wherein the sensor is a corner sensor that detects an obstacle near a corner of a vehicle body.   The smart parking assist system according to claim 7, wherein the sensor is an infrared sensor that detects a heat source in the vehicle.   The smart parking assist system according to claim 7, wherein the sensor is a field sensor that detects a moving body that has entered a predetermined range around the vehicle.   The smart parking assist system according to claim 7, wherein the sensor is a door sensor that detects opening and closing of the door of the vehicle body.   The smart parking assist system according to claim 7, wherein the sensor is an impact sensor that detects an impact applied to the vehicle body.

Images