JP2011178272A - Parking support device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a parking support device starting an exact support even for a driver unaccustomed to the parking support, and allowing the driver to easily understand the content of the support. <P>SOLUTION: This device includes: an image acquisition section 2 acquiring a peripheral image photographed by a photographing device 12; a display control section 3 displaying at least the peripheral image on a display device 20; an operation guide generating section 4 generating operation guides each showing a driving operation specified for each step of a plurality of steps when a vehicle is parked at a target parking position, by use of a text or an image or both; an operation icon generating section 5 generating operation icons corresponding to the operation guides, and having display areas smaller than the operation guides; and a superimposition control section 6, when a preset time has elapsed in a state without a driving operation in each step, creating a state where an operation guide for the step is displayed superimposed onto a peripheral image, and, when a driving operation is started from that state, creating a state where an operation icon instead of the operation guide is superimposed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a parking assistance device that assists a driving operation of a driver when a vehicle is parked.

  2. Description of the Related Art A parking assist device that can reduce a driver's operation burden when a vehicle is parked is known. For example, Patent Literature 1 describes a steering assist device in which a video behind the vehicle is displayed on a monitor screen, and a steering wheel steering amount guide and an eye mark are superimposed on the video. The steering wheel steering amount guide includes a target steering amount mark and an actual steering amount mark. When the actual steering amount mark matches the target steering amount mark, the driver holds the steering wheel and moves backward. When the eye mark that guides the turning point enters the parking space, the driver turns the steering wheel in the opposite direction and moves the vehicle backward.

  Patent Document 2 describes a parking assist device that assists a driving operation during parallel parking by superimposing various auxiliary lines and the like on an image captured by an in-vehicle camera. This parking assistance device has a help button arranged at the driver's seat of the vehicle and display control means for displaying a help screen for instructing a driving operation on the monitor screen. The display control means sequentially updates the scenario pointers set stepwise with respect to the parking progress status in accordance with the driving operation during parking. Then, when the help button is operated by the driver, a help screen for instructing the driving operation is displayed on the monitor according to the scenario pointer at that time.

Japanese Patent No. 3575365 (see 0028, FIG. 5, etc.) Japanese Patent No. 3565156 (see 0013-0016, FIG. 7 etc.)

  However, according to the steering assist device described in Patent Document 1, it is necessary for the driver to know in advance what the actual steering amount mark, the target steering amount mark, the eye mark, and the like indicate. If the driver does not know these meanings, it is difficult to understand the support contents from the information on the display screen, which may cause confusion. Furthermore, in order to use this steering assist device, it is necessary for the driver to know not only the meaning of each display but also the operation procedure assumed by the system. For example, a smooth parking operation cannot be performed without knowing “matching the actual steering amount mark with the target steering amount mark” or “stopping when the eye mark enters the parking space”.

  The parking assist device described in Patent Literature 2 can instruct a driver who has lost his or her driving operation to perform a driving operation according to the progress of parking. This parking assistance device is configured so that a driver can acquire driving operation information by operating a help button. However, since the driving operation information is not displayed unless the driver operates the help button, accurate support is not executed when the presence of the help button is not known or when the driving operation is incorrect.

  SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and provides a parking assistance device that can start assistance accurately even for a driver who is unfamiliar with parking assistance and can easily understand the assistance contents. The purpose is to provide.

  The first characteristic configuration of the parking assist device according to the present invention includes an image acquisition unit that acquires a peripheral image of the vehicle photographed by a photographing device provided in the vehicle, and a display in which at least the peripheral image is provided in the vehicle interior. A display control unit to be displayed on the device, and an operation guide generation unit that generates an operation guide that indicates a driving operation defined for each of a plurality of steps when parking at a parking target position by at least one of characters and figures. An operation icon generation unit that generates an operation icon that corresponds to the operation guide and has a smaller display area than the operation guide, and is preset in a state where no driving operation is performed in each step during the execution of parking assistance. When time elapses, the operation guide of the process is overlaid on the surrounding image, and when the driving operation is started from this state, the operation guide Ete is the operation icon in that and a superposition control unit so as to be brought into superimposed and displayed on the peripheral image.

  According to this characteristic configuration, when a preset time elapses without driving operation in each process, an operation guide indicating the driving operation specified in the process by at least one of characters and figures is displayed. To display. In other words, if the parking procedure is not known and the driver maintains a stop state where no driving operation is performed, an operation guide is displayed after a certain period of time without performing a special operation. As a result, the driver can start the assistance accurately even for the driver who is not accustomed to the vehicle, and can easily understand the driving operation by the operation guide. Since the operation guide is displayed when the vehicle is stopped, even a beginner can calmly see the operation guide. Further, since an operation guide is not displayed for a skilled driver who can execute a driving operation by himself / herself before a certain time elapses, it is possible to avoid such annoyance to the driver.

  Further, according to this feature configuration, when the driving operation is started, the operation guide is switched to an operation icon having a smaller display area than the operation guide. This operation icon is associated with the operation guide using, for example, the same characters and figures as the operation guide, so even if the content is somewhat simplified, the driver should perform the driving operation to be performed in the current process Can be easily understood. Therefore, even a beginner who is not confident in driving operation can continue driving operation with peace of mind by checking the operation icon. Since the operation icon has a relatively small display area, it is possible to ensure the visibility of the surrounding image and to avoid being obstructive during the driving operation.

  The second characteristic configuration is that the superimposition control unit displays the operation guide of the first step among the plurality of steps at the start of parking assistance.

  According to this characteristic configuration, the driver can well recognize that parking assistance has been started, so that it is possible to avoid the driver from being uneasy because the unresponsive state is maintained. Moreover, the troublesomeness for the driver who is used to parking assistance can be suppressed by limiting the process of displaying the operation guide to the first process regardless of the duration of the state where the driving operation is not performed. .

  The third characteristic configuration is that when the driving operation by the driver is different from the driving operation defined in each of the steps or when the driving operation is terminated without reaching the specified operation amount, the superimposing control unit The operation icon is highlighted.

  According to this feature configuration, the operation icon is highlighted when the driving operation by the driver is different from the driving operation specified in each process or when the driving operation is terminated without reaching the specified operation amount. The driver can easily understand that the driving operation being performed is incorrect or insufficient in quantity. Note that, as a form of highlighting, it is conceivable to blink the operation icon or change the color of the operation icon.

  The fourth characteristic configuration is that the driving operation defined in each step includes a steering operation.

  According to this characteristic configuration, when the steering direction is wrong or when the steering amount is insufficient, the driver can be well informed.

  The fifth characteristic configuration is that the driving operation defined in each step includes an accelerator operation.

  According to this characteristic configuration, when the amount of movement of the vehicle is insufficient, it is possible to notify the driver well.

  A sixth characteristic configuration is that the superimposition control unit deletes the operation icon when the driving operation indicated by the operation icon superimposed on the display device is completed.

  According to this feature configuration, when the driving operation indicated by the operation icon is completed, the operation icon is deleted, so that the driver can understand that the driving operation in the process is completed and the process proceeds to the next process. . Therefore, even a beginner can safely perform the next driving operation. In addition, once the operation icon is deleted, the operation is performed except when a certain period of time has passed without the driving operation being performed after the next step and when the operation icon is highlighted due to an error in driving operation, etc. Since guides and operation icons are not displayed in a superimposed manner, it is possible to avoid annoyance for a skilled driver.

  A seventh characteristic configuration is that the display device is a mirror monitor provided in a rearview mirror installed in a vehicle interior.

  As in this feature configuration, if the display device is a mirror monitor provided in the rearview mirror, the display area becomes smaller than when a monitor for a navigation system is used, and voice support cannot be performed because there is no speaker. However, this parking assistance device provides visual parking assistance using an operation guide and operation icons, and only operation icons with a small display area are displayed during driving operations. Therefore, the parking assistance device is applied to a mirror monitor. Even better parking assistance.

It is a schematic diagram which shows the driver's seat front of a vehicle. It is a block diagram which shows the basic composition of a vehicle. It is a block diagram which shows the structural example of a parking assistance apparatus. It is explanatory drawing which shows the movement locus | trajectory in the case of parallel parking. It is process drawing which shows the procedure of the parallel parking supported by a parking assistance apparatus. It is an example of a display in the 1st process. It is an example of a display in the 2nd process. It is an example of a display in the 3rd process.

  Hereinafter, an embodiment of a parking assistance device according to the present invention will be described with reference to the drawings.

  1 and 2 show the basic configuration of the vehicle 30. FIG. The steering 24 provided in the driver's seat is interlocked with the power steering unit 33 and transmits the rotational operation force to the front wheels 28f to steer the vehicle 30. An engine 32 and a speed change mechanism 34 having a torque converter, CVT, and the like that shift the power from the engine 32 and transmit the power to the front wheels 28f and the rear wheels 28r are arranged at the front of the vehicle body. Power is transmitted to the front wheel 28f and / or the rear wheel 28r according to the driving method of the vehicle 30 (front wheel drive, rear wheel drive, four wheel drive). In the vicinity of the driver's seat, an accelerator pedal 26 as an accelerator operating means for controlling the traveling speed, and a brake pedal 27 for applying a braking force to the front wheels 28f and the rear wheels 28r via the brake devices 31 for the front wheels 28f and the rear wheels 28r, Are arranged in parallel.

  A rearview mirror 19 is provided in the upper left front part of the driver's seat. In the present embodiment, a part of the rearview mirror 19 functions as a mirror monitor 20 (display device). When the mirror monitor 20 is not functioning, the part of the mirror monitor 20 functions as a normal rearview mirror. The mirror monitor 20 does not include a speaker and provides visual parking assistance to the driver. However, the form of the display device is not limited to that described above, and for example, a monitor for a navigation system provided in a console may be used, or a configuration with voice parking assistance may be used.

  A steering sensor 14 is provided in the operation system of the steering 24, and the steering operation direction and the operation amount are measured. The operation system of the shift lever 25 is provided with a shift position sensor 15 to determine the shift position. The operation system of the accelerator pedal 26 is provided with an accelerator sensor 16 to measure an operation amount. The operating system of the brake pedal 27 is provided with a brake sensor 17 that detects the presence or absence of the operation.

  In addition, a rotation sensor 18 that measures the amount of rotation of at least one of the front wheel 28f and the rear wheel 28r is provided as a movement distance sensor. In this embodiment, the case where the rotation sensor 18 is provided in the rear wheel 28r is illustrated. As for the movement distance, the transmission mechanism 34 may measure the movement amount of the vehicle 30 from the rotation amount of the drive system. In addition, the vehicle 30 is provided with an ECU (electronic control unit) 10 that is the core of the parking assistance device according to the present invention and that performs traveling control including parking assistance.

  At the rear of the vehicle 30, a camera 12 (imaging device) that captures a scene behind the vehicle 30 is provided. The camera 12 is a digital camera that incorporates an image sensor such as a charge coupled device (CCD) or a CMOS image sensor (CIS) and outputs information captured by the image sensor in real time as moving image information. The camera 12 includes a wide-angle lens and has a field angle of about 140 degrees on the left and right, for example. The camera 12 is installed with a depression angle of, for example, about 30 degrees toward the rear of the vehicle 30 and photographs a region up to about 8 m behind. The captured image is input to the ECU 10 and used for parking assistance or the like.

  FIG. 3 is a block diagram schematically showing a configuration example of the parking assist apparatus according to the present invention having the ECU 10 as a core. As shown in the figure, the ECU 10 is configured to include functional units of a calculation unit 1, an image acquisition unit 2, and a display control unit 3. The calculation unit 1 includes functional units such as an operation guide generation unit 4, an operation icon generation unit 5, and a superimposition control unit 6 described later. Each functional unit of the ECU 10 is realized by cooperation with software such as a program executed on the hardware, with a logic operation hardware such as a microcomputer or a DSP (digital signal processor) as a core. Therefore, each functional unit shows a sharing as a function and does not necessarily need to be physically configured independently. The ECU 10 also includes various memories such as a frame memory for storing images and various electronic circuits such as an image processing circuit. Since the configurations and functions of these various memories and various electronic circuits are known, illustration and detailed description thereof are omitted.

  The image acquisition unit 2 is a functional unit that acquires a peripheral image of the vehicle 30 captured by the camera 12. The image acquisition unit 2 includes a frame memory for storing images, a synchronization separation circuit, and the like. The display control unit 3 is a functional unit that displays a peripheral image of the vehicle 30 captured by the camera 12 on the mirror monitor 20 in the vehicle interior. In addition, the display control unit 3 superimposes and displays an indicator for guiding the driver to the parking target position, an operation guide and an operation icon, which will be described later, on the peripheral image.

  In the present embodiment, the calculation unit 1 is configured to include functional units such as the operation guide generation unit 4, the operation icon generation unit 5, and the superimposition control unit 6, but is configured to include other functional units. It is also possible. For example, the calculation unit 1 may perform the setting of the parking target position and the calculation of the guidance route to the parking target position. In addition, since the method of setting a parking target position or calculating a guidance route is a well-known method, description is abbreviate | omitted here. For example, the techniques described in Japanese Patent Application Laid-Open No. 11-224470 and Japanese Patent No. 3762855 can be applied.

  The calculation unit 1 receives detection results from the steering sensor 14, the shift position sensor 15, the accelerator sensor 16, the brake sensor 17, the rotation sensor 18, and the like. Based on the detection results of these sensors, an operation guide and an operation icon described later are provided. Is generated.

  The operation guide generating unit 4 is a functional unit that generates an operation guide that indicates a driving operation defined in each step by at least one of characters and figures when the vehicle is parked at the parking target position. This operation guide has a larger display area and higher visibility than an operation icon described later.

  The operation icon generation unit 5 is a functional unit that generates the operation icon that shows the same content as the operation guide and has a smaller display area than the operation guide. It is preferable that this operation icon is configured so that it is clear that the operation icon indicates the same driving operation as the operation guide of the process by using a part of characters and figures used for the operation guide of each process. . However, it is not necessary to use the same characters and figures used for the operation guide. If you can understand the correspondence with the operation guide, you can change the characters of the operation guide or simplify the figure. I do not care.

  The superimposing control unit 6 is a control unit that determines a display time, a display mode, an erasing time, and the like when displaying the operation guide and the operation icon on the mirror monitor 20. In the present embodiment, regarding the superimposed display of the operation guide and the operation icon, a command signal is sent from the superimposition control unit 6 to the display control unit 3 and displayed on the mirror monitor 20 via the display control unit 3. It is.

  As shown in FIG. 4, the parking assist device of the present embodiment configured with the ECU 10 as a core is, for example, parking when performing parallel parking in a parking space E between two parked vehicles 40 (41 and 42). Provide support. The vehicle 30 passes by the side of the parking space E, moves forward, turns back with turning back, and is parked in the parking space E.

  The ECU 10 calculates the guidance route of the vehicle 30 with the approximate center portion of the axle of the rear wheel 28r of the vehicle 30 as the reference point Q of the vehicle 30, and assists the parking operation in the parking space E. That is, the ECU 10 advances from the point P1 to the point P2, starts to reverse from the point P2 that is the reverse start position, turns back the steering 24 at the point P3 that is the return position, and completes parking at the point P4 that is the parking target position. Assist in parallel parking. The ECU 10 keeps the steering angle when moving from the reverse start position P2 to the return position P3 and the steering angle when moving from the reverse start position P3 to the parking target position P4, respectively, from the reverse start position P2 to the parking target position P4. Calculate the guidance route.

  Point A in the figure indicates a position where the vehicle 30 heading for the parking space E with a turn from the reverse start position P <b> 2 does not come into contact with an obstacle on the front side of the vehicle 30. In the example shown in FIG. 3, the obstacle on the front side of the vehicle 30 is the parked vehicle 41, and the right rear end portion of the parked vehicle 41 adjacent to the vehicle 30 at the reverse start position P <b> 2 substantially corresponds to the point A. The ECU 10 calculates an appropriate position as the reverse start position P2 from the relationship with the point A so that the contact with the parked vehicle 41 is avoided. Hereafter, with reference to FIG. 5, each process of the parallel parking guided by the parking assistance apparatus which concerns on this embodiment is demonstrated.

[First step]
In order to perform parallel parking by moving the vehicle 30 backward, the driver advances and stops the vehicle 30 until the parking space E enters the shooting range F of the camera 12 installed behind the vehicle 30. It is difficult to stop the vehicle 30 so as to coincide with the reverse start position P2 shown in FIG. Accordingly, the vehicle 30 is first advanced beyond the reverse start position P2 and the parking assist device is activated, and then the vehicle 30 is moved backward to the reverse start position P2 with reference to the vertical index a and the horizontal index b shown in FIG. . The step of moving the vehicle 30 to the reverse start position P2 is referred to herein as the first step.

[Second step]
The driver operates the steering wheel 24 counterclockwise with the vehicle 30 stopped at the reverse start position P2, and moves the parking frame c shown in FIG. The indicated parking target position P4 is set. At the same time, by the operation of the steering wheel 24, a steering angle for starting parallel parking is set for the front wheel 28f, which is a steering wheel. The process accompanied by this driving operation for moving the parking frame c to the desired parking space E and setting the parking target position P4 is referred to as a second process executed following the first process.

  The lateral distance between the parking space E and the vehicle 30 may vary depending on the driver. The geometric relationship between the reverse start position P2 and the parking space E in the front-rear direction of the vehicle 30 is adjusted to an appropriate position by the first step. Since the geometric relationship between the backward start position P2 and the parking space E in the left-right direction of the vehicle 30 varies depending on the driver, it is adjusted in the second step. Since the parking frame c is set in the parking space E in the second step, the ECU 10 can determine the parking target position P4. When the reverse start position P2 and the parking target position P4 are determined, the ECU 10 can determine the guidance route and the return position P3.

  The setting of the reverse start position P2, the parking target position P4, the guidance route, and the turn-back position P3 in the first step and the second step may be performed by the calculation unit 1 or performed by another functional unit of the ECU 10. Also good. Further, in setting these, after the reverse start position P2 and the parking target position P4 are determined, the guide route and the turn-back position P3 may be set, or vice versa. That is, you may set the parking target position P4, calculating the position which can be induced | guided | derived from the reverse start position P2.

[Third step]
As shown in FIG. 5C, the driver holds the rudder angle set in the second step and moves the vehicle 30 backward while referring to the turning line d. FIG. 5B shows a state before the vehicle 30 starts to reverse. FIG. 5D, which will be described later, shows a state in which the vehicle 30 has completed or has completed the reverse operation performed while maintaining the rudder angle set in the second step, that is, has reached the turn-back position P3 or its vicinity. ing. FIG. 5C shows a process involving a driving operation in which the driver moves the vehicle 30 backward between the reverse start position P2 and the switching back position P3. This step is referred to herein as a third step that is performed following the second step.

[Fourth step]
The driver holds the rudder angle set in the second step while referring to the turning line d, and stops the vehicle 30 when moving backward to the turning position P3 as shown in FIG. 5 (d). Specifically, when the turn-back line d moves backward to the far side of the parking frame c, that is, the position where it reaches the road shoulder, the driver steps on the brake pedal 27 to stop the vehicle 30. This process accompanied by the driving operation for stopping the vehicle 30 at the switching position P3 is referred to herein as a fourth process that is executed following the third process.

[Fifth step]
The driver operates the steering wheel 24 with the vehicle 30 stopped at the turn-back position P3 stopped in the fourth step, and turns back until the maximum steering angle is obtained in the reverse direction as shown in FIG. 5 (e). . That is, the rudder angle after turning back the parallel parking is set. The steered angle after turning is set to the front wheel 28f which is a steered wheel. Further, a vehicle rear line e and a rear prediction line g are displayed instead of the turn-over line d in the third step and the fourth step. This step accompanied by this driving operation of operating the steering wheel 24 while the vehicle 30 is stopped at the turning-back position P3 is referred to herein as a fifth step executed following the fourth step.

[Sixth step]
The driver holds the rudder angle set in the fifth step and moves the vehicle 30 backward while referring to the vehicle rear line e and the rear prediction line g. When the driver confirms that the vehicle rearward line e is substantially parallel to the parking space E as shown in FIG. 5 (f), the driver stops the vehicle 30. That is, when reaching the parking target position P4, the driver stops the vehicle 30. This process involving the driving operation for stopping the vehicle 30 at the parking target position P4 is referred to herein as a sixth process that is executed following the fifth process.

  The vehicle 30 is parked in parallel in the parking space E through the above steps. After the sixth step, when it is necessary to finely adjust the position in the front-rear direction in the parking space E, the driver operates the steering 24 or the like to move the vehicle 30. When the vehicle rear line e and the rear prediction line g are continuously displayed, it is preferable that the steering 24 can be returned to the neutral position by operating the steering 24 so that both indicators overlap.

  The parking assistance apparatus according to the present invention indicates the driving operation in each process described above to the driver with an operation guide and an operation icon. The parking assistance is configured to be started by operating the shift lever 25 to the reverse position. However, in addition to this, the parking assistance may be started by a switch (not shown) provided in the vehicle interior.

  When the vehicle 30 is stopped at a position advanced from the reverse start position P2 shown in FIG. 4 and the driver operates the shift lever 25 in the reverse direction, the ECU 10 starts parking assistance. When the ECU 10 receives a detection result indicating that the shift lever 25 has been changed to reverse from the shift lever sensor 15, the ECU 10 causes the mirror monitor 20 to display a peripheral image captured by the camera 12 via the display control unit 3.

  Based on FIGS. 6-8, the example of a display screen displayed on the mirror monitor 20 at the time of parking assistance is demonstrated. 6 to 8 are screens for showing driving operations in the first step to the third step, respectively. Moreover, a figure of each figure is a screen where the operation guide and the operation icon are not displayed, b is a screen where the operation guide is superimposed, and c is a screen where the operation icon is superimposed. Indicates.

  In the present embodiment, the peripheral images are mirrored in the display screen examples shown in FIGS. The peripheral image is an image according to the shooting direction of the camera 12, and is substantially equivalent to, for example, an image viewed by the driver looking back. On the other hand, as shown in FIG. 1, since the mirror monitor 20 is disposed in front of the driver, the driver views the rear peripheral image displayed on the mirror monitor 20 facing the front. Accordingly, the peripheral image is displayed as a mirror image so that the actual direction of the parking space E matches the direction of the parking space E on the display screen in the left-right direction of the driver.

  In the first step, as shown in FIG. 6A, the vertical index a and the horizontal index b are superimposed and displayed on the peripheral image. This screen indicates to the driver that the vertical indicator a should coincide with the rear end of the parked vehicle 41, that is, the vehicle 30 should be moved back to the reverse start position P2 in FIG. However, a driver who is unfamiliar with parking assistance may not know what kind of driving operation should be performed even when viewing the screen as shown in FIG.

  Therefore, in the parking assistance device according to the present invention, when a predetermined time has elapsed without driving operation, the operation guide m1 is displayed superimposed on the surrounding image as shown in FIG. Thus, by displaying the operation guide m1 composed of characters and figures, the driver can easily understand the driving operation to be performed in the first step. Furthermore, since the operation guide m1 is displayed when a certain time has passed without the driving operation being performed, that is, when the vehicle 30 is stopped, the driver calms down and looks at the operation guide m1. Can do. In FIG. 6B, the operation guide m1 is arranged at the lower part of the screen. However, the operation guide m1 is not limited to this, and may be arranged at other positions such as the center of the screen or the upper part of the screen.

  If the driver performs any driving operation while the operation guide m1 is being displayed, an operation icon n1 is superimposed and displayed on the peripheral image as shown in FIG. 6C instead of the operation guide m1. The content displayed on the operation icon n1 is a figure only by omitting the characters shown in the operation guide m1 in order to reduce the display area, but the meaning is the operation guide m1. The same thing. Since the display area of the operation icon n1 is small, it is possible to confirm the driving operation to be performed by the driver during the operation while avoiding deterioration of the visibility of the peripheral image and each index displayed on the mirror monitor 20. it can. Note that the content of the operation icon n1 is not limited to that shown in FIG. 6C, and for example, a graphic may be further simplified, or a part of characters of the operation guide m1 may be used. In FIG. 6C, the operation icon n1 is arranged at the lower right of the screen, but the present invention is not limited to this, and may be arranged at other positions such as the upper right of the screen.

  When the driver performs an operation different from the driving operation displayed on the operation icon n1, that is, here, when the vehicle 30 moves forward or the steering 24 is steered, the operation icon n1 is blinked and highlighted. It is preferable that the user can be notified that the operation is incorrect. Similarly, even when the driver finishes the backward operation of the vehicle 30 in a state where the amount that the ECU 10 does not reach is reached, the operation amount is given to the driver by blinking and highlighting the operation icon n1. It is preferable to be configured so that it can be notified that it is insufficient. As a method for highlighting the operation icon n1, other methods such as changing the color of the operation icon n1 may be adopted.

  When the vehicle 30 is stopped and the driving operation is not performed while the operation icon n1 is superimposed, the operation guide m1 is displayed again in place of the operation icon n1. In this way, the operation guide m1 is displayed without performing any special operation each time a certain time elapses in a state where the driving operation is not performed, so that the driver can perform the driving that the ECU 10 assumes each time. Since the operation can be confirmed, it is more suitable for a driver unfamiliar with parking assistance.

  In addition, when the driver | operator complete | finishes the reverse operation of the vehicle 30 in the state which does not reach the regulation amount, it is preferable to set the timing which highlights the operation icon n1 so that it may be before progress of the said fixed time. Then, when the vehicle 30 stops in the middle of the reverse operation, first, the operation icon n1 having a small display area is blinked and then the operation guide m1 having a large display area is displayed when the driving operation is not performed. Therefore, it is possible to avoid the troublesomeness that the operation guide m1 is immediately displayed in a superimposed manner when the vehicle is temporarily stopped during the backward movement.

  When the vehicle 30 moves backward to a position where the vertical index a coincides with the rear end of the parked vehicle 41 and the ECU 10 recognizes the completion of the first step, the operation icon n1 indicating the driving operation in the first step is deleted. The superimposition control of the operation guide m1 and the operation icon n1 described above is the same in the second and subsequent steps, but only in the first step, the shift lever 25 is changed to reverse to clearly indicate the start of parking assistance. It is desirable that the operation guide m1 is displayed when parking assistance is started.

  In the second step, as shown in FIG. 7A, a green parking frame c is superimposed and displayed on the surrounding image together with the vertical index a and the horizontal index b. This screen indicates that the parking target position P4 should be set by moving the parking frame c to a desired parking space E by operating the steering wheel 24 with the vehicle 30 stopped at the reverse start position P2 shown in FIG. Show. After the completion of the first step, the operation guide and the operation icon are both displayed as shown in FIG. 7A while the driving operation of the second step is being performed without a certain amount of time being passed. The state where it is not superimposed is maintained.

  When a certain period of time has passed after the completion of the first step and the driving operation is not performed until the second step is completed, an operation guide m2 indicating the driving operation in the second step is displayed as shown in FIG. It is displayed superimposed. Then, when the driver performs some driving operation in a state where the operation guide m2 is displayed in a superimposed manner, an operation icon n2 is displayed in a superimposed manner instead of the operation guide m2 as shown in FIG. 7C.

  In addition, after completion of the first step, some driving operation is performed before a certain time elapses in a state where the driving operation is not performed. However, the operation is an operation other than the driving operation assumed by the ECU 10, that is, the steering here. In the case of 24 right steering or accelerator operation, the operation icon n2 is superimposed in a blinking highlighted state without passing through the display of the operation guide m2. Similarly, when the left steering of the steering wheel 24 is terminated without reaching the prescribed amount assumed by the ECU 10, the operation icon n2 is superimposed in a blinking highlighted state.

  When the parking frame c is within the parking space E and the ECU 10 recognizes the completion of the second step, the operation icon n2 is deleted when the operation icon n2 is displayed.

  In the third step, as shown in FIG. 8A, the arc-shaped return line d displayed in red is superimposed and displayed on the surrounding image. This screen indicates that the vehicle 30 should be moved backward with the steering wheel 24 held until the turn-over line d reaches the shoulder, that is, until the vehicle 30 reaches the turn-back position P3. After the completion of the second step, the operation guide and the operation icon are both displayed as shown in FIG. 8 (a) while the driving operation of the third step is being performed without a certain amount of time being passed. The state where it is not superimposed is maintained.

  When a certain period of time has passed after the completion of the second step until the third step is completed, the operation guide m3 indicating the driving operation in the third step is displayed as shown in FIG. It is displayed superimposed. Then, when the driver performs some driving operation in a state where the operation guide m3 is displayed in a superimposed manner, an operation icon n3 is displayed in a superimposed manner instead of the operation guide m3 as shown in FIG. 8C.

  In addition, after completion of the second step, some driving operation was performed before a certain period of time had elapsed without the driving operation being performed. However, the operation is an operation other than the driving operation assumed by the ECU 10, that is, the steering here. In the case of 24 steering or forward movement of the vehicle 30, the operation icon n3 is superimposed in a blinking highlighted state without passing through the display of the operation guide m3. Similarly, the operation icon n3 is also superimposed in a blinking highlighted state when the reverse amount of the vehicle 30 is terminated without reaching the prescribed amount assumed by the ECU 10.

  When the turning line d reaches the shoulder of the parking space E and the ECU 10 recognizes the completion of the third step, the operation icon n2 is deleted when the operation icon n2 is displayed.

  The description of the subsequent fourth to sixth steps is omitted, but the superimposition control unit 6 performs the same superimposition control as the operation guide and operation icon described so far. In the above embodiment, parking support in parallel parking has been described, but the parking mode that can be supported by the parking support device according to the present invention is not limited to parallel parking, such as garage storage It is also possible to support a parking form.

  The present invention can be applied to a parking assistance device that assists the driving operation of the driver when the vehicle is parked.

2 Image acquisition unit 3 Display control unit 4 Operation guide generation unit 5 Operation icon generation unit 6 Superimposition control unit 12 Camera (photographing device)
19 Rearview mirror 20 Mirror monitor (display device)
30 vehicle m1, m2, m3 operation guide n1, n2, n3 operation icon

Claims (7)

An image acquisition unit for acquiring a peripheral image of the vehicle imaged by an imaging device provided in the vehicle;
A display control unit for displaying at least the peripheral image on a display device provided in a vehicle interior;
An operation guide generating unit that generates an operation guide that indicates a driving operation defined by each step of a plurality of steps when parking at a parking target position by at least one of characters and figures;
An operation icon generator that generates an operation icon that corresponds to the operation guide and has a smaller display area than the operation guide;
When a preset time elapses in a state where the driving operation is not performed in each step during the execution of the parking assistance, the operation guide of the step is overlaid on the peripheral image, and the driving operation is started from this state. Is started, a superimposition control unit that superimposes and displays the operation icon on the surrounding image instead of the operation guide,
Parking assistance device with   The parking support device according to claim 1, wherein the superimposition control unit displays the operation guide of the first step among the plurality of steps at the start of parking support.   When the driving operation by the driver is different from the driving operation specified in each step or when the driving operation is terminated in a state where the specified operation amount is not reached, the superimposition control unit emphasizes the operation icon of the step. The parking assistance device according to claim 1 or 2, wherein the parking assistance device is displayed.   The parking assistance device according to claim 3, wherein the driving operation defined in each step includes a steering operation.   The parking assistance device according to claim 3, wherein the driving operation defined in each step includes an accelerator operation.   The parking assistance device according to any one of claims 1 to 5, wherein the superimposition control unit erases the operation icon when a driving operation indicated by the operation icon superimposed on the display device is completed.   The parking support device according to any one of claims 1 to 6, wherein the display device is a mirror monitor provided in a rearview mirror installed in a vehicle interior.

Images