JP2006160060A - Image display system, and image display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the convenience of an occupant of a vehicle by optimizing the display position of a reference line superposed on a pick-up image of an on-vehicle camera. <P>SOLUTION: When a reference line is superposed on a picked-up image of a rearview monitor camera 1, and displayed on a display 9, the operation input by an occupant to change the display position of the reference line on a screen of the display 9 is received, and information on the display position of the reference line after the change is stored in a storage unit 8 in relation to information on the vehicle position at the time. Thereafter, when the picked-up image of the rearview monitor camera 1 is displayed at the place same as the place of receiving the operation input to change the display position of the reference line, information on the display position of the reference line stored in the storage unit 8 in relation to information on the vehicle position detected at the time is read, and displayed on the display 9 while the reference line is superposed at the display position after the change on the picked-up image of the rearview monitor camera 1. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image display system and an image display method for displaying on a display device a guide line that is a guide for a distance from a vehicle end portion on a captured image of an in-vehicle camera such as a back view monitor camera.

  Conventionally, when the vehicle is traveling backward, an image of the rear of the vehicle is displayed on a display installed in the passenger compartment, and the vehicle occupant recognizes the state of the rear of the vehicle, thereby assisting the backward traveling of the vehicle when performing parking or the like. Back view monitor systems have been proposed and put into practical use.

In this type of back-view monitor system, when the start of reverse running of the vehicle is detected by the input of a reverse signal or the like, the display image on the display installed in the passenger compartment is displayed on the back view installed on the rear end of the vehicle. Switch to the image taken with the monitor camera and display the vehicle width line representing the vehicle width and the reference line that is a measure of the distance from the rear end of the vehicle superimposed on the image taken by the back view monitor camera. Is common. At this time, the display position of the vehicle width line and the reference line superimposed on the captured image of the back view monitor camera is normally fixed at a predetermined position (see, for example, Non-Patent Document 1). .
“PRESIDENT New Car Manual”, Nissan Motor Co., Ltd., October 2003, p. F-204 ~ 207

  By the way, among parking spaces where vehicles are parked, especially for parking spaces that are frequently used by vehicle occupants, such as parking spaces at home and workplaces, the occupant is in the optimal parking position of the vehicle in that parking space. Is often familiar. Therefore, it is desirable that the reference line superimposed on the image captured by the back view monitor camera is displayed so as to serve as a reference for parking the vehicle at such an optimal parking position. In the system, since the display position of the reference line is fixed at a predetermined position, there is a problem that the display is not always satisfactory for the vehicle occupant.

  In addition, in recent years, in addition to the back view monitor system, for monitoring the vehicle periphery of the vehicle using an in-vehicle camera, such as a system for monitoring the rear side of the vehicle using a camera embedded in a side mirror of the vehicle, etc. Various systems have been developed, and even in these systems, attempts have been made to superimpose and display a reference line on the captured image of the camera. However, the above-mentioned problems are common problems in these various monitoring systems. is there.

  The present invention was devised to solve the above-described problems of the prior art, and optimizes the display position of the reference line superimposed on the captured image of the in-vehicle camera, thereby improving the convenience of the vehicle occupant. An object of the present invention is to provide an image display system and an image display method with improved performance.

  In the present invention, in order to achieve the above object, an operation input by a vehicle occupant for changing the display position of the reference line on the screen of the display device is received, and the display position of the reference line is changed. The vehicle position when the operation input by the vehicle occupant is performed is detected, and the information of the changed display position of the reference line is stored in the storage means in association with the vehicle position information at that time. After that, when displaying the captured image of the in-vehicle camera on the display device, if the vehicle position at that time substantially matches any of the vehicle positions stored in the storage means, Information on the display position of the reference line that is associated and stored in the storage means is read out, and the reference line is displayed at the display position.

  According to the present invention, when displaying a photographed image of the in-vehicle camera on the display device, a guideline that is a guideline for the distance from the vehicle end is superimposed and displayed at an optimal display position according to the current position of the vehicle. The convenience of the vehicle occupant can be improved.

  Hereinafter, specific embodiments of the image display system of the present invention will be described in detail with reference to the drawings.

(First embodiment)
First, as an embodiment of the present invention, an example will be described in which the present invention is applied to a back view monitor system that assists backward traveling of a vehicle when parking is performed by displaying an image of the rear of the vehicle on a display.

  FIG. 1 is a block diagram showing a schematic configuration of a back view monitor system to which the present invention is applied. As shown in FIG. 1, the back view monitor system includes a back view monitor camera 1, a TV tuner 2, a video switching unit 3, a vehicle position detection unit 4, a vehicle direction detection unit 5, and a display control unit 6. And an operation input unit 7, a storage unit 8, and a display 9.

  The back view monitor camera 1 is composed of, for example, a small CCD camera using a CCD (Charge Coupled Device) as an image pickup device, and is attached to an appropriate position at the rear end of the vehicle. The TV tuner 2 receives a TV broadcast signal transmitted by television broadcast, and is installed, for example, in a vehicle trunk room. The back view monitor camera 1 and the TV tuner 2 are connected to a video switching unit 3, and the output is controlled by the video switching unit 3.

  The video switching unit 3 switches video to be displayed on the display 9. Specifically, the video switching unit 3 is when the vehicle (hereinafter referred to as the host vehicle) on which the back view monitor system of this embodiment is mounted is stopped or when the vehicle is traveling forward in the traveling direction. In a normal time such as, the video signal (composite signal) of the TV broadcast signal received by the TV tuner 2 is sent to the display control unit 6 to display the TV screen on the display 9. The video switching unit 3 then transmits a composite signal to be sent to the display control unit 6 from the video signal from the TV tuner 2 when the host vehicle starts to move backward, for example, by inputting a reverse signal. Switching to the video signal from the monitor camera 1 causes the display 9 to display a captured image of the back view monitor camera 1. In addition to such a video switching function, the video switching unit 3 has a function of controlling the operation of the back view monitor camera 1 such as supply of power to the back view monitor camera 1, for example. In the present embodiment, the source of the video to be displayed on the display 9 is limited to the back view monitor camera 1 and the TV tuner 2. However, other sources such as a DVD (Digital Versatile Disc) player and a navigation device are also described. When other video sources are connected, the video switching unit 3 also performs switching with the video from these other video sources.

  The vehicle position detection unit 4 detects a vehicle position that is the current position of the host vehicle. For example, a GPS receiver that receives radio waves from a GPS (Global Positioning System) satellite is used. Moreover, the vehicle direction detection part 5 detects the vehicle direction which is the direction which the own vehicle is facing, for example, a gyro sensor, a geomagnetic sensor, a rudder angle sensor, etc. are used. The vehicle position information detected by the vehicle position detection unit 4 and the vehicle direction information detected by the vehicle direction detection unit 5 are sent to the display control unit 6.

  The display control unit 6 controls the display operation of the display 9 in accordance with the composite signal sent from the video switching unit 3. In particular, the video switching unit 3 detects the start of backward travel of the host vehicle and performs backview. When a video signal is sent from the monitor camera 1, the display control unit 6 displays a vehicle width line that represents the vehicle width of the host vehicle and a guide line that is a guide for the distance from the rear end of the host vehicle. It has a function of reading information from the storage unit 8 and superimposing these vehicle width lines and reference lines on the captured image of the back view monitor camera 1 and displaying them on the display 9.

  Here, in the conventional general back view monitor system, the display position of the vehicle width line and the reference line superimposed on the captured image of the back view monitor camera is normally fixed at a predetermined position. In the back view monitor system of this embodiment, the display control unit 6 accepts an operation input by the vehicle occupant for changing the display position of the reference line, and the reference line can be displayed at the display position desired by the vehicle occupant. I have to. Further, in the back view monitor system of the present embodiment, when the host vehicle is about to park in the same posture at the place where the operation for changing the display position of the reference line is performed, the display control unit 6 The reference line is displayed at the changed display position.

  Specifically, when an operation input for changing the display position of the reference line is performed by a vehicle occupant, the display control unit 6 displays information on the display position of the changed reference line at the time of the vehicle position. The information is stored in the storage unit 8 in association with the vehicle position information detected by the detection unit 4 and the vehicle direction information detected by the vehicle direction detection unit 5. Then, when the captured image of the back view monitor camera 1 is displayed on the display 9 later, the vehicle position detected by the vehicle position detection means 4 at that time and the vehicle direction detected by the vehicle direction detection means 5 are stored in the storage unit. If the vehicle position and the vehicle direction stored in association with the vehicle position are substantially coincident with each other, the display control unit 6 stores the vehicle position in association with the vehicle position and the vehicle direction. Information on the display position of the reference line stored in the unit 8 is read out, and the reference line is displayed at this display position.

  That is, in the back view monitor system of the present embodiment, the display control unit 6 has a function as “reference line display position changing means” and a function as “display control means”. Note that these functions by the display control unit 6 are realized by executing a control program stored in a ROM inside the display control unit 6, and details of processing by the display control unit 6 will be described later. .

  The operation input unit 7 is a user interface for a vehicle occupant to perform various inputs. For example, a centralized switch device having operation switches and a joystick, a touch sensor on a touch panel, and the like are used. The operation input for changing the above-mentioned reference line by the vehicle occupant is performed using the operation input unit 7, and a control signal corresponding to the operation input by the vehicle occupant is sent from the operation input unit 7 to the display control unit 6. Sent.

  The storage unit 8 stores information on the vehicle width line and the reference line to be superimposed on the photographed image of the back view monitor camera 1, and particularly in the back view monitor system of the present embodiment, as described above, the vehicle The information on the display position of the reference line changed according to the operation input by the passenger is associated with the vehicle position information and the vehicle orientation information at the time when the operation input for changing the display position is performed. It is stored in the storage unit 8.

  The display 9 displays a TV broadcast image received by the TV tuner 2 and a photographed image of the back view monitor camera 1 under the control of the display control unit 6. For example, the display 9 is displayed on the center console of the vehicle. An installed liquid crystal display (LCD) or the like is used. When some switches of the operation input unit 7 are touch sensors on the touch panel, some switches of the operation input unit 7 and the display 9 are configured as an integrated touch panel.

  In the back view monitor system of the present embodiment configured as described above, when the video switching unit 3 detects that the host vehicle has started to reverse by, for example, inputting a reverse signal, the video signal from the TV tuner 2 is detected. Is output, and the back view monitor camera 1 is operated to capture an image of the rear of the vehicle taken by the back view monitor camera 1 and display control of a video signal (composite signal) for displaying the image is displayed. Supply to part 6.

  When the video signal of the back view monitor camera 1 is supplied from the video switching unit 3, the display control unit 6 controls the display 9 to superimpose the vehicle width line and the reference line on the captured image of the back view monitor camera 1. I do. At this time, the display control unit 6 confirms the vehicle position and vehicle orientation at the present time, and when an operation for changing the display of the reference line by the vehicle occupant is performed at the same vehicle position and vehicle orientation in the past, The reference line is superimposed and displayed at the changed display position. A processing flow executed by the display control unit 6 at this time is shown in FIG.

  The processing flow shown in FIG. 2 is performed when the video switching unit 3 detects the start of backward travel of the host vehicle and the video switching unit 3 supplies the video signal of the back view monitor camera 1 to the display control unit 6. Be started. When the processing flow of FIG. 2 is started, the display control unit 6 first reads information on the current vehicle position detected by the vehicle position detection unit 4 in step S1, and in step S2, the vehicle orientation detection unit. The information of the current vehicle direction detected at 5 is read. Next, in step S3, the display control unit 6 searches the storage unit 8 to determine whether or not the storage unit 8 stores information on the vehicle position and vehicle orientation that substantially matches the current vehicle position and vehicle orientation. Confirm. As a result, when information on the vehicle position and the vehicle orientation that substantially matches the current vehicle position and vehicle orientation is stored in the storage unit 8, in step S4, the storage unit is associated with these vehicle position and vehicle orientation. 8 is read from the storage unit 8 and the process proceeds to step S6. The display position of the reference line read from the storage unit 8 in step S4 is the reference line that has been changed according to the operation input of the vehicle occupant when the host vehicle is facing in the same direction at the same place in the past. Is the display position.

  On the other hand, when the information on the vehicle position and the vehicle orientation that substantially matches the current vehicle position and vehicle orientation is not stored in the storage unit 8, the display control unit 6 is preliminarily defined as an initial value in step S5. The information on the display position of the reference line is read from the storage unit 8, and the process proceeds to the next step S6. In step S6, the display control unit 6 superimposes a reference line on the image behind the host vehicle captured by the back view monitor camera 1 at the display position read in step S4 or the display position read in step S5. If there is a vehicle width line and other necessary information, the information is superimposed and displayed on the display 9, and the series of guide line display control processing is terminated.

  In addition, the display control unit 6 superimposes the vehicle width line and the reference line on the captured image of the back view monitor camera 1 and displays them on the display 9 while the vehicle occupant uses the operation input unit 7 to display the reference line. When the operation input for changing the display position is received, the operation input by this occupant is accepted, the display position of the reference line is changed to the position desired by the occupant, and the reference line display position after the change Is stored in the storage unit 8 in association with the vehicle position and vehicle direction information at that time. The processing flow executed by the display control unit 6 at this time is shown in FIG. 3, and the transition of the screen displayed on the display 9 is shown in FIG.

  In the back view monitor system of the present embodiment, when the captured image of the back view monitor camera 1 is displayed on the display 9, as shown in FIG. 4A, the mode is shifted to the adjustment mode on the screen of the display 9. The “Adjust” button is displayed. When the “adjustment” button is pressed by the vehicle occupant and an item for changing the guide line display position is selected from the various selection items in the adjustment mode, the processing flow shown in FIG. Be started.

  When the processing flow of FIG. 3 is started, the display control unit 6 first reads information on the current vehicle position detected by the vehicle position detection unit 4 in step S11, and in step S12, the vehicle direction detection unit. The information of the current vehicle direction detected at 5 is read. Next, in step S13, the display control unit 6 causes the display 9 to display an adjustment screen as shown in FIG. 4B for adjusting the display position of the reference line. In the adjustment screen shown in FIG. 4 (b), a guideline that can be adjusted is displayed blinking, and the vehicle occupant moves the flashing guideline up / down / left / right using the joystick or the like of the operation input unit 7. After deciding, the display position of the reference line can be changed to an arbitrary position by pressing the “OK” button.

  Next, in step S14, the display control unit 6 determines whether or not the reference line adjustment operation by the occupant using the adjustment screen of FIG. 4B has been completed, for example, after the adjustment operation for all the reference lines, the “OK” button. When the reference line adjustment operation by the occupant is completed, the process proceeds to step S15, and a confirmation screen as shown in Fig. 4C is displayed on the display 9. Fig. 4C. In the confirmation screen shown in Fig. 4, "OK" and "NG" buttons are displayed together with a confirmation message, and the occupant of the vehicle presses the "OK" button to confirm the changed reference line display position. It has become.

  Next, in step S16, the display control unit 6 determines whether or not an operation for confirming the reference line display position by the occupant is performed on the confirmation screen of FIG. 4C, by using the “OK” button and the “NG” button. Judge which button was pressed. If the “NG” button is pressed by the vehicle occupant, the process returns to step S13 to display the adjustment screen again on the display 9 as shown in FIG. . On the other hand, when the “OK” button is pressed on the confirmation screen of FIG. 4C, the display control unit 6 displays the guide line 9 changed by the adjustment operation by the vehicle occupant in the next step S 17. The display position information above is stored in the storage unit 8 in association with the vehicle position information read in step S11 and the vehicle orientation information read in step S12.

  Then, in step S18, the display control unit 6 returns the display screen of the display 9 to the normal screen as shown in FIG. 4A, and sets the reference line at the display position after the change in the captured image of the back view monitor camera 1. In addition, the vehicle width line and other necessary information are superimposed and displayed on the display 9, and the series of guide line change control processing is terminated.

  As described above in detail, in the back view monitor system of the present embodiment, when the host vehicle is traveling backward, the reference line is superimposed on the captured image of the back view monitor camera 1 and displayed on the display 9. The operation input by the vehicle occupant for changing the display position of the reference line on the screen of the display 9 is received, and the vehicle position and the vehicle when the operation input for changing the display position of the reference line is performed. The azimuth is detected by the vehicle position detector 4 and the vehicle azimuth detector 5 respectively, and the information on the changed display position of the reference line is stored in the storage unit 8 in association with the vehicle position and vehicle azimuth information at that time. I am doing so. After that, if the host vehicle starts to run backward in the same location and in the same position as the operation input by the vehicle occupant for changing the display position of the reference line, it is detected at that time. Information on the display position of the changed guide line is read from the storage unit 8 on the basis of the information on the vehicle position and the vehicle direction, and the reference line is superimposed on the captured image of the back view monitor camera 1 at the changed display position. The information is displayed on the display 9.

  Therefore, in the back view monitor system according to the present embodiment, for example, the host vehicle is parked backward in a parking space where the vehicle occupant is familiar with the optimal parking position, such as a parking space at home or a parking space at work. At the time, it is possible to change the display position of the reference line so that it becomes a reference for properly parking the vehicle at the optimal parking position by the operation input of the passenger, and the display position of the reference line can be changed After the operation input by the occupant for the vehicle, when the vehicle is parked in the same position in the same position, the reference line can be displayed at the changed display position, improving the convenience of the vehicle occupant Can be made.

  In addition, when the host vehicle is parked in a backward running in a parking space where a part of the road surface is inclined, a distance deviation may occur in the inclined road surface portion in the captured image of the back view monitor camera 1. If the display position of the reference line is fixed at a predetermined position as shown in FIG. 6, it may be a factor that causes a sense of distance to be mistaken. However, in the back view monitor system of this embodiment, such special Even in a parking space, the reference line can be displayed at the optimal display position, and the convenience of the vehicle occupant can be improved.

  Note that the back view monitor system described above exemplifies an embodiment of the present invention, and the present invention is not limited to the above example, and various modifications can be made. is there. For example, in the above-described back view monitor system, when a photographed image of the normal back view monitor camera 1 is displayed on the display 9, when the “adjustment” button is pressed by a vehicle occupant, the screen is displayed on the adjustment screen. Transition is made and the display position of the reference line is changed by the vehicle occupant using the operation input unit 7 using this adjustment screen. However, if the vehicle is equipped with a ranging sensor For example, the distance measurement sensor starts measuring the distance in conjunction with the pressing of the “adjustment” button by the vehicle occupant, and the distance to the obstacle or wall in the parking space measured by the distance measurement sensor is adjusted. The display position of the reference line may be automatically changed.

(Second Embodiment)
Next, as another embodiment of the present invention, an example will be described in which the present invention is applied to a vehicle surrounding monitoring system that assists the traveling of a vehicle by selectively displaying captured images of a plurality of in-vehicle cameras on a display.

  FIG. 5 is a block diagram showing a schematic configuration of a vehicle surrounding monitoring system to which the present invention is applied. As shown in FIG. 5, the vehicle surrounding monitoring system according to the present embodiment includes a side view monitor camera 10 in addition to the back view monitor camera 1 as an in-vehicle camera. It is possible to selectively display on the display 9 a captured image of the rear side of the vehicle and an image of the rear of the vehicle captured by the back view monitor camera 1. In the vehicle surrounding monitoring system of the present embodiment, the configuration other than the side view monitor camera 10 and the basic control content of each part are the same as those of the back view monitor system of the first embodiment described above. Only parts different from the back view monitor system of the first embodiment will be described.

  The side view monitor camera 10 includes, for example, a small CCD camera similar to the back view monitor camera 1 and is installed in a shape embedded in a side mirror of the vehicle. The side view monitor camera 10 is also connected to the video switching unit 3 in the same manner as the back view monitor camera 1 and the TV tuner 2, and the video switching unit 3 performs power supply and output control. In the vehicle surrounding monitoring system of the present embodiment, for example, a composite signal that the video switching unit 3 sends to the display control unit 6 when a dedicated button for activating the side view monitor camera 10 is pressed by a vehicle occupant. By switching to the video signal from the side view camera 10, an image of the rear side of the vehicle photographed by the side view camera 10 is displayed on the display 9.

  Further, in the vehicle surrounding monitoring system of this embodiment, when the display control unit 6 receives a video signal from the side view camera 10, a reference line serving as a guide for the distance from the side end of the host vehicle is used. It has a function of reading information from the storage unit 8 and superimposing the reference line on the captured image of the side view monitor camera 10 and displaying it on the display 9. In particular, in the vehicle surrounding monitoring system of the present embodiment, the display control unit 6 receives an operation input by the vehicle occupant for changing the display position of the reference line to be superimposed on the captured image of the side view monitor camera 10, The reference line can be displayed at the display position desired by the vehicle occupant. In the vehicle surrounding monitoring system according to the present embodiment, the host vehicle then travels in the same posture in a place where an operation for changing the display position of the reference line to be superimposed on the captured image of the side view monitor camera 10 is performed. When the side view monitor camera 10 is activated at this time, the display control unit 6 displays the reference line superimposed on the captured image of the side view monitor camera 10 at the changed display position. .

  Specifically, the display control unit 6 displays the changed guide line when an occupant of the vehicle performs an operation for changing the display position of the guide line to be superimposed on the captured image of the side view monitor camera 10. The display position information is associated with the vehicle position information detected by the vehicle position detection unit 4 and the vehicle direction information detected by the vehicle direction detection unit 5 and the identification information of the side view monitor camera 10 at that time. The information is stored in the storage unit 8. Then, when the captured image of the side view monitor camera 10 is displayed on the display 9 later, the vehicle position detected by the vehicle position detection unit 4 at that time and the vehicle direction detected by the vehicle direction detection unit 5 are stored in the storage unit. 8 substantially matches the vehicle position stored in association with the vehicle position and the vehicle position stored in association with the vehicle position, and the identification information of the side view monitor camera 10 is associated with these vehicle position and vehicle direction. When the information is stored, the display control unit 6 reads out information on the display position of the reference line stored in the storage unit 8 in association with the vehicle position and the vehicle direction, and the reference line is displayed at the display position. Is displayed.

  Note that the display position change of the reference line to be superimposed on the captured image of the back view monitor camera 1 and the display control of the reference line after the change are basically the same as those of the back view monitor system of the first embodiment described above. It is. However, when the information on the display position of the reference line changed by the operation of the vehicle occupant is stored in the storage unit 8, the identification information of the back view monitor camera 1 is also stored, and the changed reference line is stored from the storage unit 8. When the display position is read, it is determined whether the identification information of the camera is matched in addition to the information on the vehicle position and the vehicle direction, and the display position of the changed guide line superimposed on the captured image of the back view monitor camera 1 is read. ing.

  FIG. 6 shows the vehicle surrounding monitoring system according to the present embodiment in which the display control unit 6 displays the reference line superimposed on the image captured by the back view monitor camera 1 or the image captured by the side view camera 10 and displayed on the display 9. It is a figure which shows the processing flow performed.

  The processing flow shown in FIG. 6 is started when the video signal of the back view monitor camera 1 or the video signal of the side view camera 10 is supplied from the video switching unit 3 to the display control unit 6. When the processing flow of FIG. 6 is started, the display control unit 6 first reads information on the current vehicle position detected by the vehicle position detection unit 4 in step S21, and in step S22, the vehicle direction detection unit. The information of the current vehicle direction detected at 5 is read. In step S23, the display control unit 6 determines the source of the video signal sent from the video switching unit 3, that is, the type of the in-vehicle camera currently in use.

  Next, in step S24, the display control unit 6 searches the storage unit 8 to substantially match the current vehicle position and vehicle direction, and is associated with identification information indicating the currently used in-vehicle camera. It is confirmed whether or not information on the vehicle position and the vehicle direction is stored in the storage unit 8. As a result, when the storage unit 8 stores information on the vehicle position and the vehicle direction that substantially matches the current vehicle position and the vehicle direction and is associated with the identification information indicating the on-vehicle camera currently in use. In step S25, information on the display position of the guide line associated with these vehicle position, vehicle orientation, and identification information and stored in the storage unit 8 is read from the storage unit 8, and the process proceeds to step S27. The display position of the reference line read from the storage unit 8 in step S25 is the position of the vehicle occupant when the host vehicle is facing in the same direction at the same place while displaying the captured image of the same in-vehicle camera in the past. This is the display position of the reference line changed according to the operation input.

  On the other hand, when the information on the vehicle position and the vehicle direction that is substantially coincident with the vehicle position and the vehicle direction and is associated with the identification information indicating the currently used in-vehicle camera is not stored in the storage unit 8, In step S26, the control unit 6 reads information on the display position of the reference line that is defined in advance as an initial value from the storage unit 8, and proceeds to the next step S27. Then, in step S27, the display control unit 6 displays the display position read in step S25 or the display read in step S26 on the photographed image of the in-vehicle camera (back view monitor camera 1 or side view camera 10) currently in use. A guide line is superimposed on the position and displayed on the display 9, and a series of guide line display control processing is terminated.

  FIG. 7 shows a vehicle surrounding monitoring system according to the present embodiment, in which the reference line is superimposed on the image captured by the back view monitor camera 1 or the image captured by the side view camera 10 and displayed on the display 9. FIG. 10 is a diagram illustrating a processing flow executed by the display control unit 6 when an occupant performs an operation input for changing the display position of the reference line using the operation input unit 7.

  In the processing flow shown in FIG. 7, for example, as in the first embodiment described above, the “adjustment” button on the screen of the display 9 as shown in FIG. This is started by selecting an item for changing the reference line display position from among the various selection items. When the processing flow of FIG. 7 is started, the display control unit 6 first determines the source of the video signal sent from the video switching unit 3, that is, the type of the in-vehicle camera currently in use, in step S31. The display control unit 6 reads information on the current vehicle position detected by the vehicle position detection unit 4 in step S32, and information on the current vehicle direction detected by the vehicle direction detection unit 5 in step S33. Is read.

  Next, in step S34, the display control unit 6 causes the display 9 to display an adjustment screen as shown in FIG. 4B for adjusting the display position of the reference line. In step S35, it is determined whether or not the reference line adjustment operation by the occupant using the adjustment screen has been completed, and when the reference line adjustment operation by the occupant has been completed, the process proceeds to step S36 and the display 9 displays FIG. A confirmation screen as shown in c) is displayed.

  Next, in step S37, the display control unit 6 determines whether or not an operation for confirming the reference line display position is performed by the occupant on the confirmation screen, and the operation for confirming the reference line display position must be performed. For example, the process returns to step S34 to display the adjustment screen on the display 9 again, and prompts the user to adjust the reference line. On the other hand, when the operation for determining the reference line display position is performed, the display control unit 6 determines the display position on the display 9 of the reference line changed by the adjustment operation by the vehicle occupant in the next step S38. The information is stored in the storage unit 8 in association with the identification information of the vehicle camera currently in use determined in step S31, the vehicle position information read in step S32, and the vehicle orientation information read in step S33. .

  Then, in step S39, the display control unit 6 returns the display screen of the display 9 to the normal screen as shown in FIG. 4A, and uses the display position after the change to the captured image of the vehicle camera currently in use. The lines are superimposed and displayed on the display 9, and a series of guideline line change control processing ends.

  As described above in detail, in the vehicle surrounding monitoring system of the present embodiment, when the reference line is superimposed on the captured image of the back view monitor camera 1 or the side view camera 10 and displayed on the display 9, The vehicle when the operation input by the vehicle occupant for changing the display position of the reference line on the screen of 9 is received, and the operation input by the vehicle occupant for changing the display position of the reference line is performed The position and the vehicle direction are detected, and the information on the display position of the changed reference line is stored in the storage unit 8 in association with the vehicle position and vehicle direction information at that time and the identification information of the in-vehicle camera used. I try to let them. After that, when the host vehicle is traveling in the same position as the place where the operation input by the vehicle occupant for changing the display position of the reference line is performed, the captured image of the same in-vehicle camera is displayed. In this case, the information on the display position of the changed guide line is read from the storage unit 8 based on the vehicle position and vehicle orientation information detected at that time and the identification information of the in-vehicle camera, and the captured image of the in-vehicle camera is read out. Since the reference line is superimposed on the display position after being changed to be displayed on the display 9, the display position of the reference line is set to the current position of the vehicle as in the back view monitor system of the first embodiment described above. Therefore, the convenience of the vehicle occupant can be improved.

  The vehicle surrounding monitoring system described above exemplifies an embodiment of the present invention, and the present invention is not limited to the above example, and various modifications can be made. is there. For example, in the above example, two types of cameras, the back view monitor camera 1 and the side view camera 10, are used as the in-vehicle cameras. The present invention can also be effectively applied to a vehicle surroundings monitoring system which is displayed on the display 9.

It is a block diagram which shows schematic structure of the back view monitor system to which this invention is applied. It is a flowchart which shows the flow of the process of the reference line display control performed by the display control part in the back view monitor system to which this invention is applied. It is a flowchart which shows the flow of the process of the reference | standard line change control performed by the display control part in the back view monitor system to which this invention is applied. It is a figure showing the screen transition of the display screen of reference line change control, (a) is a display example of a normal screen, (b) is a display example of an adjustment screen, (c) is a display example of a confirmation screen, respectively. FIG. It is a block diagram which shows schematic structure of the vehicle periphery monitoring system to which this invention is applied. 6 is a flowchart showing a flow of guide line display control processing executed by a display control unit in a vehicle periphery monitoring system to which the present invention is applied. 6 is a flowchart showing a flow of guide line change control processing executed by a display control unit in a vehicle surroundings monitoring system to which the present invention is applied.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Back view monitor camera 4 Vehicle position detection part 5 Vehicle direction detection part 6 Display control part 8 Memory | storage part 9 Display 10 Side view monitor camera

Claims (4)

In an image display system that displays on a display device a reference line that is a guideline for a distance from a vehicle end on a captured image of a vehicle-mounted camera mounted on a vehicle,
Vehicle position detecting means for detecting a vehicle position which is a current position of the vehicle;
Guide line display position changing means for changing the display position of the guide line on the screen of the display device in response to an operation input by a vehicle occupant;
Information on the display position of the guide line changed by the guide line display position changing means is detected by the vehicle position detecting means when an operation input by a vehicle occupant for changing the display position of the guide line is performed. Storage means for storing in association with the information on the vehicle position,
When the vehicle position detected by the vehicle position detection means substantially coincides with any of the vehicle positions stored in the storage means, the reference stored in the storage means in association with the vehicle position information An image display system comprising: display control means for reading information on a display position of a line and displaying the reference line at the display position. A plurality of cameras as the in-vehicle camera,
The storage means stores the information on the display position of the reference line changed by the reference line display position changing means when the operation input by the vehicle occupant for changing the display position of the reference line is performed. The information on the vehicle position detected by the detection means and the identification information of the camera used when the operation input by the vehicle occupant for changing the display position of the reference line is stored in association with the information.
The display control means substantially matches the vehicle position detected by the vehicle position detection means with any of the vehicle positions stored in the storage means, and identifies the storage position in association with the vehicle position. When using a camera storing information, information on the display position of the reference line stored in the storage means in association with the vehicle position information and the camera identification information is read and displayed. The image display system according to claim 1, wherein the reference line is displayed at a position. Vehicle azimuth detecting means for detecting a vehicle azimuth that is the direction the vehicle is facing;
The storage means stores the information on the display position of the reference line changed by the reference line display position changing means when the operation input by the vehicle occupant for changing the display position of the reference line is performed. The vehicle position information detected by the detection means is associated with the vehicle direction information detected by the vehicle direction detection means when an operation input by a vehicle occupant for changing the display position of the reference line is performed. Remember,
The display control unit associates the vehicle position detected by the vehicle position detection unit and the vehicle direction detected by the vehicle direction detection unit with any vehicle position stored in the storage unit and the vehicle position. When the vehicle orientation substantially matches the vehicle orientation stored in the storage means, the vehicle position information and the reference line display location information stored in the storage means in association with the vehicle orientation information are read out. The image display system according to claim 1, wherein the reference line is displayed at the display position. An image display method for displaying on a display device by superimposing a guide line that is a guide for a distance from a vehicle end on a captured image of an in-vehicle camera mounted on a vehicle,
A first step of receiving an operation input by a vehicle occupant for changing the display position of the reference line on the screen of the display device;
A second step of detecting a vehicle position when an operation input by a vehicle occupant for changing the display position of the reference line is performed;
A third step of storing information on the display position of the reference line changed in the first step in a storage unit in association with the information on the vehicle position detected in the second step;
When the current position of the vehicle substantially coincides with any vehicle position stored in the storage means, information on the display position of the reference line stored in the storage means in association with the information on the vehicle position And a fourth step of displaying the reference line at the display position.

Images