WO2006006689A1

WO2006006689A1 - Display system, vehicle, display method, display program and storage medium thereof

Info

Publication number: WO2006006689A1
Application number: PCT/JP2005/013094
Authority: WO
Inventors: Aki Miake; Takeshi Yamamoto; Megumi Itoh; Toshiya Takahashi
Original assignee: Sharp Kabushiki Kaisha
Priority date: 2004-07-12
Filing date: 2005-07-08
Publication date: 2006-01-19
Also published as: JP2007223338A

Abstract

An object of the present invention is to provide a display system capable of easily and accurately recognizing a view in front of a vehicle, as well as views of a left rear side or right rear side of the vehicle or the like with respect to a traveling direction. To attain this object, the image (18e) in front of the vehicle and the images (18a and 18b) of the left rear side and the right rear side of the vehicle with respect to the traveling direction are taken by an imaging section, and are displayed on a display panel (10).

Description

DESCRIPTION

DISPLAY SYSTEM, VEHICLE, DISPLAY METHOD, DISPLAY PROGRAM AND STORAGE MEDIUM THEREOF

TECHNICAL FIELD The present invention relates to a display system mounted to a vehicle, a vehicle in which the display system is mounted, a display method, a display program, and a storage medium of the display program. Here, a vehicle refers to any transporting means.

BACKGROUND ART

A vehicle, such as an automobile, is equipped with an instrument panel showing traveling conditions such as a speedometer or the like. In recent years, a new instrument panel is proposed in order to display not only an instrumental information such as a speedometer, but also images pictured by cameras provided in a vehicle .

For example, Japanese Laid-Open Patent Publication No. 123848 / 1997 (Tokukaihei 1997- 123848 , publication date :

May 13 , 1997) discloses an instrument panel capable of switching the display content between right rear view and left rear view depending on operation of the indicator when the vehicle changes the traveling direction. In the structure of this publication, regardless of the direction of the driver' s eye , the left rear view or right rear view is displayed in a portion of right side of a display area of a wide-screen. Further, Japanese Laid-Open Patent Publication No.

257482 / 1998 (Tokukaihei 1998-257482 , publication date: September 25, 1998) discloses a structure of constantly displaying an image of rear view in a screen.

Further, Japanese Laid-Open Patent Application No. 392 17/ 2001 (Tokukai 2001 -392 17, publication date: February,

2001 ) discloses a structure in which a display device is not contained in the instrument panel. This structure uses a monitor that displays an image of left rear view or right rear view in accordance with the direction of the driver's eye. Further, Japanese Laid-Open Patent Publication No .

84500 / 2001 (Tokukai 2001 -84500, publication date: March 31 , 2001 ) discloses a technique for displaying a right-side view showing the right side of a vehicle (a view taken from the right front side of a driver) , and a left-side view showing the left side of a vehicle (a view taken from the left front side of a driver) with respect to the traveling direction. This publication describes displaying not only a right or left view, but also an image including a front view that shows the traveling direction of the vehicle . Further, Japanese Laid-Open Patent Publication No. 195056/ 1994 (Tokukaihei 1994- 195056, publication date : July 15 , 1994) discloses a technique for displaying respective images of the left rear view and the right rear view of the vehicle, respective images of the left front view and the right front view of the vehicle , or respective images of the left rear view, the right rear view, and the rear view of the vehicle. These images are displayed in a divided screen .

However, in the image display in these conventional structures, the drivers cannot always fully rely on the display in driving their vehicles.

For example, when the vehicle moves from a traveling lane (left lane) into a passing lane (right lane) , a driver has to check the safety of the front direction, as well as the rear to right front direction. This is because, for example, a vehicle running ahead of the vehicle may slow down either gradually or suddenly, even when no vehicle is approaching from the right rear direction.

However, with the conventional techniques, there is a difficulty in simultaneously displaying a front view and a view of a direction in which the vehicle turns (e.g. from the rear to right front direction) .

Accordingly, the drivers using these systems need to pay attention by their own eyes the front direction, while checking views shown in a display. In this case , the driver is required not only to move their eyes but also to change the focal distance . This has been a burden on the driver.

DISCLOSURE OF INVENTION

The present invention was made in view of the above problems, and an object of the present invention is to provide :

(i) a display system capable of easily and accurately recognizing a view in front of a vehicle, as well as views of a left rear side or right rear side of the vehicle with respect to a traveling direction; (ii) a vehicle in which the display system is mounted; (iii) a display method; (iv) a display program; and

(v) a storage medium of the display program. Here, a vehicle refers to any transporting means.

To attain the foregoing object, the display system of the present invention includes, an imaging section taking an image in a vicinity of a vehicle, the imaging section taking at least a front image, that is an image in front of the vehicle, and a left rear image and a right rear image which are images to a left rear side and to a right rear side of the vehicle with respect to a traveling direction; a display section displaying an image taken by the imaging section, and a control section for causing the display section to display the front image, and either of the left rear image or the right rear image.

As used herein, the vehicle includes any mode of transporting means such as an automobile, a two-wheeled vehicle, a bicycle, a helicopter, aircraft, or a vessel. The left rear image of the vehicle with respect to a traveling direction may be an image including the left side view of the vehicle . In a similar manner, the right rear image of the vehicle with respect to a traveling direction may be an image including the right side view of the vehicle . For example, images including the left rear side view and the right rear side view can be taken by the imaging section provided close to the right and left edges of the vehicle with respect to a traveling direction. Also, the front image in a traveling direction may include the left front view and the right front view of the vehicle.

According to the arrangement, the imaging section takes an image in front of the vehicle in a traveling direction, and images of the left rear side and the right rear side of the vehicle . Then, the control section causes the display section to display the front image and the left rear or right rear image simultaneously.

This allows a driver to easily check the front image of the vehicle with respect to a traveling direction, and the left rear or right rear image of the vehicle . That is, the front image and the left rear or right rear image are simultaneously displayed in the display section, thereby reducing eye movement and change in focal distance of the driver when viewing the information. On this account, the driver is able to check the information in a shorter time, which improves the driver's safety, and also he/ she is immune to burdens of frequent eye movement and change in focal distance. In addition, because the left rear and the right rear images are not displayed simultaneously, the driver will not refer to a wrong image.

Further, when the front image and the left rear image are displayed, the control section controls the display section so that the front image is displayed in a region adj acently provided on the right of a display region for the left rear image when viewed from a displaying direction of the display section, and, when the front image and the right rear image are displayed, the control section controls the display section so that the front image is displayed in a region adjacently provided on the left of a display region for the right rear image when viewed from a displaying direction of the display section.

According to the arrangement, the front image and the left rear or right rear image are displayed in the regions adjacently provided each other. Therefore, the eye movement of the driver in checking the images is reduced, so that the driver can perceive the images easily and securely.

Further, the driver can perceive the shooting directions easily and securely, because the left rear image is displayed on the left side of the front image and the right rear image is displayed on the right side of the front image. Further, a shooting range of the front image and a shooting range of the left rear or right rear image are in contact or overlap with each other.

According to the arrangement, the driver can confirm the safety more accurately, because there is no dead zone between the front image and the left rear or right rear image.

Further, the control section controls shapes of the display regions for the left rear image and the right rear image in accordance with their positions relative to the vehicle .

In this case, the driver can comprehend the position of the left rear or right rear image relative to the vehicle, based on a shape of a display region. For example, the driver can instinctively recognize which direction is closer to the vehicle between the display regions for the left rear image and the right rear image, based on a shape of a display region.

Further, the control section controls shapes of the display regions for the left rear image and the right rear image in accordance with their positions relative to the vehicle . In this case, the driver can recognize the displayed right rear or left rear image like viewing an image in a mirror.

That is, when driving an automobile, for example , the driver can recognize the left rear or right rear image as if he/ she checks conditions of the left rear or right rear direction with a door mirror. Further, the control section causes the display section to display, in a part of the left rear image and the right rear image, an image of the vehicle or an image indicating a position of the vehicle . In this case, with the indication appeared in the left rear or right rear image, the driver can recognize an accurate relative position to the vehicle easily.

Further, the display system includes a direction indication detecting sensor for detecting a previous notice of changing a traveling direction of the vehicle, wherein the control section causes the display section to display one of the left rear image and the right rear image corresponding to the previous notice, together with the front image . For example , the front image and the right rear image in the traveling direction may be displayed when giving a previous notice for moving into the right lane . Similarly, the front image and the left rear image in the traveling direction may be displayed when giving a previous notice for moving into the left lane .

According to the arrangement, when the direction indication sensor detects a previous notice of changing a traveling direction from the driver, the display section displays one of the rear image and the right rear image corresponding to the previous notice, together with the front image . This allows the driver to easily check, together with the front image, one of the left rear image and the right rear image corresponding to a direction in which the vehicle turns, thereby allowing the driver to check the views around the vehicle in changing the traveling direction.

Further, the display system includes an object sensor for detecting a presence or absence of an object in a vicinity of the vehicle, wherein, according to a detection result of the object sensor, the control section causes the display section to display, together with the front image, one of the left rear image and the right rear image corresponding to a direction where an obj ect was found.

According to the arrangement, the driver can check conditions of the front direction while monitoring movement of a detected object.

Further, the display system includes location detecting means for detecting a current location of the vehicle; and means for previously setting a point at which the vehicle changes its direction and a direction in which the vehicle turns, wherein the control section causes the display section to display, together with the front image, one of the left rear image and the right rear image according to the direction in which the vehicle turns, when a distance between the current location of the vehicle and the point at which the vehicle changes its direction becomes equal to or shorter than a predetermined value. According to the arrangement, the driver can check, together with the front image, one of the left rear image and the right rear image corresponding to a direction in which the vehicle turns in an appropriate timing, according to a previously notified location and a direction to move in. Further, the display system includes an operation section for receiving an instruction from the driver regarding an image to be displayed on the display section, wherein the control section causes the display section to display one of the left rear image and the right rear image in accordance with the instruction received in the operation section.

In this case, the driver can controls the display section to display the front image and the left rear or right rear image as appropriate .

Further, the control section causes the display section to display an instrument image showing conditions of the vehicle . In this case, the driver can recognize conditions of the vehicle, which are necessary for driving the vehicle, based on the instrument image . Also, a frequency of eye movement or change in focal distance of the driver can be reduced, because the instrument images, the front image, and the left rear or right rear image are displayed on a single display section.

Further, the control section causes the display section to display an instrument image showing a traveling speed of the vehicle . Information related to a traveling speed is important when driving a vehicle, and the driver has to check the information frequently. In this view, according to the arrangement, the instrument image showing a traveling speed, the front image, and the left rear or right rear image are displayed on the same display section, thereby reducing frequency of eye movement or change in focal distance of the driver while driving.

To solve the foregoing problems, the vehicle of the present invention includes the display system according to any one of claims 1 through 12.

According to the arrangement, the driver is allowed to check the information with less eye movement and less change in focal distance, which are accompanied by checking the front image and the left rear or right rear image . On this account, the driver is able to check the information in a shorter time , which improves the driver's safety, and also he/ she is immune to burdens on the driver of frequent eye movement and change in a focal distance .

To solve the foregoing problems, the display method of the present invention causes a display device, which is mounted to a vehicle, to take an image in a vicinity of a vehicle and display the image in the display device, the display method comprising the step of: taking an image in front of the vehicle and an image of a left rear side or a right rear side of the vehicle with respect to a traveling direction; and displaying the image in front of the vehicle and the image of a left rear side or a right rear side in the display device .

According to the display method, the front image and the left rear or right rear image are simultaneously displayed on the display device .

This allows the driver to easily check the front image of the vehicle with respect to a traveling direction, and the left rear or right rear image of the vehicle . That is, the front image and the left rear or right rear image are simultaneously displayed in the display section, thereby reducing eye movement and change in focal distance of the driver when viewing the information. On this account, the driver is able to check the information in a shorter time, which improves the driver's safety, and also he / she is immune to burdens of frequent eye movement and change in focal distance.

To solve the foregoing problems, the display program of the present invention causes a computer in a display system to function as a control section of the display system according to any one of claims 1 through 12. By causing the computer to read out the program, processing of the control section in the display system is realized by the computer.

Further, by storing the program in a storage medium readable by the computer, storage and distribution of the program can be facilitated . Further, by causing the computer to read the program from the storage medium, processing of the control section in the display system is realized by the computer.

The following description will be given for fuller understanding of the nature and advantages of the invention.

BRIEF DESCRIPTION OF DRAWINGS

Figure l (a) is a plan view illustrating an exemplary display state on normal driving in a display system of the present invention.

Figure l (b) is a plan view illustrating an exemplary display state when the vehicle turns right or moves into the right lane, in the display system of the present invention.

Figure l (c) is a plan view illustrating an exemplary display state when the vehicle turns left or moves into the left lane, in the display system of the present invention.

Figure 2 is a block diagram illustrating an exemplary structure of the display system of the present invention.

Figure 3 is a plan view illustrating an exemplary positions of cameras mounted to a vehicle, in the display system of the present invention.

Figure 4 is a plan view illustrating respective shooting ranges of the cameras mounted to the display system of the present invention. Figure 5 is a perspective view illustrating an exemplary layout of the display panel mounted to the display system of the present invention.

Figure 6 is a perspective view illustrating another exemplary layout of the display panel mounted to the display system of the present invention.

Figure 7 is a perspective view illustrating still another exemplary layout of the display panel mounted to the display system of the present invention.

Figure 8(a) is a plan view illustrating an exemplary display state when the vehicle turns right or moves into the right lane in the display system of the present invention.

Figure 8 (b) is a plan view illustrating an exemplary display state when the vehicle turns left or moves into the left lane in the display system of the present invention. Figure 9 is a plan view illustrating examples of respective positions and shooting ranges of the cameras mounted to the display system of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION The following will describe an embodiment of the present invention. Figure 2 is a block diagram illustrating a schematic structure of a display system 1 according to the present embodiment. As shown in Figure 2, a display system 1 includes an operation section 2 , a control section 3 , an imaging section 4 , a display device 5, an object sensor 6, and a transmission/ reception section 7. Note that, the display system 1 of the present embodiment is mounted to an automobile .

The operation section 2 detects a user's operation and informs the control section 3 of the enforcement of operation.

The operation section 2 includes a handle sensor 2a, a brake sensor 2b, an accelerator sensor 2c, an indicator sensor

(direction-indicator detection sensor) 2d, and a camera switch

( camera-ON instruction device) 2e . The handle sensor 2a, the brake sensor 2b, the accelerator sensor 2c, and the indicator sensor 2d detect user ' s instructions to a handle, a brake , an accelerator, and a turn signal (direction indicator) , which are used for operation of the automobile (vehicle) equipped with the display system 1. The camera switch 2e is an image switching section for selecting a desired image for display from images stored in cameras provided in the imaging section 4.

The control section 3 is a main part of the display system 1 , which controls all operations of the display system 1 .

The imaging section 4 takes images presenting conditions around the vehicle, and feeds the captured image data to the display device 5 through the control section 3. The imaging section 4 includes cameras 4a to 4e mounted on different parts of the vehicle, as shown in Figure 3. The camera 4a is provided at the left front of the vehicle with respect to a traveling direction D (front) of the vehicle so as to capture a leftward view and a left-rear view of the vehicle . Note that, the camera 4a can also capture a dead zone of a door mirror (fender mirror) 2 1 a.

The camera 4c is provided at the left rear of the vehicle with respect to the traveling direction D of the vehicle . The camera 4c can captures a rear region including both the immediately behind and the left rear of the vehicle . That is, the cameras 4a and 4c are left-rear-side imaging cameras for capturing a left rear view in the traveling direction D . Note that, "left rear side" means a region including the left to the rear side of the vehicle .

The camera 4b is provided at the right front of the vehicle with respect to the traveling direction D of the vehicle so as to capture a rightward view and a right-rear view of the vehicle . Note that, the camera 4b can also capture a dead zone of a door mirror (fender mirror) 2 1 b.

The camera 4d is provided at the right rear of the vehicle with respect to the traveling direction D of the vehicle. The camera 4d can capture a rear region including both the immediately behind and the right rear of the vehicle.

That is, the cameras 4b and 4d are right-rear-side imaging cameras for capturing a right rear view in the traveling direction D . Note that, "right rear side" means a region including the right to the rear side of the vehicle .

The camera 4e is provided at the front of the vehicle so as to capture a front view of the vehicle .

According to the present embodiment, the cameras 4a to 4e are equipped with wide-angle lenses capable of capturing all views in a range of predetermined angel (e.g. approximately 120°) . Further, the cameras 4a to 4e capture views in a range of predetermined angle, with respect to a direction substantially horizontal to the ground level. Figure 4 illustrates shooting ranges (shooting angles) for images of the left rear (left rear side) , right rear (right rear side) , and the front of a vehicle , which are captured by the cameras 4a, 4b, and 4e, respectively. Note that, Figure 4 shows not the shooting distances but the shooting angles of the cameras 4a, 4b, and 4e .

In accordance with an instruction from the control section 3 , the display device 5 displays instrumental images such as a speedometer, or image data fed from the imaging section 4 which takes images presenting conditions around of the vehicle . Note that, according to the present embodiment, a liquid crystal display is used as the display device 5. The display device 5 will be described later in detail.

The object sensor 6 is used for detecting the presence or absence of an object around the vehicle . The object sensor 6 of the present embodiment detects the presence or absence of an object around the vehicle by projecting an ultrasonic wave to a predetermined direction, and detecting reflection of the proj ected supersonic wave. Note that, the obj ect sensor 6 is not limited to this. For example, the obj ect sensor 6 may determine the presence or absence of an obj ect through predetermined image processing or image extraction with respect to images taken by the imaging section 4. For example, it is possible to recognize the presence or absence of an automobile or two-wheeled vehicle around the vehicle by extracting any images of automobiles or two-wheeled vehicles from the captured images.

The display system 1 also includes other various sensors (not shown) for, for example, measuring data such as a speed of the vehicle (traveling speed) , counting the number of engine rotations, detecting condition of shift lever, checking a temperature of cooling water, and detecting remaining amount of fuel, and transmits these data items to the control section 3. The control section 3 outputs the data having been transmitted thereto to the display device 5, thereby causing the display device 5 to display images showing the results detected by the sensors .

The transmission / reception section (position detecting means) 7 serves as a navigation information transmission/ reception section which acquires positional information of the vehicle from a navigation information transmitting station 30. In the display system 1 , the control section 3 serves as a so-called navigation system, which provides a driver with information in which the current positional information of the vehicle is associated with map information. The current positional information is detected through the transmission/ reception section 7 , and the map information is stored in memory means (not shown) . This navigation system allows the control section (route setting means) 3 to perform search for an optimum route with setting of a starting point and a destination, for example .

The following describes the display device 5 of the present embodiment in detail. The display device 5 is a liquid crystal display employing a flat panel display (FPD) as an instrument panel. As shown in Figure 2 , the display device 5 includes a controller (display control section) 8a, an input section 8b, an image processing device (image processing section) 9 , and a display panel (display section) 10.

The controller 8a controls the display device 5. More specifically, the controller 8a outputs data having been transmitted thereto the display panel 10 through the image processing device 9 , thereby causing the display panel 10 to display the data. For example, the controller 8a causes the display panel 10 to show: (i) speed data of the vehicle transmitted from a sensor (not shown) ; (ii) images around the vehicle taken by the imaging section 4 ; or (iii) navigation information.

Further, the controller 8a causes the display panel 10 to display image data captured by cameras 4a to 4e of the imaging section 4 in accordance with an instruction of the control section 3.

The input section 8b is a user interface of the display device 5. The input section 8b allows adjustment and control of display conditions on the screen. For example, with the input section 8b, it is possible to instruct whether or not to perform mirror inversion on an image of the rear side of the vehicle.

The image processing device 9 performs image processing of the image data having been transmitted thereto . This image processing is, for example, mirror inversion, change in display position of contents etc . For example, when the input section 8b detects an instruction for mirror-inversion of an image of the rear side of the vehicle , the image processing device 9 performs mirror inversion of the image data captured by the imaging section 4 and outputs the inverted image data.

Further, the image processing device 9 performs image processing of image data which are taken by the imaging section and transmitted from the controller 8a, thereby causing the display panel 10 to carry out display of the image data in a different manner depending on the shooting direction. For example, the image processing device 9 changes display layout of the instrument images, by displaying instrument images in different layout. The display panel 10 serves to carry out display of image data. The display panel 10 measures greater in width than in height with an aspect ratio of 8 : 3 or greater (the width is at least eight-third times the height) . This provides improvement in visibility when simultaneously displaying secondary images such as an navigation image, and vehicle condition images presenting the conditions of the vehicle (speed, remaining amount of fuel, etc.) .

Figure 5 illustrates an exemplary structure of the interior of an automobile (vehicle) to which the display system 1 is mounted. As shown in Figure 5, the display panel 10 is mounted to an automobile as an instrument panel for displaying instrument images such as a speedometer, views around the vehicle taken by the imaging section 4, navigation information, or the like . In reference to Figures l (a) through l (c) , the display panel 10 of the display device 5 is described below in detail. Figure l (a) is a plan view illustrating an exemplary display state of the display panel 10 under general traveling condition (traveling straight ahead) . Figure l (b) is a plan view illustrating an exemplary display state of the display panel 10 when turning right or moving into the right-hand lane . Figure l (c) is a plan view illustrating an exemplary display state of the display panel 10 when turning left or moving into the left-hand lane. As shown in Figure l (a) , the display device 5 displays a speedometer 1 1 , gear position (a state of the shift lever) 12 , a tachometer 13 , a thermometer 14 , a fuel gauge 15 , and a navigation information 16, as instrument images. Note that, under general traveling condition (e .g. when traveling straight ahead) , the display panel 10 does not displays images around the vehicle.

The speedometer 1 1 shows a speed of the vehicle detected by a speed sensor (not shown) . The speedometer 1 1 may show instrument information either in the form of image of the meter or numerical values. According to the present embodiment, only a single speedometer 1 1 is displayed, however, the display panel 10 may displays another speedometer, which is constantly shown in the screen at a fixed position, for example . In a similar manner, the gear position 12 , the tachometer 13 , the thermometer 14, and the fuel gauge 15 show a position of the shift lever, the number of engine rotations, a temperature of the cooling water, remaining amount of fuel, respectively, which are detected by the various sensors (not shown) . Note that, the instrument images are displayed on the display panel 10 of the display device 5 in different layouts. For example, other instruments than those above may be displayed, or some of the instruments may not be displayed. Kinds of instrument images to be displayed and display positions may be varied according to conditions of the vehicle or the driver's instructions.

In such a display system 1 , when the driver operates the indicator (direction indicator) during driving so that the right indicator blinks, the control section 3 causes the display section 10 to display a right rear image 18b and a front image

18e . Here , the front image 18e is displayed on the left of the right rear image 18b as shown in Figure l (b) .

More specifically, when the driver operates the indicator (the driver gives notice of changing direction) , the indicator sensor 2d first detects the signal and transmits it to the control section 3. The control section 3 determines for which direction the driver operated the indicator (the direction in which the vehicle turns) .

When the right indicator flashes to indicate that the vehicle turns right, the control section 3 causes the display panel 10 to display a right rear image (right-side and right-rear-side images) 18b captured by the camera 4b, and the front image (the view in front of the vehicle) 18e captured by the camera 4e . In an example illustrated in Figure l (b) , when operating the indicator to flash for the right direction, the display panel 10 displays the right rear image 18b, the front image 18e , a right-turn indication signal 17, the speedometer 1 1 , the gear position 12 , the thermometer 14 , and the fuel gauge 15 (in this order from the right edge of the screen) . In this display, the tachometer 13 and the navigation information 16, which are shown in Figure l (a) , disappear due to image processing by the image processing device 9.

On the other hand, in the display system 1 , when the driver operates the indicator (direction indicator) during driving so that the right indicator blinks, the control section

3 causes the display section 10 to display a left rear image 18a and the front image 18e . Here, the front image 18e is displayed on the left of the left rear image 18e as shown in Figure l (c) . More specifically, when the driver operates the indicator

(the driver gives notice of changing direction) , the indicator sensor 2d first detects the signal and transmits it to the control section 3. The control section 3 determines for which direction the driver operated the indicator (the direction in which the vehicle turns) .

When the left indicator flashes to the left direction to indicate that the vehicle turns left, the control section 3 causes the display panel 10 to display a left rear image (left-side and left-rear-side images) 18a captured by the camera 4a, and the front image (the view in front of the vehicle) 18e captured by the camera 4e . In an example illustrated in Figure l (c) , when operating the indicator to flash for the left direction, the display panel 10 displays the left rear image 18a, the front image 18e, the left-turn indication signal 17, the speedometer 1 1 , the gear position 12 , the thermometer 14 , and the fuel gauge 15 (in this order from the left edge of the screen) . In this display, the tachometer 13 and the navigation information 16, which are shown in Figure l (a) , disappear due to image processing by the image processing device 9.

As described above , the display system 1 of the present embodiment is equipped with the cameras 4e, 4b, and 4a, which capture the front image 18e, the right rear image 18b, and the left rear image 18a, respectively. When the indicator is operated, the rear image and the front image are displayed simultaneously in accordance with the indicated direction . This allows the driver to easily check conditions of the front and the left rear (left side and left rear side) or right rear (right side and right rear side) of the vehicle. That is, the front image 18e , and the left rear image 18a or the right rear image 18b are simultaneously displayed on the display panel 10, thereby allowing the driver to check the information with less eye movement and less change in focal distance. On this account, the driver is able to check the information in a shorter time , which improves the driver's safety, and also he / she is immune to burdens of frequent eye movement and change in focal distance.

In the example illustrated in Figure l (b) , the front image 18e is provided in substantially front of the driver, and the right rear image 18b is provided on the right hand side of the driver. In an example illustrated in Figure l (c) , the front image 18e is provided in substantially front of the driver, and the left rear image 18a is provided on the left hand side of the driver. In this arrangement in which the right rear image is displayed at the right hand side of the driver, the left rear image is displayed at the left hand side of the driver, and the front image is displayed in substantially front of the driver, the driver more easily instinctively recognizes shooting directions of the images.

However, the display images can be provided in different layouts on the display panel 10. For example, as shown in Figure l (a) , the speedometer 1 1 , the gear position 12 , the thermometer 14, and the fuel gauge 15 may be displayed at fixed positions. Then, in the left portion of the display panel

10, the right rear image 18b is displayed in place of the tachometer 13, and the front image 18e is displayed in place of the navigation information 16. Still another arrangement may be that the front image 18e is displayed in place of the tachometer 13, and the left rear image 18a is displayed in place of the navigation information 16. In this case, because the instrument images such as the speedometer 1 1 are displayed at fixed positions, the driver can easily check necessary information presenting conditions of the vehicle . Further, in this case, the speedometer 1 1 , which is often checked by the driver during driving, is provided in substantially front of the driver, thereby allowing the driver to more easily check the speedometer 1 1 .

Note that, the present embodiment describes a case of switching images in display on the display panel 10 in accordance with operation of the turn signal. However, timings for switching the images are not limited to this. For example, considering the fact that the driver views the front image less frequently when turning to the right, it is possible to display only the right rear image in association with the operation of the direction indicator. In this case, the front image will be displayed only when a switch is operated.

Images in display may be switched in response to the driver's instructions provided to the operation section 2 (e.g. camera switch 2e) , for example . When audio input means (not shown) such as a microphone is attached, images in display may be switched in response to the driver's audio instructions.

Further, images in display may be switched, for example , in association with the navigation information, that is, they are switched in accordance with positional information (current positional information) received from the navigation information transmitting station 30 through the transmission/ reception section 7. For example , with the navigation system, information such as a map of the present location is displayed on the display panel 10 as the navigation information 16 in response to input of a starting point and a destination. Further, as the driver travels the optimum route obtained based on the starting point and the destination (route in which the positions at which the vehicle changes its direction and the direction in which the vehicle turns are previously determined) , and if the navigation system instructs the driver to turn left or right at a next intersection, the left rear or right rear image and the front image of the vehicle may be displayed according to the instruction (the instructed direction of turning) . That is, when turning right, the right rear image 18b and the front image 18e may be displayed on the display panel 10 as shown in Figure l (b) . When turning left, the left rear image 18a and the front image 18e may be displayed on the display panel 10 as shown in

Figure l (c) .

When the object sensor 6 detects an object in the vicinity of the vehicle, images to be displayed may be switched in accordance with a detected direction. For example, when the object sensor 6 detects an object (automobile, two-wheeled vehicle, bicycle, pedestrian, etc.) at the right rear side of the vehicle, the right rear image 18b and the front image 18e may be displayed on the display panel 10 as shown in Figure l (b) . When the object sensor 6 detects an object at the left rear side of the vehicle, the left rear image 18a and the front image 18e may be displayed as shown in Figure l (c) . This allows the driver to check conditions of the front of the vehicle, while monitoring movement of the detected obj ect.

Further, in the display system 1 , when the driver need not check the left rear and the right rear of the vehicle, the display of the rear image or the front image may instead be display of information related to conditions of the vehicle (the number of engine rotations, remaining amount of fuel, etc .) , or the navigation information, in addition to the speed information. In this way, the driver obtains necessary information for traveling to a destination. Alternatively, it may be arranged such that images captured by cameras are constantly displayed.

As described above, the right rear image and the left rear image may be displayed by performing mirror inversion on captured images. In this case, the driver can use the displayed right rear or left rear image as a view in a fender mirror, for example.

Further, an image of the vehicle and an image of another vehicle (e .g. door pillar (A pillar) displayed in a semitransparent mode) may be displayed at an edge portion of the right rear image and the left rear image, respectively. In this case, for example, the driver can easily recognize a relative position between the vehicle and an object such as another vehicle. Further, the shooting angles of cameras 4a and 4b may be adjusted to include the side part (one portion) of the vehicle .

According to the present embodiment, shapes of the respective display areas (right rear image 18b, left rear image 18e, front image 18e) are rectangular. However, the shapes of the display areas are not limited to this, and may be any shapes such as trapezoid, polygon, round, ellipse, or even a shape of a door mirror. Further, the right rear image 18b and the left rear image 18a may have different shapes . Each of the rear images may be, for example, trapezoid that varies in height of its display area according to a distance from the vehicle (a shooting position relative to the vehicle) . This allows the driver to be aware of an accurate relative position between the rear image and the vehicle . The front image 18e may contain a frame of a windshield or the like, which comes in sight when the driver look ahead through the real windshield, in semitransparent mode, thereby enabling the driver to instinctively recognize the front image 18e as a front image of the vehicle. As a method for displaying images in an onboard display device mounted to the vehicle , the display system 1 of the present embodiment includes steps of: (i) detecting instructions supplied to the onboard display device for displaying images to check the in the vicinity of the vehicle when the vehicle turns right or left; (ii) switching images in a display of the onboard display device when detecting an instruction of displaying images through the detecting step; and (iii) displaying the images in various manner according to whether the images are used for checking the right rear or the left rear of the vehicle . The right rear image and the front image are displayed when the vehicle turns right, while the left rear image and the front image are displayed when the vehicle turns left.

According to the present embodiment, the display panel 10 is provided in front of the driver as shown in Figure 5.

However, the position of the display panel 10 is not limited to this . As shown in Figure 6 for example, the display panel 10 may be provided such that it extends from the driver seat to the front passenger' s seat in an automobile . According to the present embodiment, the display panel

10 displays not only images taken by the imaging section 4, but also instrument images presenting conditions of the vehicle. However, the display panel 10 is not limited to these . As shown in Figure 7 for example, the display panel 10 may be separated from the instrument panel showing meters and the like.

For example, Figure 8(a) illustrates a case of displaying a front image and a right rear image. On the display panel 10, the right rear image (right rear side image) 18b may be displayed in the right half portion and the front image 18e may be displayed in the left half portion. Figure 8(b) illustrates a case of displaying a front image and a left rear image, for example. On the display panel 10, the left rear image (left rearward image) 18a may be displayed in the left half portion and the front image 18e may be displayed in the right half portion.

In this case, the images may be displayed on the display panel 10 in response to operation of the direction indicator (not shown) , or in response to operation of a switch provided separately. For example , by operating the direction indicator to show the right turn, the right rear image captured by the camera 4b/ 4d and the front image captured by the camera 4e are displayed on a single display device . Displaying the both images on a single screen allows the driver to check with little eye movement the two directions which he / she needs to look at, thereby improving the safety. It is more desirable to display the both images next to each other on the display device, in order to further reduce eye movement.

According to the present embodiment, the display panel 10 measures greater in width than in height with an aspect ratio of 8:3 or greater. A display device having an aspect ratio of 8:3, 30:9, or 32:9 etc. may be used in the display panel 10. In this case, the display panel 10 may be constituted of a combination of any two of panels having an aspect ratio of 4:3, 15:9, and 16:9, respectively.

Further, a display panel having an aspect ratio of 8:3 or smaller, for example, an aspect ratio of 4:3, 15:9, or 16:9, may be used in the display panel 10. Note that, in the display system 1, two images; the front image 18e, and the left rear image 18a or the right rear image 18b are displayed in terms of improvement of safety during driving. Therefore, it is preferable to ensure sufficient visibility. In this view, it is preferable to adjacently display oblong images, each having the aspect ratio of 4:3. For this purpose, it is preferable that the display panel 10 have an aspect ratio of 8:3 or greater.

Further, the display panel 10 need not always have oblong-rectangle display areas. For example, the shapes of the display areas may be ellipse, round, trapezoid, or the like. Further, the surface of the display section 11 may be either flat or round.

According to the present embodiment, a liquid crystal panel is used in the display panel 10. However, an organic or inorganic electro luminescence (EL) panel, a plasma display panel, or cathode ray tube (CRT) may be used, for example. According to the present invention, Figures 3 and 4 illustrate an arrangement where the camera 4e is provided at the center of the vehicle , enabling itself to take images about the line (traveling direction) extending forward from the center of the vehicle. Specifically, when changing traveling lanes, the layout of the camera 4e allows the driver to check not only a vehicle or the like ahead of the driving vehicle by referring to the front image 18e, but also a vehicle approaching from the right rear direction by referring to the right rear image (right rear side image) . Therefore, the driver can check not only a vehicle or the like running ahead to avoid a collision, but the rear side view without moving visual lines, thereby ensuring safety. Further, even when a vehicle is overtaking the vehicle from the left lane, the camera 4e can capture the vehicle in the front image. Thus, the safety can be highly ensured when traveling on a multilane highway or the like.

However, positions and the number of mounted cameras are not limited to the examples shown in Figures 3 and 4 , as long as they are able to tale images of the front and the left or the right of the vehicle . The positions and the number of cameras may be changed appropriately.

For example, the cameras 4a and 4b may be provided on door mirrors 2 1 a and 2 1 b, respectively, or on the top of the vehicle . Mounting the cameras on the top of the vehicle gives an advantage for maintaining the same angles of the cameras because it is not likely to collide with other objects. The cameras may be used in such a manner that it is exposed outside to shoot images and is contained inside the vehicle otherwise, for example. Further, in the display system 1 , the cameras 4a to 4b are equipped with wide-angle lenses capable of simultaneously shooting images in plural predetermined ranges of different angles. However, other cameras such as an omnidirectional camera (capturing a 360° view about an axis substantially vertical to the ground) may be used. Also, the cameras may have a function of shooting at least one direction. Thus, besides cameras equipped with wide-angle lenses or omnidirectional cameras, cameras equipped with standard lenses may be used. Further, shooting directions of the cameras do not always have to be fixed, and can be changeable . Shooting directions may be determined by the user's instructions. In this case, it is preferable to provide an inputting section for receiving instructions from the user.

Further, infrared cameras may be used, or illuminating means for illuminating shooting ranges of the cameras may be provided. With these, suitable images can be captured even in the dark, for example, at night or inside the tunnel, thereby ensuring the safety around the vehicle .

Further, in the display system 1 , when the indicator is operated, the left rear image 18a captured by the camera 4a or the right rear image 18b captured by the camera 4b, and the front image 18e captured by the camera 4e are displayed. However, images used as the left rear image 18a and the right rear image 18b may not be limited to these . For example, it is possible to use the image captured by the camera 4c , which shoots a rear region including the area immediately behind the vehicle and the left rear side of the vehicle, as the left rear image 18a. It is also possible to use the image captured by the camera 4d for shooting a rear region including the area immediately behind the vehicle and the right rear side of the vehicle, as the right rear image 18b. Alternatively, the left rear image 18a may be a synthetic of the image captured by the camera 4a and the image captured by the camera 4c . Similarly, the left rear image 18b may be a synthetic image of the image captured by the camera 4b and the image captured by the camera 4d.

As shown in Figure 9 , instead of the camera 4e, a camera 4f may be provided at the left front of the vehicle to capture the left front view, and a camera 4g may be provided at the right front of the vehicle to capture the right front view.

Note that, Figure 9 shows not the shooting distances but the shooting angles (ranges of shooting angles) of the cameras when the cameras 4f and 4g are mounted in place of the camera 4e. In this case, the left front image captured by the camera 4f and the right front image captured by the camera 4g may be used as the front image 18e. For example, when operating the indicator for the left direction, the left rear image captured by the camera 4a and the left front image captured by the camera 4f may be displayed on the display panel 10..

When operating the indicator for the right direction, the right rear image 18b captured by the camera 4b and the right front image captured by the camera 4g may be displayed on the display panel 10. In this case, the cameras 4a to 4f may be constituted of wide-angle lenses each having a shooting range of approximately 120° with an arrangement such that shooting ranges of the cameras 4a and 4f have borders overlapped or in contact with each other, thereby causing no dead zones in the shooting ranges. The cameras 4b and 4g may be provided in a similar manner.

In this case, the front image 18e, and the left rear image 18a or the right rear image 18b are not necessarily displayed in separate display areas. For example, a combined (synthesized) image of the left front image captured by the camera 4f and the left rear image captured by the camera 4a, or a combined image (synthesized) image of the right front image captured by the camera 4g and the right rear image captured by the camera 4b may be displayed on the display panel 10. It is preferable to provide the cameras 4f and 4g so that borders of their shooting ranges in front of the vehicle cross on the line extending from the vehicle. This enables these cameras to accurately capture a vehicle or the like running ahead of the user' s vehicle (the front direction of the center line) .

Further, when the cameras 4a to 4e are not disposed in the portions shown in Figure 3 , or when the number of cameras varies, any suitable images may be selected for the left rear image and the right rear image among those.

According to the present embodiment, processing in the display system 1 is entirely controlled by the control section 3. However, the present invention is not limited to this arrangement; for example, instead of the control section 3 , the foregoing functions may be realized as a computer program stored in a storage medium, together with an information processing unit capable of reading out the program.

In such a structure, a CPU or an MPU of the information processing unit reads the program stored in a storage medium, so that the program itself performs the processing.

The information processing unit may be realized not only by a general computer (workstation or personal computer) , but also by a function expansion board or a function expansion unit. The program designates a program code (execute form program, intermediate code program, source program, etc.) of a software which realizes processing. The program may be used independently, or in combination with other programs (e.g. OS) . Further, the program may be once stored in an internal memory (RAM) after being read out from a storage medium, and then may be re-read out for execution.

The storage medium for storing the program may be easily removed from, or fixed (attached) to the information processing unit. Further, the storage medium may be connected to the information processing unit as an external memory device.

Examples of the storage medium include an optical tape such as a video tape or a cassette tape or the like, a magnetic disk such as a floppy disk®, a hard disk or the like, an optical disk (magnetooptical disk) such as a CD-ROM , an MO , an MD , a DVD , a CD-R or the like, and a semiconductor memory such as an IC card, a memory card (e . g. an optical card) , a mask ROM, an EPROM, an EEPROM, a flash ROM or the like.

Further, the storage medium connected to the information processing unit may be used via a network (Intranet, Internet, etc . ) . In this case, the information processing unit downloads a program via the network. That is, the program may be downloaded via a transmission medium (a medium which fluidly carries the program) such as the network (connected wired lines or wireless lines) . It is preferable that a program to be downloaded be previously stored in the unit (or the transmission side unit/ the reception side unit) .

As described above, the display system 1 is mounted to a vehicle . According to the present embodiment, the vehicle is not only automobiles, but also automatic two-wheeled vehicles or bicycles. Further, apart from various vehicles, the display system 1 can be mounted to any transporting means

(traveling means) such as helicopters, aircraft, or vessels.

As described above, the display system of the present invention is equipped with the control section which causes the display section to display the front image, and the left rear or right rear image .

Accordingly, the display section simultaneously displays the front image and the left rear or right rear image, thereby reducing eye movement and change in a focal distance of the driver when viewing the information. On this account, the driver is able to check the information in a shorter time, which improves the driver's safety, and also he / she is immune to burdens of frequent eye movement and change in focal distance. In addition, because the left rear and the right rear images are not displayed simultaneously, the driver will not refer to a wrong image. The vehicle of the present invention is equipped with any of the display system described above .

Thus, the display system enables reducing eye movement and change in focal distance of the driver when checking the front image and the left rear or right rear image. On this account, the display system allows a driver to check the information in a shorter time, which improves the driver's safety, and also he / she is immune to burdens of frequent eye movement and change in focal distance . In addition, because the left rear image and the right rear image are not displayed simultaneously, the driver will not refer to a wrong image .

The display method of the present invention includes the step of: taking a front image and a left rear or right rear image of the vehicle in a traveling direction; and displaying the front image and the left rear or right rear image on the display device.

This allows the driver to easily check the front image of the vehicle with respect to a traveling direction, and the left rear or right rear image of the vehicle. That is, the front image and the left rear or right rear image are simultaneously displayed in the display section, thereby reducing eye movement and change in focal distance of the driver when viewing the information. On this account, the driver is able to check the information in a shorter time, which improves the driver's safety, and also he / she is immune to burdens of frequent eye movement and change in focal distance. In addition, because the left rear and the right rear images are not displayed simultaneously, the driver will not refer to a wrong image. The display program of the present invention causes a computer in a display system to function as a control section of the display system.

By causing the computer to read out the program, processing of the control section in the display system is realized by the computer.

Further, by storing the program in a storage medium readable by the computer, storage and distribution of the program can be facilitated. Further, by causing the computer to read the program from the storage medium, processing of the control section in the display system is realized by the computer.

The invention being thus described, it will be obvious that the same way may be varied in many ways. Such changes are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.

INDUSTRIAL APPLICABILITY The display system of the present invention can be mounted to any kind of vehicles (transporting means) such as automobiles, automatic two-wheeled vehicles, bicycles, helicopters, aircraft, or vessels.

Claims

1. A display system comprising: an imaging section taking an image in a vicinity of a vehicle, the imaging section taking at least a front image, that is an image in front of the vehicle, and a left rear image and a right rear image which are images to a left rear side and to a right rear side of the vehicle with respect to a traveling direction; a display section displaying an image taken by the imaging section, and a control section for causing the display section to display the front image, and either of the left rear image or the right rear image.

2. The display system according to claim 1 , wherein: when the front image and the left rear image are displayed, the control section controls the display section so that the front image is displayed in a region adjacently provided on the right of a display region for the left rear image when viewed from a displaying direction of the display section, and, when the front image and the right rear image are displayed, the control section controls the display section so that the front image is displayed in a region adjacently provided on the left of a display region for the right rear image when viewed from a displaying direction of the display section.

3. The display system according to claim 1 or 2 , wherein a shooting range of the front image and a shooting range of the left rear or right rear image are in contact or overlap with each other.

4. The display system according to any one of claims 1 through 3 , wherein the control section controls shapes of the display regions for the left rear image and the right rear image in accordance with their positions relative to the vehicle.

5. The display system according to any one of claims 1 through 4, wherein the control section carries out mirror inversion of the left rear image and the right rear image after the left rear image and the right rear image are taken by the imaging section so that the left rear image and the right rear image are inverted when displayed.

6. The display system according to any one of claims 1 through 5, wherein the control section causes the display section to display, in a part of the left rear image and the right rear image, an image of the vehicle or an image indicating a position of the vehicle.

7. The display system according to any one of claims 1 through 6, further comprising a direction indication detecting sensor for detecting a previous notice of changing a traveling direction of the vehicle, wherein the control section causes the display section to display one of the left rear image and the right rear image corresponding to the previous notice, together with the front image.

8. The display system according to any one of claims 1 through 7 , further comprising an object sensor for detecting a presence or absence of an object in a vicinity of the vehicle, wherein, according to a detection result of the object sensor, the control section causes the display section to display, together with the front image , one of the left rear image and the right rear image corresponding to a direction where an object was found.

9. The display system according to any one of claims 1 through 8, further comprising: location detecting means for detecting a current location of the vehicle; and means for previously setting a point at which the vehicle changes its direction and a direction in which the vehicle turns, wherein the control section causes the display section to display, together with the front image, one of the left rear image and the right rear image according to the direction in which the vehicle turns, when a distance between the current location of the vehicle and the point at which the vehicle changes its direction becomes equal to or shorter than a predetermined value .

10. The display system according to any one of claims 1 through 9 , further comprising an operation section for receiving an instruction from the driver regarding an image to be displayed on the display section, wherein the control section causes the display section to display one of the left rear image and the right rear image in accordance with the instruction received in the operation section.

1 1. The display system according to any one of claims 1 through 10, wherein the control section causes the display section to display an instrument image showing conditions of the vehicle.

12. The display system according to claim 1 1 , wherein the control section causes the display section to display an instrument image showing a traveling speed of the vehicle.

13. A vehicle comprising the display system according to any one of claims 1 through 12.

14. A display method for causing a display device, which is mounted to a vehicle, to take an image in a vicinity of a vehicle and display the image in the display device, the display method comprising the steps of: taking an image in front of the vehicle and an image of a left rear side or a right rear side of the vehicle with respect to a traveling direction; and displaying the image in front of the vehicle and the image of a left rear side or a right rear side in the display device.

15. A display program for causing a computer in a display system to function as a control section of the display system according to any one of claims 1 through 12.

16. A storage medium storing the display program according to claim 15.