WO2001049527A1

WO2001049527A1 - System and method for enhancing vision in a vehicle

Info

Publication number: WO2001049527A1
Application number: PCT/US2001/000439
Authority: WO
Inventors: Larry E. Mathias; Paul R. Amos; Jonathan Peter Cansfield; Eugene J. Sobieski
Original assignee: Johnson Controls Technology Company
Priority date: 2000-01-06
Filing date: 2001-01-08
Publication date: 2001-07-12
Also published as: EP1244572A1; EP1244571A1; WO2001049526A1

Abstract

A vision enhancement system for a vehicle includes a first camera, a second camera, a display, and a switch. The first camera is configured to view an interior of the vehicle and to generate a first video signal representative of the interior of the vehicle. The second camera is configured to view an exterior of the vehicle and to generate a second video signal representative of the exterior of the vehicle. The switch is coupled to the first and second cameras and to the display. The switch is configured to receive the first and second video signals and to selectively provide the first and second video signals to the display.

Description

TITLE OF THE INVENTION

SYSTEM AND METHOD FOR ENHANCING VISION IN A VEHICLE

CROSS-REFERENCE TO RELATED APPLICATIONS Not Applicable.

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT Not Applicable.

FIELD OF THE INVENTION

The present invention relates to a vision enhancement system and method for a vehicle, and more particularly, to a vision enhancement system incorporating single or multiple video inputs generated by single or multiple cameras that may include an interior camera, such as, a rear passenger camera, and a camera for viewing the rear of the vehicle.

BACKGROUND OF THE INVENTION Rearview and sideview mirror systems are widely used in motor vehicles, such as cars and trucks, to enable the driver to view the rear or side of the vehicle and to monitor the activities of passengers, such as children in the rear seat of a vehicle. Traditionally, rearview mirrors and sideview mirrors are located on the inside of the front windshield and on the sides of a vehicle. All such rearview mirrors and sideview mirrors include a blind spot where the driver cannot accurately view a portion of the area around the vehicle, necessitating the driver to turn his/her head to view the rear portion of the vehicle. Furthermore, in many instances where children are located in the rear seat of a vehicle, it is difficult to monitor the children using a rearview mirror, especially since the rearview mirror has been adjusted for driving and not for viewing the rear seat of a vehicle. In a situation where children are located in the rear seat of a vehicle, a driver must turn his/her head to monitor the behavior of the children. In most traffic conditions, driving a vehicle while trying to view the rear of a vehicle is an awkward task.

Accordingly, there is a need for a rearview vision system that is easily accessed by the driver of a vehicle and can be switched between multiple perspectives of difficult viewing areas in and around a vehicle. Furthermore, there is a need for system and method for viewing the interior of a vehicle to monitor children or other activities within the vehicle. Further still, there is a need for a system and method for improving the quality, visibility, or perspective of images displayed by such systems. Further yet, there is a need for a system and method for improving both audio and visual communication between a front seat passenger and a rear seat passenger in a vehicle. There is also a need for providing convenient and easy-to-use operator controls for such systems. There is also a need for an improved vehicle camera system to provide images of areas in and around the vehicle. The teachings hereinbelow extend to those embodiments which fall within the scope of the appended claims, regardless of whether they accomplish one or more of the above-mentioned needs.

SUMMARY OF THE INVENTION

According to one exemplary embodiment, a vision enhancement system for a vehicle includes a camera and a display. The camera is coupled to the interior of the vehicle and is configured to view the interior of the vehicle and to generate a video signal representative of the interior of the vehicle. The display is coupled to the interior of the vehicle and coupled to the camera. The display is configured to display the video signal. According to another exemplary embodiment, a vision enhancement system for a vehicle includes a camera, a display, and a light source. The camera is configured to view an area of the vehicle interior and to generate a video signal representative of the area of the vehicle interior. The display is coupled to the camera and is configured to display the video signal. The light source is positioned proximate the area of the vehicle interior configured to illuminate the area.

According to yet another exemplary embodiment, an integrated audio/visual system for a vehicle includes a vision enhancement system, an audio system, and an operator input device. The vehicle has an interior, and the interior has a front seat and a rear seat. The vision enhancement system includes a camera and a display. The camera is coupled to the interior of the vehicle and is configured to view the interior of the vehicle and to generate a video signal representative of the interior of the vehicle. The display is coupled to the camera and is configured to display the video signal. The audio system is configured to provide an audio signal between a passenger in the front seat and a passenger in the rear seat. An operator input device is coupled to the display and the audio system. The vision enhancement system and the audio system are activated in response to operator input at the operator input device.

According to still another exemplary embodiment, a vision enhancement system for a vehicle includes first and second cameras, a display, and a switch. The first camera is configured to view the interior of the vehicle and to generate a first video signal representative of the interior of the vehicle. The second camera is configured to view the exterior of the vehicle and to generate a second video signal representative of the exterior of the vehicle. The switch is coupled to the first and second cameras and to the display. The switch is configured to receive the first and second video signals and to selectively provide the first and second video signals to the display. According to another exemplary embodiment, a vision enhancement system for a vehicle includes a rearview camera, a display, and operator input device, and a light source. The rearview camera is configured to generate a video signal representative of an area proximate the rear of the vehicle. The display is coupled to the interior of the vehicle. The light source is coupled to the operator input device and is configured to provide illumination to the area proximate the rear of the vehicle in response to actuation of the operator input device.

According to another exemplary embodiment, a vehicle camera system for a vision enhancement system includes a housing, a camera, and a light source. The camera and light source are both disposed at least partially in the housing. The camera is configured to generate a video signal representative of an area proximate the rear of the vehicle. The light source is configured to provide illumination to the area proximate the rear of the vehicle.

According to another exemplary embodiment, a vision system which incorporates a video display receives video image signals from cameras viewing the interior of a vehicle and cameras viewing the exterior of a vehicle. The video display is placed in an easy to view position with reference to the forward viewing perspective of a driver such that he/she is able to view the video display without significant disruption in operation of the vehicle. In one exemplary embodiment, the video display and controls are incorporated in a bezel mounted in the roof or headliner of a vehicle. The bezel may be mounted in the forward area of a vehicle cabin such as in a position directly above a rearview mirror. The bezel may further include a video camera positioned to view the rear seats of a vehicle. According to another exemplary embodiment, the video system includes a control interface mounted in the bezel which allows the video display and video inputs to be easily switched by the driver of the vehicle. Light sources remote or proximate the cameras allow dark areas to be illuminated when the driver of a vehicle has switched to a camera viewing the dark areas. For example, when the video display is switched to a camera viewing the rear of the vehicle in a dark or low light condition, a light on the rear of the vehicle will illuminate the area being viewed by the camera. Furthermore, when the video display is switched to the rear seat camera a light positioned proximate the rear seat will automatically illuminate the rear seat.

According to another exemplary embodiment, an audio system is included to allow communication between the driver and passengers in the rear seats of a vehicle. The audio system includes a microphone which responds to the voice of the driver and generates an audio signal. When audio input to the microphone is detected, the audio system will attenuate the signal on the front speakers of a vehicle and switch the rear speakers to the audio signal from the microphone. In this manner, the driver may be clearly heard and understood by passengers in the rear seat of a vehicle.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will become more fully understood from the following detailed description, taken in conjunction with the accompanying drawings, wherein like reference numerals refer to like parts, in which:

Figure 1 is a cutaway perspective view of a vehicle including a video system according to an exemplary embodiment; Figure 2 is an overhead view of a vehicle including the video system of Figure 1 ;

Figure 3 is a diagrammatic view of a video control panel according to an exemplary embodiment;

Figure 4 is a diagrammatic view of an overhead light positioned over a rear seat according to an exemplary embodiment; and

Figures 5-7 are views of a vehicle camera system equipped with lights and a video camera according to an exemplary embodiment.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Referring to Figure 1 , 2, and 3, in accordance with a first embodiment of the present invention, a vehicle 1 0 is shown equipped with a video system or vision enhancement system 1 2. Vehicle 1 0 may be a car, truck, or other vehicle. The vehicle 1 0 has a rear 6, an interior 7 and an exterior 8, wherein the interior includes front seats 9, rear seats 1 1 , and a chimsel 1 3. Vehicle exterior 8 generally refers to areas surrounding vehicle interior 7 and/or the exterior surfaces of vehicle 1 0.

The video system 1 2 includes a video control panel 1 4, one or more lights 1 6 (e.g., rear seat lights), and a camera unit 1 8 5 (e.g., a rearview camera unit). The video control panel 1 4 is preferably mounted in the vehicle 10 cabin in a bezel 1 7 attached to the roof of the vehicle 1 0; thus, control panel 1 4 is mounted in the forward viewing perspective of a driver. The video control panel 1 4 includes a video display 20 that may be switched from a video input ιo or signal provided by a camera 22 viewing the vehicle interior 7

(e.g., the rear seats 1 1 , other portions of the vehicle interior, etc.) of the vehicle 1 0 and a video signal provided by the rearview camera unit 1 8 or another camera unit which views exterior 8 of the vehicle. The video display 20, because of its ergonomic positioning, allows i s the driver or other front seat passenger of a vehicle to easily view the video display 20 while driving.

An operator input device 24 (e.g., button, switch, dial, clickable icon on display 20, etc.) activates the video display 20 into a default mode wherein the video display 20 receives and displays

20 the video signal from the rearview camera 1 8. In the preferred embodiment, the video display 20 is a liquid crystal display ("LCD") with the ability to display analog or digital video inputs, although any video display (e.g., a light-emitting diode (LED) display, a cathode ray tube (CRT), etc.) is considered within the scope of this invention.

25 Thus, cameras 1 8 and 22 may be any type of digital or analog camera. Video display 20 may be any shape, such as square, rectangular, or elliptical, and may have a surface area of between 8.75 in² and 1 2 in² or other sizes. Furthermore, the video display 20, in alternate embodiments, may also be electronically configured or reconfigured to display vehicle operation and/or trip data from an onboard controller or computer such as mileage, compass heading, tire pressure, fuel efficiency data, outside/inside temperature, etc., but is not limited to such. Such data may be received from sensors positioned at various locations on the vehicle, and may be received via a wired or wireless connection (e.g., radio frequency, infrared, etc.) .

As seen in Figures 1 -4, the rear seat lights 1 6 are mounted to the roof of the vehicle 10 proximate the sides of the vehicle 1 0 and provide ambient light to the rear seats 1 1 of the vehicle 1 0 to allow the rear seat camera 22 to provide a well- illuminated picture of the rear seats 1 1 in low light conditions. Alternatively, lights 1 6 may be mounted anywhere on vehicle 1 0, and may be configured to provide illumination to any area of vehicle interior 7 to be viewed by camera 22. Lights 1 6 may be mounted alone or in a housing or bezel containing one or more of lights 1 6, a rear speaker for an audio system, a coat hook, and a task light or map light. Lights 1 6, the rear speaker, and the task light may further have ON/OFF switches associated therewith. In one embodiment, at least one of the rear seat lights

1 6 will be automatically turned on when the rear seat camera 22 is switched on using the button 24, but any number or combination of lights 1 6 switched on is considered within the scope of the present invention. Further, at least one of rear seat lights 1 6 may be automatically switched off when the rear seat camera 22 is switched off using button 24. A manual override control comprising a pushbutton dial 26 will allow the driver to turn the rear seat lights 1 6 on and off by pushing the pushbutton dial 26 and will allow the driver to adjust the amount of light generated by the rear seat light by dialing the pushbutton dial 26. In further embodiments, a light sensor may be used to disable the automatic operation of the rear seat light 1 6 during daylight or high light conditions. The light sensor may include a light sensor circuit comprising the necessary analog or digital logic, software code, etc. to perform the operation of disabling the automatic operation of rear seat light 1 6.

Lights 1 6 may include any type of light source, such as fluorescent bulbs, incandescent bulbs, infrared, ultraviolet, a sconce light, an LED, etc. Lights 1 6 preferably provide a light source easily detectable by camera 22. According to one advantageous feature, the light source provides light in the infrared range. Since infrared light is not visible light, passengers in the rear seats 1 1 , such as children, will not be disturbed or awakened by the presence of the light. Since camera 22 may be configured to detect infrared light, the video signals provided by camera 22 will result in enhanced, easy-to-view images.

As illustrated in Figure 3, video control panel 1 4 includes camera 22 and display 20 mounted in the same bezel or other housing 1 7. By mounting camera 22 in a forward viewing perspective of the driver of the vehicle, or otherwise in the front of the vehicle, the view of rear seats 1 1 has a better picture quality (e.g., angle) than if camera 22 were mounted closer to seats 1 1 . Also, since video control panel 1 4 is mounted in the roof or headliner in this exemplary embodiment, the video display 20 and microphone 38 are closer to the front seat passengers, such as the driver, for ease of use and clarity of sound.

Referring to Figures 1 , 2, and 5-7, the rearview camera unit 1 8 is mounted at least partially in a housing 1 3 (e.g., a chimsel) to provide images below the sightline of a rearview mirror or images normally out of sight of a driver looking towards the rear of the vehicle 1 0. A chimsel or CHMSL (Center High Mounted Stop Lamp) is a brake light housing mounted to a vehicle in or near an area of the forward visual field toward which a following driver most often glances. The chimsel 1 3 includes brake lights and the necessary electrical connections to operate the brake lights and the rearview camera unit 1 8. Advantageously, the rearview camera unit 1 8 is fully integrated to or fully contained within the chimsel 1 3 to have an aesthetically appealing physical configuration free of unsightly protrusions normally found in traditional vehicle camera systems.

The rearview camera unit 1 8 provides video signals that detail the rear area of the vehicle 1 0. Many objects such as bikes, pets or toys may lie hidden directly below the back of the vehicle 1 0, producing a situation where the driver may back the vehicle 1 0 onto such objects. The rearview camera unit 1 8 enables the driver to view these previously hidden areas or blind spots to avoid such an occurrence. In the preferred embodiment of the present invention, the video signal of the rearview camera unit 1 8 will automatically be displayed on the video display 20 when the vehicle 1 0 is placed in reverse via a gearshift lever or other suitable operator input device. The rearview camera unit 1 8 includes one or more rear lights 28 to illuminate the rear of the vehicle 10 with light directed at the hidden areas or blind spots. Rear lights 28 may include any type of light source, such as fluorescent bulbs, incandescent bulbs, infrared, ultraviolet, sconce lights, LEDs, etc. Lights 28 preferably provide a light source easily detectable by camera 1 8. The rear lights 28 will be automatically switched on when the vehicle 1 0 is placed in reverse but may be manually overridden and adjusted by pushbutton dial 30. A light sensor may also be included to disable the rear lights 28 in daylight or in a high light condition. The rearview camera unit 1 8 further includes a lens 32 to slightly diffuse the light generated by rear lights 28 to allow greater illumination of the rear of the vehicle 1 0. An aperture or window 34 is formed in the lens 32 to 5 allow the rear camera unit 1 8 to bypass the interference of the lens 32.

Referring to Figures 1 and 3, the video control panel 1 4 includes various other controls or operator input devices such as an audio system control or input device 36 and a microphone 38. Upon o activation of the audio system control 36, audio input generated by a driver or front passenger to the microphone 38 will be measured and compared to a threshold level using a microcontroller or microprocessor. If the audio input is greater than the threshold level, then audio output to front speakers 40 mounted in the vehicle 1 0 5 (e.g., from a radio, CD player, or other audio system) will be attenuated (the volume will be reduced) and the audio input to the microphone 38 will be switched to rear speakers 42 mounted in the vehicle 1 0. In this manner, the voice of a driver will be easily heard by passengers seated in the rear seats 1 1 of the vehicle 10, via o microphone 38 and rear speakers 42.

According to another embodiment, an integrated audio/visual system is provided. A vision enhancement system in one or more of the above-mentioned embodiments is integrated with an audio system. The vision enhancement system includes camera 5 22, display 20, and an operator input device, such as audio system control 36 or microphone 38. In response to operator input (e.g., a button press, oral command, etc.), the vision enhancement system and the audio system are both activated. For example, camera 22 may begin providing video signals to generate an image on display 20, and microphone 38 may begin transmitting audible signals from a passenger in the front seat to a passenger in the rear seat, or vice- versa, via front- or rear-mounted speakers. Rear-mounted speakers may be provided near lights 1 6 or in another location near rear seats 5 1 1 . In this integrated audio/visual system, a single operator input may activate both a video system and an audio system to allow communication between a front seat passenger and a rear seat passenger. Alternatively, if one of the video and audio systems is already activated, the single operator input may activate the other of ιo the video and audio systems. Further, a single operator input may deactivate both the video and audio systems. The activation and deactivation may occur substantially simultaneously.

While the exemplary embodiments illustrated in the Figures and described above are presently preferred, it should be i s understood that these embodiments are offered by way of example only. For example, while the cameras, speakers, lights and operator input devices are coupled to various portions of the vehicle, alternative locations for these elements are contemplated. Further, the materials and structures shown and described herein may be

20 replaced with other suitable materials and structures. Accordingly, the present invention is not limited to a particular embodiment, but extends to various modifications that nevertheless fall within the scope of the appended claims.

Claims

WHAT IS CLAIMED:

ι 1 . A vision enhancement system for a vehicle, the vehicle

2 having an interior and an exterior, comprising:

3 a first camera configured to view the interior of the

4 vehicle and to generate a first video signal representative of the

5 interior of the vehicle;

6 a second camera configured to view the exterior of the

7 vehicle and to generate a second video signal representative of the

8 exterior of the vehicle;

9 a display; and o a switch coupled to the first and second cameras and to 1 the display, wherein the switch is configured to receive the first and 2 second video signals and to selectively provide the first and second 3 video signals to the display.

1 2. The vision enhancement system of claim 1 , further

2 comprising a button coupled to the switch operable by a driver of

3 the vehicle, wherein the switch is controllable via the button.

ι 3. The vision enhancement system of claim 1 , further

2 comprising a computer coupled to the display configured to provide

3 operation data to the display.

1 4. The vision enhancement system of claim 3, wherein the

2 operation data includes a compass heading.

1 5. The vision enhancement system of claim 1 , wherein the

2 display is mounted in a headliner of the vehicle.

6. The vision enhancement system of claim 5, wherein the display is mounted directly above a rearview mirror.

7. The vision enhancement system of claim 1 , wherein the first camera is mounted in the forward viewing perspective of a driver.

8. The vision enhancement system of claim 1 , wherein the first camera is configured to view a rear seat of the vehicle.

9. The vision enhancement system of claim 1 , wherein the second camera is configured to provide an image normally out of sight of a driver looking towards the rear of the vehicle.

ι

1 0. A vision enhancement system for a vehicle, the vehicle

2 having an interior and a rear, comprising:

3 a rearview camera configured to generate a video signal

4 representative of an area proximate the rear of the vehicle;

5 a display coupled to the interior of the vehicle;

6 an operator input device; and

7 a light source coupled to the operator input device,

8 wherein the light source is configured to provide illumination to the

9 area proximate the rear of the vehicle in response to actuation of the o operator input device.

1 1 1 . The vision enhancement system of claim 1 0, wherein

2 the area is a hidden area or a blindspot.

1 1 2. The vision enhancement system of claim 1 1 , wherein

2 the light source directs the illumination to the hidden area or

3 blindspot.

1 1 3. The vision enhancement system of claim 1 0, wherein

2 the operator input device is a gearshift lever, wherein the light

3 source is configured to provide the illumination in response to

4 movement of the gearshift lever into a reverse position.

ι

1 4. The vision enhancement system of claim 1 3, wherein

2 the gearshift lever is coupled to the rearview camera, wherein the

3 rearview camera is configured to generate the video signal in

4 response to movement of the gearshift lever into the reverse

5 position.

1 1 5. The vision enhancement system of claim 1 3, further

2 comprising a manual override button, wherein the light source is configured to turn off in response to operator actuation of the manual override button.

1 6. The vision enhancement system of claim 1 0, further comprising a computer coupled to the display configured to provide operation data to the display.

1 7. The vision enhancement system of claim 1 6, wherein the operation data includes a compass heading.

1 8. The vision enhancement system of claim 1 0, wherein the operator input device is a button or switch.

1 9. The vision enhancement system of claim 1 0, further comprising a light sensor circuit configured to disable the light source when the light source detects ambient light exceeding a predetermined luminescence threshold.

20. A vehicle camera system for a vision enhancement system suitable for use with a vehicle having an interior and a rear, comprising: a housing; a camera disposed at least partially in the housing configured to generate a video signal representative of an area proximate the rear of the vehicle; and a light source disposed at least partially in the housing configured to provide illumination to the area proximate the rear of the vehicle.

21 . The vehicle camera system of claim 20, further comprising brake lights disposed at least partially in the housing.

22. The vehicle camera system of claim 20, wherein the housing is a chimsel.

23. The vehicle camera system of claim 20, wherein the area is a hidden area or a blindspot.

24. The vehicle camera system of claim 23, wherein the light source directs the illumination to the hidden area or blindspot.

25. The vehicle camera system of claim 20, wherein the camera is configured to generate a video signal representative of an area normally out of sight of a driver looking towards the rear of the vehicle.

26. The vehicle camera system of claim 20, wherein the camera is fully contained within the housing, wherein the housing contains an aperture or window through which the camera acquires a view of the area.

27. The vehicle camera system of claim 20, further comprising a lens configured to slightly diffuse the illumination from the light source.

28. The vehicle camera system of claim 27, wherein the lens includes an aperture or window through which the camera acquires a view of the area.