EP1803292A1

EP1803292A1 - System for the detection and reproduction of images

Info

Publication number: EP1803292A1
Application number: EP05787305A
Authority: EP
Inventors: Roland Schmid; Ulrich Seger; Jens Schick
Original assignee: Robert Bosch GmbH
Current assignee: Robert Bosch GmbH
Priority date: 2004-10-13
Filing date: 2005-08-31
Publication date: 2007-07-04
Also published as: CN101040516A; US20080036878A1; DE102004049872A1; WO2006040218A1

Abstract

The invention relates to a system (1) for detecting and reproducing images, comprising a camera module (10) that encompasses an image sensor (11), a reproducing device (18), and a control device (17). The camera module (10) is provided with a memory module (14) for storing patterns and messages as well as a functional module (13) for superimposing patterns and/or messages stored in the memory module (14) on an image of the image sensor (11).

Description

System for capturing and reproducing images

State of the art

The invention relates to a system for capturing and reproducing images according to the preamble of claim 1. The system of the generic type is preferably suitable as a driver assistance system for assisting the driver of a motor vehicle. However, the invention is not limited to this preferred application, but is suitable for use in all applications in which a video image with symbols and / or texts superimposed and displayed on a display device, in particular a monitor.

Vehicles are increasingly already equipped in the original equipment with so-called parking pilots systems, which should facilitate the parking. Such a parking pilot system comprises short-range sensors, which preferably measure the distance to an obstacle by means of ultrasound. Furthermore, a

Park pilot system optical and or acoustic signal generator, which generate an optical and / or audible warning signal in response to the output signals of the sensors. Although such a parking pilots system already represents a very useful support for the driver, the usual signalers are very abstract and unclear. Especially inexperienced drivers, it is therefore very difficult, the of the

Signalers correctly interpreted signals. Furthermore, it is already known to use video cameras in a vehicle for monitoring the vehicle environment. The image signal of the video camera is displayed on a monitor arranged in the field of vision of the driver. WO 00/74976 A1 discloses a method and a device for visualization of a track, wherein a guideway of a vehicle to be expected at an unchanged steering angle is displayed in a display in which at least part of the rear travel of a vehicle is displayed. A driver is informed of the expected route, so that he can adjust the chosen steering angle to an obstacle that can be seen in the rear compartment.

From DE 100 15 897 A1 there is further provided a parking assist apparatus for taking a picture of a rear side of a vehicle by a camera at a parking operation, displaying an image from the camera on a screen inside the vehicle

Vehicle is provided, as a rear image, and for displaying an expected trajectory, which changes in accordance with a state of a steering wheel angle to superimpose the rear image known. The parking assist apparatus includes a parking-line instructing means for instructing the vehicle to park along a longitudinal line and an anticipated trajectory-indicating means for displaying the prospective trajectory with a turning point in accordance with the steering wheel angle when the vehicle is instructed by the parking instruction means to park along the longitudinal line ,

Advantages of the invention

The invention provides the advantage of providing a system for capturing and reproducing images with a camera module capable of receiving simple signals from a controller and patterns associated with those signals

Overlay messages with a recorded image and display this image on a display device, in particular a monitor. For this purpose, the camera module has a memory module for storing patterns and / or messages, as well as a function module for superposing an image of an image sensor with patterns and / or messages stored in the memory module.

Advantageously, the stored patterns and messages are assigned codes with which the patterns and messages from the memory module can be retrieved. Since these codes are only comparatively short messages, their provision is only connected with a small load on the computer capacity of a control unit cooperating with the camera module. Advantageously, the camera module includes at least one interface each for data exchange with a control unit and a monitor. This allows a simple remote from the control unit and the monitor remote operation of the camera module. The camera module can therefore be optimally arranged in the rear area of a vehicle, for example, for monitoring the rear vehicle environment, while the monitor remains in the field of vision of the driver.

Advantageously, the transmission of codes is controlled by output signals of a distance warning device. In this way, a video image provided by an image sensor can be overlaid with patterns and messages that facilitate reversing or parking.

Further advantages emerge from the description and further subclaims.

drawing

Embodiments of the invention are explained below with reference to the drawing. It shows

FIG. 1 is a block diagram of a system for capturing and reproducing images;

2 shows the representation of a video image with superimposed patterns and

Messages on a monitor,

3 shows the block diagram of an alternating buffer.

Description of the embodiments

1 shows the block diagram of an inventive system for the acquisition and reproduction of images 1. The system 1 comprises a camera module 10, a distance warning device 19, 19A, 19B, a display device, in particular a monitor 18, and a control device 17. The camera module 10 includes an image sensor 11, to which a functional module 12 connects. The functional module 12 is connected to a functional module 13. The functional module 13 is on the one hand with a - A -

Memory module 14 and on the other hand connected to a functional module 16. Furthermore, the functional module 13 is connected to a functional module 15. The functional module 16 comprises an input terminal 16A, via which it is connected to a control unit 17. The functional module 15 comprises an output terminal 15A, via which the camera module 10 can be connected to a monitor 18. In an advantageous

Embodiment of the invention, the image sensor 11 comprises a photosensitive semiconductor chip, preferably a CCD sensor and an optical module IA, which images scenes from the recording area of the image recording and reproducing system 1 on the semiconductor chip. As optical module 1 IA preferably a wide-angle lens with an opening angle of about 100 ° to 120 ° is used. Of the

Image sensor 11 provides at its output a raw image that is supplied to the input of the function module 12. The functional module 12 equalizes the raw image provided by the image sensor 11 and supplies a corrected image to the functional module 13. In order to manage with as little computing power as possible, advantageously predeterminable in the memory module 14 connected to the functional module 13

Stored patterns and messages. For example, the patterns may be simple geometric structures such as broken and unbroken lines of different widths and colors. These lines may be target and Isttrajektorien and / or distance lines, for example, signal a certain distance to an obstacle. Furthermore, the stored patterns may include warning symbols, pictograms, traffic signs and the like. The stored messages are preferably brief notes and warnings in textual form intended to assist the driver. In particular, the messages also include failure messages that indicate errors in the system according to the invention and / or errors in other systems of the vehicle. In a basic implementation, the memory module 14 includes a standard set of patterns and messages. In an advantageous embodiment, the content of the memory module 14 can be customized. For example, such that, in addition to the standard set of patterns and messages, custom information is supplemented. Alternatively, the default set may be deleted and completely replaced by a custom set of patterns and messages. The functional module 13 is connected to the functional module 16. The function module 16 in turn is connected via an input terminal 16A to a controller 17, which controls the function of the camera module 10, as will be described later. Furthermore, the control unit with a distance warning device 19, which also includes a plurality of sensors 19A, 19B. As sensors 19A, 19B ultrasonic sensors have been proven in practice. The use of radar and laser sensors is also conceivable. Furthermore, the functional module 13 is connected to a functional module 15, which has an output terminal 15A. About this output terminal 15 A is the camera module 10 with a display device for

Images, in particular a monitor 18, connected. The main task of the function module 15 is the adaptation of the output signals of the functional module 13 to the particular monitor 18. In an exemplary embodiment of the invention, for example, a color monitor 18 is connected to the NTSC standard. Advantageously, therefore, the function module 15 as an interface

Output signals ready according to this standard. A particularly advantageous feature of the system 1 according to the invention is that the superposition of the images captured by the image sensor 11 with the patterns and / or messages stored in the memory device is possible by comparatively simple control signals of the control device 17. As a result, the computing power of the controller is not overwhelmed. This is accomplished by assigning to each pattern and message stored in the memory module 14 a one-to-one code deposited in both the controller 17 and the memory device 14. Accordingly, when a particular pattern or message is to be retrieved from the memory device 14, the controller 17 will only send the code corresponding to that pattern or message to the memory device 14 via the functional module 16, the functional module 13. By sending this code, the corresponding pattern or message is provided by the memory device 14 to the functional module 13. The functional module 13 functions as a mixing device in which the equalized image of the image sensor 11 provided by the functional module 12 is superimposed with a pattern or a message provided by the memory device 14. At the output terminal 15A of the camera module 10 is thus provided with a comment image for playback on a monitor 18 ready. In the described embodiment, the output of the code to be transmitted by the distance warning device 19 with its sensors 19A, 19B controllable.

The patterns and / or messages to be superimposed on the video image by outputting a code therefore preferably relate to distance information of the vehicle with respect to the vehicle environment. In other applications, the output of codes may be controlled by other means. For example, signals from a restraint system for vehicle occupants can control the output of codes when danger is present in the vehicle Default is. The message called by the corresponding code can then be superimposed on a video image. In an advantageous development of the invention, information which itself results in the output of a code with subsequent superposition of the video image with a message stored in the memory module 14 can be extracted from the video image generated by the image sensor 11. This is useful, for example, when the image sensor 11 is used as a precrash sensor. For this purpose, a connection line I IB between the image sensor 11 and the control unit 17 may then be provided.

In a simpler embodiment of the invention, a control unit 17 is not required if the distance warning device 19 itself already has an interface which generates corresponding codes. As indicated in FIG. 1 by the connecting line 19C shown in dashed lines, the distance warning device 19 is then connected directly to the functional module 16.

The operation of the system 1 for capturing and reproducing images according to the invention will now be described below. In this case, the superposition of an image recorded by the image sensor 11 with patterns and / or messages is explained in particular with reference to a concrete example (FIG. 2). The image sensor 11 with the upstream optical module I IA detects a scene from the environment of

Vehicle 20 (Figure 2) and continuously stores the captured image in an input image memory. In a preferred embodiment, the image sensor 11 has at least VGA resolution. The input image memory has a storage capacity of around 350 Kbytes. In the function module 12, the image is equalized. The equalized image is stored in an output image memory which is stored in a

Embodiment preferably has a storage capacity of about 1 MB. In the memory module 14 patterns and messages are stored with their associated codes. As a pattern, for example, lines of different design and color or more complex symbols are considered. Preferably, the lines can each be assigned to a steering angle. In one

Embodiment of the invention are assigned 64 values of selected steering angles respectively lines. Other lines are provided for representing distance values or artifacts, such as faded bumper, warning trapezoids, and the like. Furthermore, vehicle symbols, traffic signs and roadway structures can also be stored. Furthermore, messages in text form, such as For example, warnings and warnings, as well as failure messages stored. Figure 2 shows a scene shown on the monitor 18 from the environment of a vehicle 20. The scene shows a demarcated from a wall 24 house 25. A vehicle 20 is just about to park backwards on a parking lot in front of the wall 24. The parking process is monitored by a distance warning device 19 with sensors 19A, 19B (FIG. 1). The video image displayed on the monitor 18 is overlaid with patterns and messages which, together with the codes assigned to them, are shown in the following table.

These patterns and messages are stored in the memory module 14 of the camera module 10, among many other patterns and messages. They are retrieved by a corresponding code, which is sent from the controller 17 to the camera module 10. In the discussed embodiment, the code "1" corresponds to a rectangular vehicle symbol representing the vehicle 20. The code 2 corresponds to a line 21 superimposed on the monitor 18 at the distance of 6m in front of the wall 24. The code 5 corresponds to the text message "6m", which is faded in to the line 21. The double line 23 and the associated text message "Stop!" Signal to the driver of the vehicle 20 that he should bring the vehicle 20 to a halt at this double line 23 so that the latter occupies an optimal parking position The double line 23 and the text message "Stop!" are called by codes 4 and 7. In the present embodiment, the transmission of the various codes is largely determined by output signals of the distance warning device 19, which evaluates the signals of their associated sensors 19A, 19B. Both Sensors 19A, 19B are preferably ultrasonic sensors that measure the distance of the rear of the vehicle 20 from the wall 24. The line 21, 22, 23 and the associated text messages can be displayed, for example, when the sensors 19A, 19B have measured a corresponding distance. The patterns and messages can be varied stored in the memory module 14 and called by associated codes. For example, the lines 21, 22, 23 can be displayed in different line types as solid lines, dotted lines or dashed lines. Furthermore, the lines can be shown in different widths or in different colors. Also, different patterns and messages can be arbitrarily linked. All these measures are controllable by associated codes. Because the control unit 17 only has to provide codes which are available to the transmitted codes corresponding patterns and messages but retrievable from the memory module 14 in the camera module 10, the control unit 17 itself comes with a greatly reduced computer power. The following section explains how to pass the code. Preferably, the codes are stored asynchronously in a swap buffer 30 (FIG. 3), which comprises a read buffer 32,31 and a write buffer 32,31. In an advantageous embodiment of the invention, the read and write buffers 32, 31 each receive 32 codes. The write buffer 31 is filled via the input 16A. The change between read and write buffer is advantageously also controlled by a special code. The read buffer 32 is read synchronously.

The superimposition of the video image provided by the image sensor 11 with the codes and / or messages retrievable by codes is effected as follows. The image generated by the image sensor 11 is continuously written in an input memory. With the help of the function module 12, the image is equalized and converted into an output image. The codes stored there are successively read from the read buffer 32. The patterns and / or messages corresponding to the read-out codes are retrieved from the memory module 14 and superimposed in the function module 13 with the output image. The function module 15 provides the image data for display on the monitor 18.

Preferably, the camera module 10 is locally remote from the controller 17 and the monitor 18 operable. This is particularly useful when using the system 1 as a driver assistance system, in which the camera module is arranged in the rear region of a vehicle 20 such that the rear traffic space can be monitored while the monitor 18 is arranged in the driver's field of vision. The control unit 17 can then be placed anywhere in the vehicle. For the data exchange with the control unit 17 and the monitor 18, the camera module 10 has at least one respective interface 15, 16.

Claims

claims

A system (1) for capturing and reproducing images, comprising a camera module (10) comprising a picture sensor (11), a display device (18) and a control unit (17), characterized in that the camera module (10) is a memory module (14) for the storage of patterns and messages, as well as

Function module (13) for superimposing an image of the image sensor (11) with in the memory module (14) stored patterns and / or messages.

2. System according to claim 1, characterized in that in the memory module (14) stored patterns and / or messages associated with codes, and that patterns and / or messages by sending the corresponding patterns and / or messages codes from the memory module (14) are available.

3. System according to any one of the preceding claims, characterized in that the camera module (10) has a function module (12) for the equalization of the image sensor

(11) captured images.

4. System according to any one of the preceding claims, characterized in that the camera module (10) comprises at least one interface (function module 15) for the data exchange with a display device (monitor 18).

5. System according to any one of the preceding claims, characterized in that the camera module (10) comprises at least one interface for data exchange with a control unit (17).

6. System according to any one of the preceding claims, characterized in that in the memory module (10) geometric patterns, such as lines, traffic signs and similar symbols, and text messages are stored, the playback on a display device (monitor 18) are controlled by codes.

7. System according to any one of the preceding claims, characterized in that the camera module (10) comprises a consisting of a writing and a read buffer buffer for codes.

8. System according to any one of the preceding claims, characterized in that the

Storage capacity of the write and read buffer is substantially the same size.

9. System according to any one of the preceding claims, characterized in that the emission of codes by output signals of a distance warning device (19, 19A, 19B) are controllable.

10. System according to any one of the preceding claims, characterized in that the camera module (10) is designed as an assembly which is locally remote from the control unit (17) and the display device (monitor 18) is operable, wherein the camera module (10) interfaces ( 15,16), via which it is connectable to the control unit (17) and the display device (monitor 18).