The invention relates to a system for
the capture and reproduction of images according to the preamble of
Claim 1. The system of the generic type is preferably
as a driver assistance system to assist the driver of a motor vehicle.
However, the invention is not limited to this preferred application, but
is suitable for
a use in all applications where a video image with icons
and / or texts superimposed
and on a display device, in particular a monitor,
should be displayed.
are increasingly being equipped with so-called parking pilots in their original equipment,
which should facilitate the parking. Such a parking pilot system
includes short-range sensors, preferably by means of ultrasound
measure the distance to an obstacle. Furthermore, a
Parked pilot system optical and or acoustic signalers operating in
from the output signals of the sensors an optical and / or acoustic
Generate warning signal. Although such a parking pilot system already
a very useful support for the driver
represents are the usual
Signalers very abstract and not very clear. Especially inexperienced drivers
therefore very difficult, the signals emitted by the signal generator correctly
to interpret. Furthermore, it is already known video cameras
in a vehicle for
of the vehicle environment. The image signal of the video camera
is on a monitor arranged in the field of vision of the driver
WO 00/74976 A1 discloses a method and a device for visualization of the route
known, with an expected at an unchanged steering angle
Track of a vehicle is displayed in a display, in the
at least part of the rear of the vehicle
a vehicle is displayed. A driver is over the
informed about the expected route, so that he hit the
Steering angle can adapt to an obstacle in the rear of the vehicle
can be seen.
Out DE 100 15 897 A1
Further, a parking assist apparatus for capturing an image of a rear side of a vehicle by a camera at a parking operation, displaying an image of the camera on a screen provided inside the vehicle as a rear image, and displaying an expected trajectory that changes in accordance with a state of a steering wheel angle to superimpose the rearward image is known. The parking assist apparatus includes a parking-line instructing means for instructing the vehicle to park along a longitudinal line and an anticipated trajectory-indicating means for displaying the prospective trajectory with a turning point in accordance with the steering wheel angle when the vehicle is instructed by the parking instruction means to park along the longitudinal line ,
Invention offers the advantage of having a system for capture and playback
of images with a camera module provided in the
Able to receive simple signals from a controller and these signals
overlay assigned patterns or messages with a captured image and
this image on a display device, in particular a
Monitor. This has the
Camera module over
a memory module for
the storage of patterns and / or messages, as well as over
Function module for
an image of an image sensor with stored in the memory module
Patterns and / or messages. Advantageous are the stored patterns
and Messages codes associated with which the patterns and messages
can be retrieved from the memory module. As it is with these codes
is only about comparatively short messages, is their provision
only with a small load on the computer capacity of one
connected to the camera module cooperating controller. Advantageously
the camera module at least one interface each for data exchange
with a control unit
and a monitor. this makes possible
in a simple way one of the control unit and the monitor locally remote
Operation of the camera module. The camera module can therefore, for example
for a surveillance
the rearward vehicle environment
optimally placed in the rear area of a vehicle during the
Monitor remains in the field of view of the driver.
Advantageously, the transmission of codes is controlled by output signals of a distance warning device. In this way, a video image provided by an image sensor can be pattern and message be superimposed on those that facilitate reversing or parking.
Advantages will be apparent from the description and other dependent claims.
The invention will be explained in more detail with reference to the drawing. there
1 a block diagram of a system for the capture and playback of images,
2 the presentation of a video image with overlaid patterns and messages on a monitor,
3 the block diagram of an alternating buffer.
1 shows the block diagram of a system according to the invention for the detection and reproduction of images 1 , The system 1 includes a camera module 10 , a distance warning device 19 . 19A . 19B , a display device, in particular a monitor 1S , and a controller 17 , The camera module 10 includes an image sensor 11 to which a functional module 12 followed. The functional module 12 is with a functional module 13 connected The functional module 13 is on the one hand with a memory module 14 and on the other hand with a functional module 16 connected. Furthermore, the functional module 13 with a functional module 15 connected. The functional module 16 includes an input terminal 16A about it with a control unit 17 connected is. The functional module 15 includes an output port 15A over which the camera module 10 with a monitor 18 is connectable. In an advantageous embodiment of the invention, the image sensor comprises 11 a photosensitive semiconductor chip, preferably a CCD sensor and an optical module 11A , the scenes from the recording area of the image recording and playback system 1 imaged on the semiconductor chip. As an optical module 11A Preferably, a wide-angle lens with an opening angle of about 100 ° to 120 ° is used. The image sensor 11 provides at its output a raw image that the input of the function module 12 is supplied. The functional module 12 equalizes that from the image sensor 11 provided raw image and provides a corrected image to the function module 13 , In order to get along with the least possible computing power, are in the with the function module 13 connected memory module 14 stored advantageously predetermined patterns and messages. For example, the patterns may be simple geometric structures such as broken and unbroken lines of different widths and colors. These lines may be target and Isttrajektorien and / or distance lines, for example, signal a certain distance to an obstacle. Furthermore, the stored patterns may include warning symbols, pictograms, traffic signs and the like. The stored messages are preferably brief notes and warnings in textual form intended to assist the driver. In particular, the messages also include failure messages that indicate errors in the system according to the invention and / or errors in other systems of the vehicle. In a basic version, the memory module includes 14 a standard set of patterns and messages. In an advantageous embodiment, the content of the memory module 14 customized. For example, such that, in addition to the standard set of patterns and messages, custom information is supplemented. Alternatively, the default set may be deleted and completely replaced by a custom set of patterns and messages. The functional module 13 is with the functional module 16 connect. The functional module 16 in turn is via an input port 16A with a control unit 17 connected, which is the function of the camera module 10 controls, as will be described later. Furthermore, the control unit with a distance warning device 19 connected, which also has multiple sensors 19A . 19B includes. As sensors 19A . 19B have proven in practice ultrasonic sensors. The use of radar and laser sensors is also conceivable. Furthermore, the functional module 13 with a functional module 15 connected, which has an output terminal 15A having. About this output terminal 15A is the camera module 10 with a reproduction device for images, in particular a monitor 18 , connected. The main task of the function module 15 is the adaptation of the output signals of the function module 13 to the respective monitor to be used 18 , In one embodiment of the invention, for example, a color monitor 18 connected according to the NTSC standard. Therefore, the functional module is advantageous 15 as interface output signals according to this standard ready. A particularly advantageous property of the system according to the invention 1 is that overlay that of the image sensor 11 captured images with the stored in the memory device patterns and / or messages by comparatively simple control signals of the control unit 17 is possible. As a result, the computing power of the controller is not overwhelmed. This is accomplished by having each pattern and message appearing in the memory module 14 are stored, a one-to-one code is assigned, both in the control unit 17 as well as in the storage device 14 is deposited. If a particular pattern or message from the storage device 14 is to be retrieved, therefore, the controller 17 only the code corresponding to this pattern or this message via the function module 16 , the functional module 13 to the storage device 14 send. By sending this code, the corresponding pattern or message will be sent from the storage device 14 to the function module 13 provided. The functional module 13 acts as a mixer, in de that of the functional module 12 provided rectified image of the image sensor 11 with one of the storage device 14 supplied pattern or message. At the output terminal 15A of the camera module 10 is thus provided with a comment image for playback on a monitor 18 ready. In the described embodiment, the output of the code to be transmitted is by the distance warning device 19 with their sensors 19A . 19B controllable. The patterns and / or messages to be superimposed on the video image by outputting a code therefore preferably relate to distance information of the vehicle with respect to the vehicle environment. in other instances, the output of codes may be controlled by other means. For example, signals from a restraint system for vehicle occupants can control the issuing of codes when danger is imminent. The message called by the corresponding code can then be superimposed on a video image. In an advantageous development of the invention can from that of the image sensor 11 information extracted for generating a code with subsequent superimposition of the video image with one in the memory module 14 stored message leads. This is useful, for example, when the image sensor 11 , is used as a precrash sensor. For this purpose, then a connection line 11B between the image sensor 11 and the controller 17 be provided.
In a simpler embodiment of the invention is a control device 17 not needed when the distance warning device 19 even has an interface that generates corresponding codes. As in 1 through the connection line shown in dashed lines 19C is indicated, then the distance warning device 19 directly with the function module 16 connected.
The functioning of the system according to the invention will now be described below 1 for capturing and playing back images. It is based on a concrete example ( 2 ) In particular, the superposition of one of the image sensor 11 recorded image with patterns and / or messages explained. The image sensor 11 with the upstream optical module 11A captures a scene from the environment of the vehicle 20 ( 2 ) and continuously stores the captured image in an input image memory. In a preferred embodiment, the image sensor has 11 at least VGA resolution. The input image memory has a storage capacity of around 350 Kbytes. In the function module 12 the picture is equalized. The equalized image is stored in an output image memory, which in one embodiment preferably has a memory capacity of about 1 MB. In the memory module 14 Patterns and messages are stored with the codes assigned to them. As a pattern, for example, lines of different design and color or more complex symbols are considered. Preferably, the lines can each be assigned to a steering angle. In one embodiment of the invention, 64 values of selected steering angles are assigned to lines, respectively. Other lines are provided for representing distance values or artifacts, such as faded bumper, warning trapezoids, and the like. Furthermore, vehicle symbols, traffic signs and roadway structures can also be stored. Furthermore, messages in text form, such as warning and warning texts, as well as failure messages are stored. 2 shows one on the monitor 18 represented scene from the environment of a vehicle 20 , The scene shows one of a wall 24 demarcated house 25 , A vehicle 20 is getting ready, backwards to a parking lot in front of the wall 24 to park. The parking process is by a distance warning device 19 with sensors 19A . 19B ( 1 ) supervised. In the on the monitor 18 The video image shown includes patterns and messages which, together with the codes assigned to them, are shown in the following table.
These patterns and messages are, along with many other patterns and messages, in the memory module 14 of the camera module 10 saved. They are retrieved by an appropriate code provided by the controller 17 to the camera module 10 is sent. In the embodiment discussed, the code "1" corresponds to a rectangular vehicle symbol representing the vehicle 20 represents. The code 2 corresponds to a line 21 at 6m from the wall 24 in the picture on the monitor 18 is displayed. The code 5 corresponds to the text message "6m", which is to the line 21 is properly displayed. The double line 23 and the associated text message "Stop!" signal the driver of the vehicle 20 he is the vehicle 20 at this double line 23 should stop, so that this occupies an optimal parking position. The double line 23 and the text message "Stop!" will be through the codes 4 and 7 called. In the present embodiment, the transmission of the various codes is determined by output signals of the distance warning device 19 determines the signals of its associated sensors 19A . 19B evaluates. With the sensors 19A . 19B they are preferably ultrasonic sensors, which are the distance of the rear of the vehicle 20 from the wall 24 measure up. The line 21 . 22 . 23 and the associated text messages can be displayed, for example, when the sensors 19A . 19B have measured a corresponding distance. The patterns and messages may vary widely in the memory module 14 stored and called by associated codes. So can the lines 21 . 22 . 23 for example, in different types of lines as solid lines, dotted lines or dashed lines are shown. Furthermore, the lines can be shown in different widths or in different colors. Also, different patterns and messages can be arbitrarily linked. All these measures are controllable by associated codes. By doing that, the controller 17 only provide codes, but the sent codes corresponding patterns and messages from the memory module 14 in the camera module 10 ready to be retrieved, comes the control unit 17 even with a greatly reduced computer performance.
The following section explains how to pass the code. Preferably, the codes are asynchronously in a swap buffer 30 ( 3 ), which stores a read and a write buffer 32 . 31 includes. In an advantageous embodiment of the invention, the read and write buffers take 32 . 31 each 32 Codes on. The write buffer 31 is over the entrance 16A filled. The change between read and write buffer is advantageously also controlled by a special code. The read buffer 32 is read synchronously.
The overlay of the image sensor 11 provided video image with the codes and / or messages retrievable by codes is done as follows. That of the image sensor 11 generated image is continuously written to an input memory. With the help of the function module 12 The image is equalized and converted into an output image. From the read buffer 32 The codes stored there are successively read out. The patterns and / or messages corresponding to the read codes are read from the memory module 14 and in the function module 13 overlaid with the output image. Through the function module 15 the image data are displayed on the monitor 18 provided.
Preferably, the camera module 10 locally remote from the control unit 17 and the monitor 18 operated. This is particularly useful when using the system 1 as a driver assistance system, in which the camera module in the rear area of a vehicle 20 is arranged that the rear traffic area is monitorable while the monitor 18 is arranged in the field of vision of the driver. The control unit 17 can then be placed anywhere in the vehicle. For data exchange with the control unit 17 and the monitor 18 has the camera module 10 at least one each corre sponding friendly interface 15 . 16 ,