DE102004049872A1 - System for capturing and reproducing images - Google Patents

System for capturing and reproducing images

Info

Publication number
DE102004049872A1
DE102004049872A1 DE200410049872 DE102004049872A DE102004049872A1 DE 102004049872 A1 DE102004049872 A1 DE 102004049872A1 DE 200410049872 DE200410049872 DE 200410049872 DE 102004049872 A DE102004049872 A DE 102004049872A DE 102004049872 A1 DE102004049872 A1 DE 102004049872A1
Authority
DE
Germany
Prior art keywords
characterized
module
messages
system according
patterns
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE200410049872
Other languages
German (de)
Inventor
Jens Schick
Roland Schmid
Ulrich Seger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Robert Bosch GmbH
Original Assignee
Robert Bosch GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Robert Bosch GmbH filed Critical Robert Bosch GmbH
Priority to DE200410049872 priority Critical patent/DE102004049872A1/en
Publication of DE102004049872A1 publication Critical patent/DE102004049872A1/en
Application status is Pending legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, camcorders, webcams, camera modules specially adapted for being embedded in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control ; Control of cameras comprising an electronic image sensor
    • H04N5/23293Electronic viewfinders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed circuit television systems, i.e. systems in which the signal is not broadcast

Abstract

The invention relates to a system 1 for capturing and reproducing images, comprising a camera module 10 comprising an image sensor 11, a display device 18 and a control device 17. The camera module 10 comprises a memory module 14 for storing patterns and messages and a functional module 13 for the superposition of an image of the image sensor 11 with stored in the memory module 14 patterns and / or messages.

Description

  • The The invention relates to a system for the capture and reproduction of images according to the preamble of Claim 1. The system of the generic type is preferably as a driver assistance system to assist the driver of a motor vehicle. However, the invention is not limited to this preferred application, but is suitable for a use in all applications where a video image with icons and / or texts superimposed and on a display device, in particular a monitor, should be displayed.
  • vehicles are increasingly being equipped with so-called parking pilots in their original equipment, which should facilitate the parking. Such a parking pilot system includes short-range sensors, preferably by means of ultrasound measure the distance to an obstacle. Furthermore, a Parked pilot system optical and or acoustic signalers operating in dependence from the output signals of the sensors an optical and / or acoustic Generate warning signal. Although such a parking pilot system already a very useful support for the driver represents are the usual Signalers very abstract and not very clear. Especially inexperienced drivers it falls therefore very difficult, the signals emitted by the signal generator correctly to interpret. Furthermore, it is already known video cameras in a vehicle for The supervision of the vehicle environment. The image signal of the video camera is on a monitor arranged in the field of vision of the driver shown.
  • Out WO 00/74976 A1 discloses a method and a device for visualization of the route known, with an expected at an unchanged steering angle Track of a vehicle is displayed in a display, in the at least part of the rear of the vehicle a vehicle is displayed. A driver is over the informed about the expected route, so that he hit the Steering angle can adapt to an obstacle in the rear of the vehicle can be seen.
  • Out DE 100 15 897 A1 Further, a parking assist apparatus for capturing an image of a rear side of a vehicle by a camera at a parking operation, displaying an image of the camera on a screen provided inside the vehicle as a rear image, and displaying an expected trajectory that changes in accordance with a state of a steering wheel angle to superimpose the rearward image is known. The parking assist apparatus includes a parking-line instructing means for instructing the vehicle to park along a longitudinal line and an anticipated trajectory-indicating means for displaying the prospective trajectory with a turning point in accordance with the steering wheel angle when the vehicle is instructed by the parking instruction means to park along the longitudinal line ,
  • Advantages of invention
  • The Invention offers the advantage of having a system for capture and playback of images with a camera module provided in the Able to receive simple signals from a controller and these signals overlay assigned patterns or messages with a captured image and this image on a display device, in particular a Monitor. This has the Camera module over a memory module for the storage of patterns and / or messages, as well as over Function module for the overlay an image of an image sensor with stored in the memory module Patterns and / or messages. Advantageous are the stored patterns and Messages codes associated with which the patterns and messages can be retrieved from the memory module. As it is with these codes is only about comparatively short messages, is their provision only with a small load on the computer capacity of one connected to the camera module cooperating controller. Advantageously the camera module at least one interface each for data exchange with a control unit and a monitor. this makes possible in a simple way one of the control unit and the monitor locally remote Operation of the camera module. The camera module can therefore, for example for a surveillance the rearward vehicle environment optimally placed in the rear area of a vehicle during the Monitor remains in the field of view of the driver.
  • Advantageously, the transmission of codes is controlled by output signals of a distance warning device. In this way, a video image provided by an image sensor can be pattern and message be superimposed on those that facilitate reversing or parking.
  • Further Advantages will be apparent from the description and other dependent claims.
  • drawing
  • embodiments The invention will be explained in more detail with reference to the drawing. there shows
  • 1 a block diagram of a system for the capture and playback of images,
  • 2 the presentation of a video image with overlaid patterns and messages on a monitor,
  • 3 the block diagram of an alternating buffer.
  • description the embodiments
  • 1 shows the block diagram of a system according to the invention for the detection and reproduction of images 1 , The system 1 includes a camera module 10 , a distance warning device 19 . 19A . 19B , a display device, in particular a monitor 1S , and a controller 17 , The camera module 10 includes an image sensor 11 to which a functional module 12 followed. The functional module 12 is with a functional module 13 connected The functional module 13 is on the one hand with a memory module 14 and on the other hand with a functional module 16 connected. Furthermore, the functional module 13 with a functional module 15 connected. The functional module 16 includes an input terminal 16A about it with a control unit 17 connected is. The functional module 15 includes an output port 15A over which the camera module 10 with a monitor 18 is connectable. In an advantageous embodiment of the invention, the image sensor comprises 11 a photosensitive semiconductor chip, preferably a CCD sensor and an optical module 11A , the scenes from the recording area of the image recording and playback system 1 imaged on the semiconductor chip. As an optical module 11A Preferably, a wide-angle lens with an opening angle of about 100 ° to 120 ° is used. The image sensor 11 provides at its output a raw image that the input of the function module 12 is supplied. The functional module 12 equalizes that from the image sensor 11 provided raw image and provides a corrected image to the function module 13 , In order to get along with the least possible computing power, are in the with the function module 13 connected memory module 14 stored advantageously predetermined patterns and messages. For example, the patterns may be simple geometric structures such as broken and unbroken lines of different widths and colors. These lines may be target and Isttrajektorien and / or distance lines, for example, signal a certain distance to an obstacle. Furthermore, the stored patterns may include warning symbols, pictograms, traffic signs and the like. The stored messages are preferably brief notes and warnings in textual form intended to assist the driver. In particular, the messages also include failure messages that indicate errors in the system according to the invention and / or errors in other systems of the vehicle. In a basic version, the memory module includes 14 a standard set of patterns and messages. In an advantageous embodiment, the content of the memory module 14 customized. For example, such that, in addition to the standard set of patterns and messages, custom information is supplemented. Alternatively, the default set may be deleted and completely replaced by a custom set of patterns and messages. The functional module 13 is with the functional module 16 connect. The functional module 16 in turn is via an input port 16A with a control unit 17 connected, which is the function of the camera module 10 controls, as will be described later. Furthermore, the control unit with a distance warning device 19 connected, which also has multiple sensors 19A . 19B includes. As sensors 19A . 19B have proven in practice ultrasonic sensors. The use of radar and laser sensors is also conceivable. Furthermore, the functional module 13 with a functional module 15 connected, which has an output terminal 15A having. About this output terminal 15A is the camera module 10 with a reproduction device for images, in particular a monitor 18 , connected. The main task of the function module 15 is the adaptation of the output signals of the function module 13 to the respective monitor to be used 18 , In one embodiment of the invention, for example, a color monitor 18 connected according to the NTSC standard. Therefore, the functional module is advantageous 15 as interface output signals according to this standard ready. A particularly advantageous property of the system according to the invention 1 is that overlay that of the image sensor 11 captured images with the stored in the memory device patterns and / or messages by comparatively simple control signals of the control unit 17 is possible. As a result, the computing power of the controller is not overwhelmed. This is accomplished by having each pattern and message appearing in the memory module 14 are stored, a one-to-one code is assigned, both in the control unit 17 as well as in the storage device 14 is deposited. If a particular pattern or message from the storage device 14 is to be retrieved, therefore, the controller 17 only the code corresponding to this pattern or this message via the function module 16 , the functional module 13 to the storage device 14 send. By sending this code, the corresponding pattern or message will be sent from the storage device 14 to the function module 13 provided. The functional module 13 acts as a mixer, in de that of the functional module 12 provided rectified image of the image sensor 11 with one of the storage device 14 supplied pattern or message. At the output terminal 15A of the camera module 10 is thus provided with a comment image for playback on a monitor 18 ready. In the described embodiment, the output of the code to be transmitted is by the distance warning device 19 with their sensors 19A . 19B controllable. The patterns and / or messages to be superimposed on the video image by outputting a code therefore preferably relate to distance information of the vehicle with respect to the vehicle environment. in other instances, the output of codes may be controlled by other means. For example, signals from a restraint system for vehicle occupants can control the issuing of codes when danger is imminent. The message called by the corresponding code can then be superimposed on a video image. In an advantageous development of the invention can from that of the image sensor 11 information extracted for generating a code with subsequent superimposition of the video image with one in the memory module 14 stored message leads. This is useful, for example, when the image sensor 11 , is used as a precrash sensor. For this purpose, then a connection line 11B between the image sensor 11 and the controller 17 be provided.
  • In a simpler embodiment of the invention is a control device 17 not needed when the distance warning device 19 even has an interface that generates corresponding codes. As in 1 through the connection line shown in dashed lines 19C is indicated, then the distance warning device 19 directly with the function module 16 connected.
  • The functioning of the system according to the invention will now be described below 1 for capturing and playing back images. It is based on a concrete example ( 2 ) In particular, the superposition of one of the image sensor 11 recorded image with patterns and / or messages explained. The image sensor 11 with the upstream optical module 11A captures a scene from the environment of the vehicle 20 ( 2 ) and continuously stores the captured image in an input image memory. In a preferred embodiment, the image sensor has 11 at least VGA resolution. The input image memory has a storage capacity of around 350 Kbytes. In the function module 12 the picture is equalized. The equalized image is stored in an output image memory, which in one embodiment preferably has a memory capacity of about 1 MB. In the memory module 14 Patterns and messages are stored with the codes assigned to them. As a pattern, for example, lines of different design and color or more complex symbols are considered. Preferably, the lines can each be assigned to a steering angle. In one embodiment of the invention, 64 values of selected steering angles are assigned to lines, respectively. Other lines are provided for representing distance values or artifacts, such as faded bumper, warning trapezoids, and the like. Furthermore, vehicle symbols, traffic signs and roadway structures can also be stored. Furthermore, messages in text form, such as warning and warning texts, as well as failure messages are stored. 2 shows one on the monitor 18 represented scene from the environment of a vehicle 20 , The scene shows one of a wall 24 demarcated house 25 , A vehicle 20 is getting ready, backwards to a parking lot in front of the wall 24 to park. The parking process is by a distance warning device 19 with sensors 19A . 19B ( 1 ) supervised. In the on the monitor 18 The video image shown includes patterns and messages which, together with the codes assigned to them, are shown in the following table.
  • Figure 00070001
  • These patterns and messages are, along with many other patterns and messages, in the memory module 14 of the camera module 10 saved. They are retrieved by an appropriate code provided by the controller 17 to the camera module 10 is sent. In the embodiment discussed, the code "1" corresponds to a rectangular vehicle symbol representing the vehicle 20 represents. The code 2 corresponds to a line 21 at 6m from the wall 24 in the picture on the monitor 18 is displayed. The code 5 corresponds to the text message "6m", which is to the line 21 is properly displayed. The double line 23 and the associated text message "Stop!" signal the driver of the vehicle 20 he is the vehicle 20 at this double line 23 should stop, so that this occupies an optimal parking position. The double line 23 and the text message "Stop!" will be through the codes 4 and 7 called. In the present embodiment, the transmission of the various codes is determined by output signals of the distance warning device 19 determines the signals of its associated sensors 19A . 19B evaluates. With the sensors 19A . 19B they are preferably ultrasonic sensors, which are the distance of the rear of the vehicle 20 from the wall 24 measure up. The line 21 . 22 . 23 and the associated text messages can be displayed, for example, when the sensors 19A . 19B have measured a corresponding distance. The patterns and messages may vary widely in the memory module 14 stored and called by associated codes. So can the lines 21 . 22 . 23 for example, in different types of lines as solid lines, dotted lines or dashed lines are shown. Furthermore, the lines can be shown in different widths or in different colors. Also, different patterns and messages can be arbitrarily linked. All these measures are controllable by associated codes. By doing that, the controller 17 only provide codes, but the sent codes corresponding patterns and messages from the memory module 14 in the camera module 10 ready to be retrieved, comes the control unit 17 even with a greatly reduced computer performance.
  • The following section explains how to pass the code. Preferably, the codes are asynchronously in a swap buffer 30 ( 3 ), which stores a read and a write buffer 32 . 31 includes. In an advantageous embodiment of the invention, the read and write buffers take 32 . 31 each 32 Codes on. The write buffer 31 is over the entrance 16A filled. The change between read and write buffer is advantageously also controlled by a special code. The read buffer 32 is read synchronously.
  • The overlay of the image sensor 11 provided video image with the codes and / or messages retrievable by codes is done as follows. That of the image sensor 11 generated image is continuously written to an input memory. With the help of the function module 12 The image is equalized and converted into an output image. From the read buffer 32 The codes stored there are successively read out. The patterns and / or messages corresponding to the read codes are read from the memory module 14 and in the function module 13 overlaid with the output image. Through the function module 15 the image data are displayed on the monitor 18 provided.
  • Preferably, the camera module 10 locally remote from the control unit 17 and the monitor 18 operated. This is particularly useful when using the system 1 as a driver assistance system, in which the camera module in the rear area of a vehicle 20 is arranged that the rear traffic area is monitorable while the monitor 18 is arranged in the field of vision of the driver. The control unit 17 can then be placed anywhere in the vehicle. For data exchange with the control unit 17 and the monitor 18 has the camera module 10 at least one each corre sponding friendly interface 15 . 16 ,

Claims (10)

  1. System ( 1 ) for capturing and reproducing images, with an image sensor ( 11 ) comprehensive camera module ( 10 ), a playback device ( 18 ) and a control unit ( 17 ), characterized in that the camera module ( 10 ) a memory module ( 14 ) for storing patterns and messages, as well as a functional module ( 13 ) for the superimposition of an image of the image sensor ( 11 ) in the memory module ( 14 ) stored patterns and / or messages.
  2. System according to claim 1, characterized in that in the memory module ( 14 ) are assigned to stored patterns and / or messages codes, and that patterns and / or messages by sending the corresponding patterns and / or messages codes from the memory module ( 14 ) are available.
  3. System according to one of the preceding claims, characterized in that the camera module ( 10 ) a functional module ( 12 ) for the equalization of the image sensor ( 11 ) comprises captured images.
  4. System according to one of the preceding claims, characterized in that the camera module ( 10 ) at least one interface (function module 15 ) for data exchange with a display device (Monitor 18 ).
  5. System according to one of the preceding claims, characterized in that the camera module ( 10 ) at least one interface for the data exchange with a control device ( 17 ).
  6. System according to one of the preceding claims, characterized in that in the memory module ( 10 ) geometric patterns, such as lines, traffic signs and similar symbols, as well as text messages are stored, their reproduction on a display device (Monitor 18 ) are controllable by codes.
  7. System according to one of the preceding claims, characterized in that the camera module ( 10 ) comprises an alternating buffer of codes consisting of a writing and a reading buffer.
  8. System according to one of the preceding claims, characterized characterized in that the storage capacity of the write and read buffer is essentially the same size.
  9. System according to one of the preceding claims, characterized in that the emission of codes by output signals of a distance warning device ( 19 . 19A . 19B ) are controllable.
  10. System according to one of the preceding claims, characterized in that the camera module ( 10 ) is designed as an assembly which is locally offset from the control unit ( 17 ) and the playback device (monitor 18 ) is operable, wherein the camera module ( 10 ) Interfaces ( 15 . 16 ) via which it is connected to the control unit ( 17 ) and the playback device (monitor 18 ) is connectable.
DE200410049872 2004-10-13 2004-10-13 System for capturing and reproducing images Pending DE102004049872A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
DE200410049872 DE102004049872A1 (en) 2004-10-13 2004-10-13 System for capturing and reproducing images

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
DE200410049872 DE102004049872A1 (en) 2004-10-13 2004-10-13 System for capturing and reproducing images
PCT/EP2005/054286 WO2006040218A1 (en) 2004-10-13 2005-08-31 System for the detection and reproduction of images
US11/665,429 US20080036878A1 (en) 2004-10-13 2005-08-31 System for Capturing and Displaying Images
CN 200580034921 CN101040516A (en) 2004-10-13 2005-08-31 System for the detection and reproduction of images
EP20050787305 EP1803292A1 (en) 2004-10-13 2005-08-31 System for the detection and reproduction of images

Publications (1)

Publication Number Publication Date
DE102004049872A1 true DE102004049872A1 (en) 2006-04-20

Family

ID=35229970

Family Applications (1)

Application Number Title Priority Date Filing Date
DE200410049872 Pending DE102004049872A1 (en) 2004-10-13 2004-10-13 System for capturing and reproducing images

Country Status (5)

Country Link
US (1) US20080036878A1 (en)
EP (1) EP1803292A1 (en)
CN (1) CN101040516A (en)
DE (1) DE102004049872A1 (en)
WO (1) WO2006040218A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006019726A1 (en) * 2006-04-27 2007-10-31 Siemens Ag Image sensor for use in e.g. rear view camera, has processing device producing one image data set, which is assigned to image from another image data set by combining signals of image points with appropriate correction signals
WO2013020747A1 (en) * 2011-08-08 2013-02-14 Robert Bosch Gmbh Image capturing device

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006052779A1 (en) * 2006-11-09 2008-05-15 Bayerische Motoren Werke Ag Method for generating an overall image of the surroundings of a motor vehicle
US8903553B1 (en) 2009-05-01 2014-12-02 Comverge, Inc. Method and system for controlling unitary air conditioners for reducing peak loads
US8239068B1 (en) 2009-06-26 2012-08-07 Comverge, Inc. Method and system for cooperative powering of unitary air conditioners
DE102011121285A1 (en) * 2011-12-15 2013-06-20 Gm Global Technology Operations, Llc Parking aid
CN102938832B (en) * 2012-10-12 2016-08-24 广东丰诺汽车安全科技有限公司 A kind of information display system
US20140327775A1 (en) * 2013-12-04 2014-11-06 Kyu Hwang Cho Mirrorless Driving of Automotive Vehicle Using Digital Image Sensors and Touchscreen
CN105984378A (en) * 2015-04-14 2016-10-05 智车优行科技(北京)有限公司 Automobile voice prompting system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4096445B2 (en) * 1999-03-31 2008-06-04 アイシン精機株式会社 Parking assistance device
KR100748859B1 (en) * 1999-05-28 2007-08-13 소니 가부시끼 가이샤 Image pick-up apparatus
DE19925584A1 (en) * 1999-06-04 2000-12-21 Bosch Gmbh Robert A method for visualizing a driving path and device
US6411867B1 (en) * 1999-10-27 2002-06-25 Fujitsu Ten Limited Vehicle driving support system, and steering angle detection device
US6476730B2 (en) * 2000-02-29 2002-11-05 Aisin Seiki Kabushiki Kaisha Assistant apparatus and method for a vehicle in reverse motion
US7148914B2 (en) * 2001-04-25 2006-12-12 Hewlett-Packard Development Company, L.P. Method and apparatus for providing subimages to remote sites
JP3812824B2 (en) * 2002-03-12 2006-08-23 カシオ計算機株式会社 Imaging apparatus, focusing status display method, and program
JP2003329462A (en) * 2002-05-08 2003-11-19 Hitachi Ltd Image distribution device and image information distribution system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102006019726A1 (en) * 2006-04-27 2007-10-31 Siemens Ag Image sensor for use in e.g. rear view camera, has processing device producing one image data set, which is assigned to image from another image data set by combining signals of image points with appropriate correction signals
WO2013020747A1 (en) * 2011-08-08 2013-02-14 Robert Bosch Gmbh Image capturing device
US9706125B2 (en) 2011-08-08 2017-07-11 Robert Bosch Gmbh Image capturing device

Also Published As

Publication number Publication date
US20080036878A1 (en) 2008-02-14
EP1803292A1 (en) 2007-07-04
WO2006040218A1 (en) 2006-04-20
CN101040516A (en) 2007-09-19

Similar Documents

Publication Publication Date Title
US6970184B2 (en) Image display method and apparatus for rearview system
JP3298851B2 (en) Image display method of the multi-function onboard camera system and a multi-function onboard camera
JP3483143B2 (en) Driving support device
CN100367314C (en) Driving support system and method of producing overhead view image
US8058980B2 (en) Vehicle periphery monitoring apparatus and image displaying method
US8138899B2 (en) Rear camera backup assistance with touchscreen display using two points of interest
JP2009081664A (en) Vehicle periphery monitoring apparatus and image display method
JP4720386B2 (en) Driving assistance device
JP2005112004A (en) Vehicle reversing motion assisting device and vehicle reversing motion assisting method
JP4956915B2 (en) Video display device and video display method
US6847873B1 (en) Driver information feedback and display system
US8089512B2 (en) Driving support device, driving support method and computer program
EP1916846B1 (en) Device and method for monitoring vehicle surroundings
DE60223095T2 (en) Device for image synthesis
JP5523448B2 (en) Driving support system, information display device, and information display program
JP2007142735A (en) Periphery monitoring system
CN101269644B (en) Vehicle outside display system and display control apparatus
JP4863791B2 (en) Vehicle peripheral image generation apparatus and image switching method
KR100743171B1 (en) Display device
JP3494434B2 (en) Parking assistance device
JP4766841B2 (en) Camera device and vehicle periphery monitoring device mounted on vehicle
DE102011010624B4 (en) Display device for fields of view of a commercial vehicle
KR101362496B1 (en) Parking assistance system and parking assistance method
JP2008227646A (en) Obstacle detector
DE102008039136B4 (en) Camera system for a vehicle and method for controlling a camera system

Legal Events

Date Code Title Description
R012 Request for examination validly filed

Effective date: 20110905

R016 Response to examination communication
R016 Response to examination communication