Classifications

• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
  • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
  • B60R1/28—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with an adjustable field of view
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F18/00—Pattern recognition
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B60—VEHICLES IN GENERAL
  • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
  • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
  • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
  • B60R2300/802—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views
  • B60R2300/8026—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for monitoring and displaying vehicle exterior blind spot views in addition to a rear-view mirror system

Definitions

• the present invention relates to a vision system for a commercial vehicle, with which a not directly visible space in the environment of a commercial vehicle can be monitored, in particular in the vicinity of a commercial vehicle.
• a primary mirror on the driver and passenger side prescribed by which the driver can see a flat and horizontal part of the lane of certain width, located at a statutory distance below the eyepoints of the driver extends to the horizon.
• areas, so-called fields of view are required to be viewed, which are usually imaged by wide-angle mirror.
• wide-angle mirrors in each case an area behind the eye points of the driver is viewed in a specific extent in the longitudinal direction of the vehicle, which is wider than the area which can be seen through the main mirror, but only has to extend along the vehicle for a certain length.
• vision systems for trucks and other commercial vehicles have also been developed, with which areas around the vehicle can be observed in a clear and simple manner for the vehicle driver while at the same time minimizing the influence of the vehicle's flow when driving protruding mirror, which affect the flow must be provided on the vehicle, so that a lower fuel consumption can be expected.
• Such vision systems include, in addition to at least one recording unit, which may be realized for example by a camera or other image sensors, a display unit in the cab, such as a display. The images taken by the recording unit are displayed on the display unit or the display units in the cab.
• such a vision system for a commercial vehicle described by means of which legally prescribed fields of view can be mapped in particular, for example, the field of view of a main and a wide-angle mirror.
• at least two of the fields of view prescribed for permanent display while driving are displayed permanently and in real time on the display unit in the driver's cab.
• the fields of view are shown similar to a mirror arrangement in a representation, for example, side by side. It is also known to display the fields of view in overlapping representation on the display unit.
• a system is known from DE 10254035 B4, in which by means of a rear-view camera arranged at the rear of the vehicle, an image of a behind the rear vehicle de lying monitoring space on a screen which is arranged in a cab of the vehicle is shown.
• a mark is further mounted, which is positioned so that the vehicle when starting a loading station associated with the marking has a predetermined loading position when in the screen between the mark and a predetermined, one of the tail lift of the vehicle ge Dunen corner or edge of the Loading station is reached an overlap.
• This means that the rearward field of view is directed straight back, so that the image plane and the projection plane on the representation extend substantially perpendicular to the vehicle central axis of the vehicle.
• At least one imaging device is provided for each non-visible and to-be-displayed partial area around the vehicle.
• the system further includes image data transfer means, image data processing means and at least one image reproduction means.
• the invention is based on the idea of giving the driver, when looking at the image displayed in the driver's cabin, the impression that he would only be able to leave the utility vehicle in a corresponding direction without being obstructed by non-transparent areas of the utility vehicle. vehicle and thus corresponds to what a natural perception, without obstruction by non-transparent areas of the commercial vehicle, could be expected. This is achieved by locating both the ground plane to which the representation relates by Cartesian coordinates whose first axis contains a vector which lies in the vehicle center plane, just as the projection plane is spanned by Cartesian coordinates, of which in turn a coordinate vector spanning the plane is selected to lie on the map of the vehicle midplane.
• the projection of a vector connecting two arbitrary points in the captured image onto the vehicle center plane vector spanning the ground plane and the projection of the pixels of these two points onto the vector located on the vehicle center plane image and the image plane spanned also have the same direction. Further, this is achieved by corresponding to the projection of the vector connecting two arbitrary points to the other of the other plane-spanning Cartesian coordinate vectors in the ground plane and the projection plane, respectively, and having the same direction.
• the invention is particularly applicable to a commercial vehicle that is a class N2 or N3 lorry or a class M2 or M3 bus.
• the areas detected by the image capture device i. the sets of points are chosen so as to detect at least one legally prescribed field of view and / or a non-directly visible area at the front, i. in the direction of travel in front of the vehicle and vome laterally, not directly visible area laterally in the middle and / or not directly visible area behind.
• the selection of the areas shown may depend on the driving situation. That is, for example, when reversing a different area can be displayed as in normal forward drive.
• the units are arranged for receiving at a height h above the roadway, where 1, 40 m ⁇ h ⁇ 3.80 m.
• image display it is also possible to display additional information in the image display, for example to highlight critical objects by image processing or to superimpose spacer lines, which indicate the actual distance in meters, for example, to an obstacle, into the image. This helps the driver in addition to the orientation and recognition of potentially endangering objects.
• the driver's attention can also be directed specifically to possible dangerous situations.
• front, rear, side, right, left, etc. used in this specification always refer to the forward direction of travel of a commercial vehicle.
• the visual system described also refers exclusively to commercial vehicles and takes into account the given conditions in these vehicle classes, such as height and total area to be monitored, as well as sitting for a driver on his driver's seat possible direct view.
• Fig. 1 shows schematically not directly visible partial areas on the example of a truck of the class N2 or N3;
• Fig. 2 is a corresponding view for explaining the image pickup
• Fig. 3 is a schematic diagram of the reproducing unit for explaining the projections
• Fig. 4 schematically illustrates the image pickup of a first embodiment
• Fig. 5 schematically shows the image reproduction of the first embodiment
• Fig. 6 shows schematically the image recording of a further embodiment
• Fig. 7 shows schematically the image reproduction of the further embodiment.
• Fig. 1 shows schematically a plan view of a commercial vehicle 1 for explanation and definition of non-directly visible portions.
• the commercial vehicle is a lorry of class N2 or N3.
• the illustration is a top view of the commercial vehicle.
• the directly visible area A is composed of a directly visible area in front AI, a directly visible area on the passenger side A2, and a directly visible area on the driver side A3.
• not directly visible areas B are shown in FIG. 1 formed by a not directly visible area front and front side Bl, not directly visible areas center side B2 and B3 and not directly visible area behind B4.
• the commercial vehicle is on a substantially flat surface, namely the ground plane 4.
• a partial area AI can be seen on the ground level through the windshield using the example of the heavy goods vehicle of class N2 or N3, the partial area A2 can be viewed directly through the side window on the passenger side, and the partial area A3 can be viewed directly from the side window on the driver side.
• the total area B which is not directly visible, thus corresponds to the ground level 4 minus the areas A1, A2, A3.
• a Cartesian coordinate system is defined (see Fig. 2) such that the coordinate origin 13 lies on the ground plane 4 and corresponds to the projected center of the outermost leading edge of the vehicle 9, i. lies in the vehicle center plane or vehicle central axis 12.
• the plane Cartesian reference coordinate system is further defined by the directions xv (7) and yv (6) on the ground plane so that the direction xv (7) lies on the plane projection of the vehicle central longitudinal axis 12 or vehicle center longitudinal plane, and the direction yv (6 ) is perpendicular thereto, the positive yv direction being that direction which points from the origin 13 to the side on which the driver can sit in his driver's seat, ie for right-hand traffic the left side of the vehicle.
• the total area B which is not directly visible or visible, according to FIG. 1, is divided into the following subareas which are not directly visible:
• a section Bl front and side front on the one hand, a subset of the entire not directly visible or visible area B and is also limited by a parallel to the vehicle outer edge 8 on the passenger side at a distance a 2 > 4.5 m in the negative yv direction 6, a parallel to the vehicle outer edge 9 front at a distance b> 3m in the positive xv direction 7, a parallel to the vehicle outer edge 9 front at a distance c> 0.75m to the driving point 5 in the negative xv direction 7 and a parallel to the vehicle outer edge 10 on the driver's side at a distance a *> in the positive yv-direction 6.
• the not directly visible portions B2 and B3 laterally and laterally behind are also subsets of not directly visible or viewable area B, wherein the sub-area B2 is bounded by the passenger-side vehicle outer edge 8, a parallel to the passenger-side outer edge 8 at a distance of a 2 > 4.5m in the negative yv-direction 6, a parallel to the vehicle outer edge 9 at a distance c ⁇ 0.75m to the tribalaug Vietnameseen 5 in negative xv direction 7 and a parallel to the vehicle outer edges 9 front at a distance d> 30m to the driver suction points 5 in the negative xv direction. 7
• the partial area B3 is bounded by the driver-side vehicle outer edge 10, a parallel to the driver-side vehicle outer edge 10 at a distance ai> Im in the positive yv direction 6, a parallel to the vehicle outer edge 9 front at a distance c ⁇ 0.75m to the driver suction points 5 in negative xv Direction 7 and a parallel to the vehicle outer edge 9 front at a distance d> 30m to the driver's suction points 5 in the negative xv direction. 7
• the not directly visible portion B4 rear is also also a subset of the not directly visible area B and is limited by the rear vehicle outer edge 1 1, a parallel to the vehicle outer edge 10 on the driver side at a distance xi> 0 in the positive yv direction 6, a Parallel to the vehicle outer edge 8 on the passenger side at a distance x 2 > 0 in the negative yv direction 6 and a parallel to the vehicle outer edge 1 1 behind at a distance e> 9m in the negative xv direction. 7
• the description refers to the embodiment of a truck.
• the boundaries of the areas B1, B2, B3, B4 are given for this example, but may be adapted and modified accordingly for other commercial vehicles.
• the not directly visible or visible areas Bl, B2, B3, B4 areas around the commercial vehicle, the front and front laterally, in the middle of the side (left or right) and behind behind the utility vehicle and the driver can not be viewed directly.
• FIG. 2 schematically illustrates the image acquisition by means of the image recording device.
• the reference coordinate system is, as explained in connection with FIG. 1, formed by a plane Cartesian coordinate system xv, yv on the ground plane 4 having its origin on the center of the outermost front edge 9 of the vehicle projected onto the ground plane 4 and at the xv plane projection of the vehicle center axis 12 is located and in the forward direction of travel of the vehicle forward, ie away from this, stretches and is directed, and wherein yv is perpendicular thereto, wherein the positive yv direction is the one which faces toward the driver side of the vehicle 1.
• the image recording units or the image recording unit KE1, KE2, KE3 are mounted on a mounting height h in the commercial vehicle of 1.40 m ⁇ h ⁇ 3.80 m above the ground level 4. This achieves a very low distortion.
• At least one set of points P is recorded, which contains one of the non-directly visible areas Bl or not directly visible areas Bl B4 or non-visible areas Bl B2 B2 or the non-visible areas B1 B2 B3 B4 ,
• the qr, xv vector component 18 corresponds to the xv component of the vector qr 16 in the xv direction 7
• the qr, yv vector component 19 corresponds to the component of the vector qr 16 in the yv direction 6.
• Fig. 3 schematically shows an image display unit and serves to explain the definitions of image reproduction by means of the image display device.
• the device for image display is, for example, a conventional display or, for example, a projection onto one of the structural columns of the driver's cab.
• the device for image display can be designed such that different areas are displayed depending on the driving situation. For example, it makes sense to display the not directly visible portion Bl at standstill or when driving forward to display the not directly visible area B4 when reverse gear engaged and, for example, always show the sections B2 B3 with activated ignition.
• an image P 'of a subset of the point set P is reproduced, a point Q being imaged on the point Q', a point R the point R 'is mapped and the original reference coordinate system, by the xv direction 7 and the yv-direction 6 is spanned on the image reference coordinate system with the xv 'direction 15 and yv' direction 14 is mapped.
• the xv 'direction 15 lies on the image of the vehicle central longitudinal axis 12 and the yv' direction 14 is perpendicular to the xv 'direction 15.
• the reproduction is, as seen from Fig. 3, designed such that the direction of the vector component qr ', yv' 21 and the direction of the vector component qr, yv 19 are equal. Similarly, the direction of the vector component qr ', xv' 20 and the direction of the vector component qr, xv 18 are equal.
• the region Bl which is not directly visible is detected with units for image recording KE1, KE2, KE3 with their detection regions AE1, AE2, AE3.
• the image recording units are preferably arranged at a height h of 1.40 m ⁇ h ⁇ 3.80 m above the ground level 4.
• the projection according to the device for image display is shown in Fig.
• FIGS. 6 and 7 show a further exemplary embodiment which has two units for image recording KE1 and KE2 whose recorded area is displayed in a unit for image reproduction in accordance with the projection explained above.
• the area Bl which is not directly visible, is detected with two units for image recording E1, KE2 with the detection areas AE1, AE2 and, as shown in FIG. 7, by the projection, as explained above, on the unit for Image playback as areas ⁇ , AE2 ', reproduced.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Mechanical Engineering (AREA)
• Theoretical Computer Science (AREA)
• Data Mining & Analysis (AREA)
• General Engineering & Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Bioinformatics & Cheminformatics (AREA)
• Evolutionary Biology (AREA)
• Evolutionary Computation (AREA)
• Physics & Mathematics (AREA)
• Bioinformatics & Computational Biology (AREA)
• General Physics & Mathematics (AREA)
• Artificial Intelligence (AREA)
• Life Sciences & Earth Sciences (AREA)
• Closed-Circuit Television Systems (AREA)
• Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
• Traffic Control Systems (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=45688418

Family Applications (1)

Country Status (6)

Families Citing this family (9)

Citations (1)

Family Cites Families (65)

• 2011
  • 2011-02-11 DE DE102011011048.8A patent/DE102011011048B9/de active Active
• 2012
  • 2012-02-10 WO PCT/EP2012/000613 patent/WO2012107238A1/de active Application Filing
  • 2012-02-10 BR BR112013020327-7A patent/BR112013020327B1/pt active IP Right Grant
  • 2012-02-10 EP EP12704687A patent/EP2520088A1/de not_active Ceased
  • 2012-02-10 KR KR1020137023938A patent/KR101547415B1/ko active IP Right Grant
  • 2012-02-10 US US13/983,264 patent/US9232195B2/en active Active

Patent Citations (1)

Also Published As

Similar Documents

Legal Events