EP1748654A1 - Visualisation de circonférence d"un véhicule - Google Patents

Visualisation de circonférence d"un véhicule Download PDF

Info

Publication number
EP1748654A1
EP1748654A1 EP05734727A EP05734727A EP1748654A1 EP 1748654 A1 EP1748654 A1 EP 1748654A1 EP 05734727 A EP05734727 A EP 05734727A EP 05734727 A EP05734727 A EP 05734727A EP 1748654 A1 EP1748654 A1 EP 1748654A1
Authority
EP
European Patent Office
Prior art keywords
vehicle
viewpoint
section
obstacle
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP05734727A
Other languages
German (de)
English (en)
Other versions
EP1748654A4 (fr
Inventor
Tomoya c/o Matushita Electric Ind. Co NAKANISHI
Akira c/o Matushita Electric Ind. Co ISHIDA
Yutaka c/o Matushita Electric Ind. Co WATANABE
Toru c/o Matushita Electric Ind. Co ICHIKAWA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Publication of EP1748654A1 publication Critical patent/EP1748654A1/fr
Publication of EP1748654A4 publication Critical patent/EP1748654A4/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/22—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle
    • B60R1/23—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view
    • B60R1/27—Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles for viewing an area outside the vehicle, e.g. the exterior of the vehicle with a predetermined field of view providing all-round vision, e.g. using omnidirectional cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/301—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/302—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/60—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective
    • B60R2300/602—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective with an adjustable viewpoint
    • B60R2300/605—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by monitoring and displaying vehicle exterior scenes from a transformed perspective with an adjustable viewpoint the adjustment being automatic
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/70—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by an event-triggered choice to display a specific image among a selection of captured images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8093—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for obstacle warning
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9314—Parking operations
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/932—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles using own vehicle data, e.g. ground speed, steering wheel direction
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327—Sensor installation details
    • G01S2013/93271—Sensor installation details in the front of the vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327—Sensor installation details
    • G01S2013/93272—Sensor installation details in the back of the vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G01S2013/9327—Sensor installation details
    • G01S2013/93274—Sensor installation details on the side of the vehicles

Definitions

  • the present invention relates to a vehicle surrounding display device, and more particularly to a vehicle surrounding display device which selectively displays at least two types of images in the vicinity of a vehicle, and informs a driver of a positional relationship between the vehicle and an obstacle.
  • a vehicle surrounding display device as described above includes a plurality of imaging devices, a plurality of laser range finders, a solid virtual section, an image converting section, and an image display section.
  • the plurality of imaging devices are mounted on a vehicle 1 and these imaging devices image an environment in the vicinity of the vehicle 1.
  • the plurality of laser range finders measure distances to objects within view fields (subjects of the imaging device) from the laser range finders.
  • One imaging device and one laser range finder are disposed in the vicinity of each other.
  • the solid virtual section is operable to obtain a distance image (see an upper left image of FIG. 18) within the view field based on distance information from the laser range finder, and to recognize obj ects within the view field based on an original image (see an upper right image of FIG. 18) imaged by the aforementioned imaging device. Based on the two pieces of image information which are the original image and the distance image, and the information about the recognized objects, a three-dimensional field of view is reproduced by simulating an invisible portion of the objects, which cannot be captured by the imaging device.
  • the three-dimensional information reproduced by solid virtual means is sent to the image converting section.
  • the image converting section As shown in a lower image of FIG. 18, based on the received three-dimensional information, the image converting section generates a bird' s eye view which appears to be imaged by a virtual camera which is set to be virtually mounted above the vehicle.
  • the bird's eye view represents a view of the vehicle and its surroundings seen from an appropriate viewpoint at the side of the vehicle, and is displayed by the image display section.
  • viewpoints for the bird's eye view are set at two points diagonal to the upper right and the upper left of the vehicle, respectively.
  • the bird's eye view imaged from either viewpoint is selectively displayed.
  • the viewpoints for the bird' s eye view are switched to each other in accordance with a steering angle of the vehicle.
  • the conventional display device displays a bird's eye view seen from a virtual camera which is set to be virtually mounted above a vehicle. Therefore, when the vehicle comes in close proximity to an obstacle, the obstacle will enter a dead zone generated by the vehicle, whereby there has been a problem that a driver has a difficulty in visually recognizing the obstacle.
  • an object of the present invention is to provide a vehicle surrounding display device capable of displaying images such that a driver can visually recognize an obstacle more easily.
  • a first aspect of the present invention is directed to a vehicle surrounding display device which selectively displays at least two types of images in a vicinity of a vehicle.
  • the vehicle surrounding display device comprises a measurement section for measuring a distance and a direction from the vehicle to an obstacle in the vicinity of the vehicle; a comparison section for comparing the distance measured by the measurement section with a predetermined threshold value; a viewpoint determination section for determining a predetermined first viewpoint when a comparison result generated by the comparison section indicates that the measured distance is larger than the threshold value, and for determining a second viewpoint based on the direction measured by the measurement section when the comparison result generated by the comparison section indicates that the measured distance is not larger than the threshold value; an image generating section for generating, when receiving the first viewpoint from the viewpoint determination section, a first image representing a view in the vicinity of the vehicle as seen from the received first viewpoint, and for generating, when receiving the second viewpoint from the viewpoint determination section, a second image representing a view of the vehicle and the obstacle as seen from an area in the vicinity of the received
  • a second aspect of the present invention is directed to a vehicle surrounding display method for causing a display device to selectively display at least two types of images in a vicinity of a vehicle.
  • the vehicle surrounding display method comprises a measurement step of measuring a distance and a direction from the vehicle to an obstacle in the vicinity of the vehicle; a comparison step of comparing the distance measured by the measurement section with a predetermined threshold value; a first viewpoint determination step of determining a predetermined first viewpoint when a result received from the comparison step indicates that the measured distance is larger than the threshold value; a first image generating step of generating a first image representing a view in the vicinity of the vehicle as seen from the first viewpoint determined by the first viewpoint determination step; a first display step of displaying the first image generated by the first image generating step; a second viewpoint determination step of determining a second viewpoint based on the distance measured by the measurement step when a result received from the comparison step indicates that the measured distance is not larger than the threshold value; a second image generating step of generating a second image representing a
  • a third aspect of the present invention is directed to a computer program for causing a display device to selectively display at least two types of images in a vicinity of a vehicle.
  • the computer program comprises a measurement step of measuring a distance and a direction from the vehicle to an obstacle in the vicinity of the vehicle; a comparison step of comparing the distance measured by the measurement section with a predetermined threshold value; a first viewpoint determination step of determining a predetermined first viewpoint when a result received from the comparison step indicates that the measured distance is larger than the threshold value; a first image generating step of generating a first image representing a view in the vicinity of the vehicle as seen from the first viewpoint determined by the first viewpoint determination step; a first display step of displaying the first image generated by the first image generating step; a second viewpoint determination step of determining a second viewpoint based on the distance measured by the measurement step when a result received from the comparison step indicates that the measured distance is not larger than the threshold value; a second image generating step of generating a second image representing a view of the vehicle
  • the first viewpoint and the second viewpoint are represented by three-dimensional coordinate values, respectively, a horizontal direction component of the second viewpoint is larger than a horizontal direction component of the first viewpoint, and a vertical direction component of the second viewpoint is smaller than a vertical direction component of the first viewpoint.
  • the three-dimensional coordinates of the first viewpoint are set at a point which is above the vehicle
  • the three-dimensional coordinates of the second viewpoint are set at a point having a predetermined depression angle which is formed between the horizontal plane and a line extending from the second viewpoint in a direction of the vehicle and the obstacle.
  • the second viewpoint is set at a point contained in a vertical plane orthogonal to a line between the vehicle and the obstacle.
  • the vertical plane is a plane which perpendicularly bisects the line between the vehicle and the obstacle.
  • a display section displays a third image different from the second image.
  • a height of the obstacle is measured, and whether the vehicle is capable of moving without contacting the obstacle is determined based on the measured height of the obstacle.
  • a steering angle of the vehicle is detected, and whether the vehicle is capable of moving without contacting the obstacle is determined based on the detected steering angle of the vehicle.
  • the second viewpoint is determined additionally based on the detected steering angle.
  • the second viewpoint is preferably set at three-dimensional coordinate values such that a driver can visually recognize both the obstacle and a spot, on the vehicle, which contacts the obstacle.
  • one distance and one direction which are most likely to contact the vehicle, are preferably selected.
  • the selected distance and direction are compared with predetermined threshold values.
  • the second viewpoint is determined based on the selected direction.
  • a plurality of active sensors are mounted at any of a front part, a rear part, a right side part or a left side part of the vehicle, whereby an obstacle in the vicinity of the vehicle is detected.
  • a distance and a direction from a vehicle to an obstacle are measured.
  • the measured distance is not larger than a predetermined threshold value, i.e., the vehicle and the obstacle are in close proximity to each other
  • the second image data representing a view of the vehicle and the obstacle as seen from an area in the vicinity of the second viewpoint determined based on the measured direction is generated and displayed. Since the second viewpoint is set as such, the obstacle is less likely to enter a dead zone generated by the vehicle in the second image data. Therefore, it becomes possible to provide a vehicle surrounding display device capable of displaying images such that the driver can more easily visually recognize an obstacle.
  • FIG. 1 is a schematic diagram illustrating an example of a block configuration of a vehicle surrounding display device 1 according to an embodiment of the present invention.
  • the vehicle surrounding display device 1 is mounted on a vehicle A.
  • the vehicle surrounding display device 1 includes a measurement section 11, a comparison section 12, a viewpoint determination section 13, an image generating section 14, and a display section 15.
  • the vehicle surrounding display device 1 also includes a data accumulating section 16.
  • Themeasurement section 11 measures at least a distance C and a direction D from the vehicle A to an obstacle B in the vicinity of the vehicle.
  • the measurement section 11 includes a plurality of active sensors 111 (16 such active sensors are illustrated in FIG. 2).
  • the active sensors 111 are typically laser radars, millimeter wave radars, or quasi-millimeter wave radars. Each of the active sensors 111 scans within a range of approximately plus minus 45 degrees horizontally, and scans within a range of approximately plus minus 20 degrees vertically, thereby detecting the obstacle B existing within a detected range of the sensor.
  • the vehicle A has four active sensors 111 positioned in a front part, a rear part, a right side part and a left side part, respectively, such that the obstacle B within 360 degrees of the vehicle A can be detected.
  • the comparison section 12 compares the distance C measured by the measurement section 11 with a previously stored threshold value E, and generates a comparison result F.
  • the threshold value E is a reference value to determine whether the vehicle A comes in close proximity to the obstacle B.
  • the comparison result F is "F T "; and when the measured distance C is not larger than the threshold value E, the comparison result F is "F F ".
  • the viewpoint determination section 13 determines a first viewpoint P 1 to allow a driver to see the vehicle A from above.
  • the viewpoint determination section 13 determines, based on the direction D measured by the measurement section 11, a second viewpoint P 2 to allow the driver to visually recognize a particular spot on the vehicle A.
  • the image generating section 14 When the image generating section 14 receives the first viewpoint P 1 from the viewpoint determination section 13, the image generating section 14 generates first image data I a representing an environment in the vicinity of the vehicle A as seen from the first viewpoint P 1 . On the other hand, when the image generating section 14 receives the second viewpoint P 2 from the viewpoint determination section 13, the image generating section 14 generates second image data I b representing a spot, on the vehicle A, which is likely to contact the obstacle B as seen from the second viewpoint P 2 .
  • the comparison section 12, viewpoint determination section 13 and image generating section 14 typically include a combination of a CPU, a ROM, and a RAM, and the processes performed by each section are realized by causing the CPU to execute a computer program stored in the ROM by means of the RAM.
  • the display section 15 When the display section 15 receives the first image data I a from the image generating section 14, the display section 15 displays a bird' s eye image of the vehicle A based on the received data. On the other hand, when the display section 15 receives the second image data I b from the image generating section 14, the display section 15 displays an image of a particular spot on the vehicle A based on the received second image data I b .
  • the display section 15 is applicable to an on-vehicle navigation system, a monitor mounted with a television receiver, a head-up display, or a head-mounted display.
  • the data accumulating section 16 typically includes an HDD (Hard Disc Drive), a DVD (Digital Versatile Disc), or a semiconductor memory. As shown in FIG. 3, the data accumulating section 16 stores a variety of data. Firstly, a height H A of the vehicle A (hereinafter, referred to as vehicle height data), and object data M A representing an outer shape of the vehicle A are stored. In addition, the data accumulating section 16 also stores a width W A of the vehicle A (hereinafter, referred to as vehicle width data), and an overall length L A of the vehicle A (hereinafter, referred to as vehicle length data).
  • the data accumulating section 16 stores a mounting position P s of each active sensor 111.
  • Each mounting position P s of the corresponding active sensor 111 is represented by a vertical distance from the ground, a distance from any of corners of the vehicle A, and the like.
  • the data accumulating section 16 also stores object data M B representing an outer shape of an object such as a person, a wall or a tree, which may become an obstacle B.
  • the variety of data stored in the aforementioned data accumulating section 16 is mainly used for generating the first image data I a and the second image data I b .
  • the measurement section 11 detects the obstacle B (step S11). Specifically, the measurement section 11 derives a distance C and a direction D from the vehicle Ato the obstacles. Furthermore, the measurement section 11 predicts what the currently detected obstacle B may be, thereby obtaining a predicted result G.
  • FIG. 5 is a schematic diagram illustrating the obstacles B existing in areas which are in front, rear or either side of the vehicle A (shown hatched).
  • FIG. 5 typically illustrates the vehicle A seen from above.
  • FIG. 5 also exemplifies a case where there are an obstacle B 1 in the left side of the vehicle A and an obstacle B 2 in the rear of the vehicle A.
  • FIG. 6A is an enlarged view of the adjacent active sensor 111 and the obstacle B 1 (or B 2 ) as seen from thereabove.
  • FIG. 6B is an enlarged view of the active sensors 111 and the obstacle B 1 (or B 2 ), both shown in FIG. 6A, as seen from a side thereof.
  • the adjacent active sensor 111 detects a distance d, an azimuth angle ⁇ and an elevation angle ⁇ , between the active sensor 111 and the obstacle B 1 (or B 2 ) .
  • the direction D toward the vehicle A is typically represented by both of the azimuth angle ⁇ and the elevation angle ⁇ between the vehicle A and the adjacent active sensor 111.
  • FIG. 7 is a schematic diagram for describing a method of deriving a distance C, when an obstacle B exists in any of areas which are diagonally across the vehicle A from each other (shown hatched) and no obstacle B exists in front, rear, and either side of the vehicle A.
  • FIG. 7 typically illustrates the vehicle A and the obstacle B both seen from above.
  • FIG. 7 also exemplifies a case where there is the obstacle B in the right rear of the vehicle A.
  • an active sensor 111 in the left rear of the vehicle A is an adjacent active sensor 111.
  • the adjacent active sensor 111 detects a distance d, an azimuth angle ⁇ and an elevation angle ⁇ , between the active sensor 111 and the obstacle B. Therefore, a closest distance C and the azimuth angle ⁇ are obtained by the measurement section 11 in a similar manner as described above.
  • the azimuth angle ⁇ is converted into a direction D to the vehicle A by means of a mounting position of the adjacent active sensor 111 stored in the data accumulating section 16.
  • the obstacle B canbe predicted, for example, based on the intensity of reflected waves to that of outgoing waves of the active sensors 111, irrespective of an area in which the obstacle B exits.
  • the distance C, the direction D and the predicted result G, which have been all obtained thereby, are stored in the RAM.
  • the comparison section 12 compares the distance C stored in the RAM with the threshold value E stored in the comparison section 12, and stores the comparison result F in the RAM (step S12). Specifically, when the distance C is larger, the comparison result "F T " is stored in the RAM; and when the distance C is not larger, the comparison result "F F " is stored in the RAM.
  • the threshold value E is a reference value to determine whether the vehicle A comes in close proximity to the obstacle B.
  • the threshold value E1 is selected, for example, at 1 meter. However, this value may be changed in accordance with a designation of a driver or a design specification of the vehicle surrounding display device 1. Based on such a threshold value E, the comparison result F indicates whether the obstacle B exists in the vicinity of the vehicle A.
  • the viewpoint determination section 13 determines whether the comparison result F stored in the RAM is "F F " (step S13) . If it is determined Yes, it indicates that the vehicle A has already come in close proximity to the obstacle B. Thus, in this case, the viewpoint determination section 13 determines the second viewpoint P 2 so as to show a particular spot (step S14).
  • the viewpoint determination section 13 uses the direction D currently stored in the RAM to determine the second viewpoint P 2 . Therefore, the viewpoint determination section 13 can identify a direction of an area including the obstacle B as seen from the vehicle A. Furthermore, the second viewpoint P 2 is set at three-dimensional coordinate values obtained when depression angles R have predetermined values (e.g., 45 degrees) with respect to the horizontal plane, such that a spot in the vicinity of the adjacent sensor 111 (i.e., a spot on the vehicle A which is highly likely to contact the obstacle B) will appear as an image of a particular spot.
  • predetermined values e.g. 45 degrees
  • the depression angle R is an angle between the horizontal plane and a line extending from the second viewpoint P 2 to the horizontal plane, and the line must extend in a direction of the adjacent active sensor 111 or its detecting range.
  • a value of the depression angle R may be changed in accordance with a designation of a driver or a design specification of the vehicle surrounding display device 1.
  • the viewpoint determination section 13 preferably uses, in addition to the direction D, the distance C currently stored in the RAM so as to determine the second viewpoint P 2 .
  • the second viewpoints P 2 are respectively set at three-dimensional coordinate values contained in a vertical plane P v orthogonal to a line L s representing a shortest distance between the vehicle A and the obstacle B, the three-dimensional coordinate values obtained when depression angles R are predetermined values with respect to the horizontal plane.
  • the vertical plane P v is a plane which perpendicularly bisects the line L s .
  • the respective second viewpoints P 2 are indicated when the obstacle B exists in any of areas which are diagonally across the vehicle A from each other (shown hatched).
  • the viewpoint determination section 13 passes the second viewpoint P 2 set as described above to the image generating section 14.
  • the image generating section 14 When receiving the second viewpoint P 2 , the image generating section 14 generates second image data I b (step S15) .
  • the image generating section 14 places an object representing the obstacle B and an object representing the vehicle A in such a positional relationship as to contain the distance C and the direction D therebetween, both stored in the RAM.
  • the image generating section 14 generates the second image data I b representing a view of the both obj ects as seen from the received second viewpoint P 2 .
  • a numerical value indicating the distance C between the obstacle B and the vehicle A, and a numerical value indicating a height H B of the obstacle are also incorporated into the second image data I b .
  • the image generating section 14 forwards the second image data I b generated thereby to the display section 15. As shown in FIG. 10, the display section 15 displays an image of a particular spot based on the second image data I b (step S16). Thereafter, a process returns to step S11.
  • the viewpoint determination section 13 determines that the vehicle A has not yet come in close proximity to the obstacle B, and determines the first viewpoint P 1 (step S17).
  • the first viewpoint P 1 is set above the vehicle A.
  • the first viewpoint P 1 is denoted by three-dimensional coordinate values (0, 0, z 1 )
  • the second viewpoint P 2 is denoted by three-dimensional coordinate values (x 2 , y 2 , z 2 ), respectively.
  • the second image data I b i.e., the second viewpoint P 2
  • a vertical direction component of the first viewpoint P 1 i.e.,
  • a vertical direction component of the second viewpoint P 2 i.e.,
  • the second viewpoint P 2 needs to be horizontally displaced from the first viewpoint P 1 . Therefore, from the origin point, a horizontal direction component of the first viewpoint P 1 is set smaller than a horizontal direction component of the second viewpoint P 2 (i.e., ⁇ (x 2 2 +y 2 2 )).
  • the viewpoint determination section 13 passes the first viewpoint P 1 set as described above to the image generating section 14.
  • the image generating section 14 When receiving the first viewpoint P 1 , the image generating section 14 generates first image data I a (step S18).
  • the first image data I a is generated in a similar manner to the second image data I b .
  • a viewpoint for the first image data I a is different from that of the second image data I b .
  • a numerical value indicating the distance C between the vehicle A and the obstacle B, and a numerical value indicating a height H B of the obstacle B may be incorporated into the first image data I a .
  • the image generating section 14 forwards the first image data I a generated thereby to the display section 15. As shown in FIG. 11, the display section 15 displays a bird's eye image based on the first image data I a (step S19). Thereafter, a process returns to step S11.
  • an bird's eye image based on the first image data I a is displayed in the display section 15. Since the bird's eye image represents an environment in the vicinity of the vehicle A as seen above the vehicle A, a driver can substantially understand the situation in the vicinity of the vehicle.
  • the distance C between the vehicle A and the obstacle B becomes not larger than the threshold value E
  • an image of a particular spot based on the second image data I b is displayed in the display section 15.
  • the second viewpoint P 2 which has been set based on the detected direction D of the obstacle B, is used for generating the image of the particular spot.
  • the image of the particular spot represents an enlarged view of a spot, on the vehicle A, in the vicinity of the adjacent active sensor 111 which has detected the obstacle B, whereby the obstacle B will be less likely to enter a dead zone.
  • the driver can more easily visually recognize a spot, on the vehicle A, which may be highly likely to contact the obstacle B.
  • the second image data I b representing the image of the particular spot such that the driver can more easily visually recognize a positional relationship between the vehicle A and the obstacle B.
  • the second viewpoint P 2 is preferably set at three-dimensional coordinate values contained in a vertical plane P v orthogonal to a line L s representing a shortest distance between the vehicle A and the obstacle B, the three-dimensional coordinate values obtained when a depression angle R is a predetermined value with respect to the horizontal plane. More preferably, the vertical plane P v is a plane which perpendicularly bisects the line L s .
  • the second viewpoint P 2 is set in such a manner as described above, whereby both of the adjacent active sensor 111 and the obstacle B are likely to appear as the image of the particular spot.
  • a vehicle surrounding display device capable of displaying an image of a particular spot such that a driver can more easily visually recognize a positional relationship between the vehicle A and the obstacle B.
  • indicating the distance C in the display section 15 allows the driver to understand the positional relationship between the vehicle A and the obstacle B more easily.
  • the above embodiment illustrates an example where the first image data I a and the second image data I b are both generated on the basis of the object data M A stored in the data accumulating section 16, and if necessary, the object data M B is also used for generating the data.
  • the present invention is not limited thereto.
  • the data similar to the first image data I a or the second image data I b may be generated by means of images imaged by imaging devices mounted at a front part, a rear part or either side part of the vehicle A, respectively.
  • the measurement section 11 detects a plurality of obstacles B.
  • the aforementioned process is preferably applied to one of the obstacles B, which exists in the traveling direction of the vehicle A and which is closest to the vehicle A.
  • FIG. 12 is a schematic diagram illustrating an example of a block configuration of the vehicle surrounding display device 1 according to a first variant (hereinafter, referred to as a vehicle surrounding display device 1a) of the present invention.
  • the vehicle surrounding display device 1a is different from the vehicle surrounding display device 1 shown in FIG. 1 in that the vehicle surrounding display device 1a further includes a contact determination section 21.
  • the vehicle surrounding display devices 1 and 1a There are no other differences between the vehicle surrounding display devices 1 and 1a. Therefore, in FIG. 12, like elements corresponding to those of FIG. 1 are denoted by like reference numerals, and the descriptions thereof are omitted.
  • the contact determination section 21 derives a height H B from the ground to the bottom of the obstacle B, and compares the height H B with a height H A of the vehicle A (hereinafter, referred to as vehicle height data) stored in the data accumulating section 16 to be described below. Then, the contact determination section 21 determines whether the vehicle A can pass under the obstacle B, and generates a determination result J.
  • vehicle height data a height of the vehicle A
  • the contact determination section 16 determines that the vehicle A can pass through. In this case, the determination result J is "J T ".
  • the determination result J is "J F ".
  • the above contact determination section 16 also typically includes a combination of the CPU, the ROM, and the RAM.
  • FIG. 13 an operation of the vehicle surrounding display device 1a shown in FIG. 12 is described.
  • the flowchart shown in FIG. 13 is different from that of FIG. 4 in that the flowchart shown in FIG. 13 further includes step S21 and step S22.
  • step S21 and step S22 There are no other differences between the two flowcharts. Therefore, in FIG. 13, like steps corresponding to those of FIG. 4 are denoted by like reference numerals, and the descriptions thereof are omitted.
  • the contact determination section 21 derives the height H B from the ground to the bottom of the obstacle B shown in FIG. 14.
  • the contact determination section 16 compares the currently derived height H B with the height data H A of the vehicle A stored in the data accumulating section 16. When the height H B is larger, the contact determination section 16 determines that the vehicle A can pass under the obstacle B, and stores "J T " in the RAM as the determination result J. On the other hand, when the height H B is not larger, "J F " is stored in the RAM as the determination result J (step S21).
  • step S21 the viewpoint determination section 13 determines whether the determination result J stored in the RAM is "J F " (step S22). If it is determined Yes, it indicates that the vehicle A cannot pass under the obstacle B. Thus, the viewpoint determination section 13 performs the aforementioned steps from step S12 onward, in order to determine whether an image of a particular spot should be generated. On the other hand, if it is determined No in step S22, it indicates that the vehicle A can pass under the obstacle B. Thus, the viewpoint determination section 13 performs the aforementioned steps from step S17 onward.
  • the aforementioned determination is performed based on a height such that a driver can use the vehicle surrounding display device 1a in a situation, for example, where a vehicle is parked into a parking space, thus making it possible to provide the vehicle surrounding display device 1a having better usability.
  • a height H B from the ground to the bottom of the obstacle B may also be incorporated into an image of a particular spot.
  • FIG. 15 is a schematic diagram illustrating an example of a block configuration of the vehicle surrounding display device 1 according to a second variant (hereinafter, referred to as a vehicle surrounding display device 1b) of the present invention.
  • the vehicle surrounding display device 1b is different from the vehicle surrounding display device 1 shown in FIG. 1 in that the vehicle surrounding display device 1b further includes a steering angle sensor 31 and a contact determination section 32.
  • the vehicle surrounding display device 1b further includes a steering angle sensor 31 and a contact determination section 32.
  • the vehicle surrounding display devices 1 and 1b There are no other differences between the vehicle surrounding display devices 1 and 1b. Therefore, in FIG. 15, like elements corresponding to those of FIG. 1 are denoted by like reference numerals, and the descriptions thereof are omitted.
  • the steering angle sensor 31 detects a steering angle of the vehicle A, and passes a detected result to the contact determination section 32.
  • the contact determination section 32 derives a predicted trajectory through which the vehicle A is intended to move based on the detected result outputted from the steering angle sensor 31. Furthermore, the contact determination section 32 determines whether an obstacle B exists along the derived predicted trajectory based on a distance C and direction D, both stored in the RAM, between the vehicle A and the obstacle B. Thereafter, the contact determination section 32 generates a determination result K. In the present embodiment, when the obstacle B exists along the predicted trajectory, the contact determination section 32 stores "K T " in the RAM as the determination result J; and when no obstacle B exists along the predicted trajectory, "K T " is stored in the RAM as the determination result K.
  • the above contact determination section 32 also typically includes a combination of the CPU, the ROM, and the RAM.
  • FIG. 16 a flowchart of FIG. 16 is different from that of FIG. 4 in that the flowchart shown in FIG. 16 further includes step S31 and step S32. There are no other differences between the two flowcharts. Therefore, in FIG. 16, like steps corresponding to those of FIG. 4 are denoted by like reference numerals, and the descriptions thereof are omitted.
  • the contact determination section 32 derives the predicted trajectory of the vehicle A by means of a detected result outputted from the steering angle sensor 31. Furthermore, the contact determination section 32 determines whether the obstacle B exists along the derived predicted trajectory, and stores the determination result K ("K T " or "K F ”) in the RAM (step S31).
  • the viewpoint determination section 13 determines whether the determination result K stored in the RAM is "K F " (step S32). If it is determined Yes, it indicates that the obstacle B and the vehicle A are not likely to contact each other. Thus, the viewpoint determination section 13 performs the aforementioned steps from step S17 onward. On the other hand, if it is determined No in step S32, it indicates that the obstacle B and the vehicle A are likely to contact each other. Thus, the viewpoint determination section 13 performs the aforementioned steps from step S12 onward, in order to determine whether an image of a particular spot should be generated.
  • the aforementioned determination is performed based on whether a contact is likely to occur such that a driver can use the vehicle surrounding display device 1b in a situation, for example, where a vehicle is parked into a parking space, thus making it possible to provide the vehicle surrounding display device 1a having better usability.
  • the predicted trajectory may also be incorporated into an image of a particular spot or a bird' s eye image.
  • the second viewpoints P 2 are set at two points. Even if either point is set as the second viewpoint P 2 , the same effects can be obtained.
  • the second viewpoint P 2 is preferably set as described below. That is, for example, as shown in FIG. 17A, when the obstacle B exists in the rear of the vehicle A which is moving backward, and a steering wheel of the vehicle A is turned to the left side (counterclockwise), a point on the right side of the vehicle A is to be set as the second viewpoint P 2 .
  • a point on the left side of the vehicle A is to be set as the second viewpoint P 2 .
  • a second viewpoint P 2 is set in accordance with a direction of the obstacle B from the vehicle A, a traveling direction of the vehicle A, and an operating direction of a steering wheel.
  • the second viewpoint P 2 is set in such a manner, thereby allowing the display section 15 to display how the vehicle A comes in proximity to the obstacle B.
  • a driver can easily understand a positional relationship between the vehicle A and the obstacle B.
  • the above first and second variants may be incorporated together into the vehicle surrounding display device 1 according to the embodiments above.
  • a vehicle surrounding display device is applicable to a navigation device, a parking assist device or the like, which is required to display images such that a driver can more easily visually recognize an obstacle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)
EP05734727A 2004-04-27 2005-04-21 Visualisation de circonférence d"un véhicule Withdrawn EP1748654A4 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004130989 2004-04-27
PCT/JP2005/007606 WO2005107261A1 (fr) 2004-04-27 2005-04-21 Visualisation de circonférence d’un véhicule

Publications (2)

Publication Number Publication Date
EP1748654A1 true EP1748654A1 (fr) 2007-01-31
EP1748654A4 EP1748654A4 (fr) 2013-01-02

Family

ID=35242048

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05734727A Withdrawn EP1748654A4 (fr) 2004-04-27 2005-04-21 Visualisation de circonférence d"un véhicule

Country Status (5)

Country Link
US (1) US7369041B2 (fr)
EP (1) EP1748654A4 (fr)
JP (1) JPWO2005107261A1 (fr)
CN (1) CN100456828C (fr)
WO (1) WO2005107261A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2541525A4 (fr) * 2010-02-24 2017-03-15 Aisin Seiki Kabushiki Kaisha Dispositif de surveillance de l'environnement immédiat d'un véhicule

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7797881B2 (en) * 2005-06-22 2010-09-21 Loitherstein Joel S Garage door control system
EP1916846B1 (fr) * 2005-08-02 2016-09-14 Nissan Motor Company Limited Dispositif et procede de surveillance de l'environnement d'un véhicule
US20090128630A1 (en) * 2006-07-06 2009-05-21 Nissan Motor Co., Ltd. Vehicle image display system and image display method
DE102006052779A1 (de) * 2006-11-09 2008-05-15 Bayerische Motoren Werke Ag Verfahren zur Erzeugung eines Gesamtbilds der Umgebung eines Kraftfahrzeugs
JP5003946B2 (ja) * 2007-05-30 2012-08-22 アイシン精機株式会社 駐車支援装置
JP4325705B2 (ja) * 2007-06-15 2009-09-02 株式会社デンソー 表示システム及びプログラム
JP4462333B2 (ja) * 2007-11-13 2010-05-12 株式会社デンソー 走行支援装置
TW200925023A (en) * 2007-12-07 2009-06-16 Altek Corp Method of displaying shot image on car reverse video system
JP2009166691A (ja) * 2008-01-16 2009-07-30 Mazda Motor Corp 車両の走行制御装置
JP5094658B2 (ja) * 2008-09-19 2012-12-12 日立オートモティブシステムズ株式会社 走行環境認識装置
US8305444B2 (en) * 2008-11-14 2012-11-06 Toyota Motor Engineering & Manufacturing North America, Inc. Integrated visual display system
JP5068779B2 (ja) * 2009-02-27 2012-11-07 現代自動車株式会社 車両周囲俯瞰画像表示装置及び方法
US20110169957A1 (en) * 2010-01-14 2011-07-14 Ford Global Technologies, Llc Vehicle Image Processing Method
DE102010010912A1 (de) * 2010-03-10 2010-12-02 Daimler Ag Fahrerassistenzvorrichtung mit optischer Darstellung erfasster Objekte
JP5501452B2 (ja) * 2010-05-19 2014-05-21 三菱電機株式会社 車両後方監視装置
DE102010062254B4 (de) * 2010-12-01 2024-05-02 Robert Bosch Gmbh Verfahren zur Darstellung einer mittels Sensoren erfassten Umgebung und Vorrichtung zur Darstellung einer von fahrzeuggestützten Sensoren erfassten Umgebung
JP5124672B2 (ja) * 2011-06-07 2013-01-23 株式会社小松製作所 作業車両の周辺監視装置
JP5124671B2 (ja) * 2011-06-07 2013-01-23 株式会社小松製作所 作業車両の周辺監視装置
DE102011084554A1 (de) * 2011-10-14 2013-04-18 Robert Bosch Gmbh Verfahren zur Darstellung eines Fahrzeugumfeldes
JP6029306B2 (ja) * 2012-03-29 2016-11-24 住友建機株式会社 作業機械用周辺監視装置
KR102003562B1 (ko) * 2012-12-24 2019-07-24 두산인프라코어 주식회사 건설기계의 감지 장치 및 방법
JP5997640B2 (ja) * 2013-03-25 2016-09-28 株式会社ジオ技術研究所 ３次元画像出力装置および背景画像生成装置
CN103600695B (zh) * 2013-11-22 2016-01-27 奇瑞汽车股份有限公司 一种检测后视盲区内车辆的方法及设备
DE102014205511A1 (de) * 2014-03-25 2015-10-01 Conti Temic Microelectronic Gmbh Verfahren und vorrichtung zur anzeige von objekten auf einer fahrzeuganzeige
DE102014107235A1 (de) * 2014-05-22 2015-11-26 Dr. Ing. H.C. F. Porsche Aktiengesellschaft Verfahren zur Darstellung einer Fahrzeugumgebung auf einer Anzeigevorrichtung; eine Anzeigevorrichtung; ein System aus einer Mehrzahl an Bilderfassungseinheiten und einer Anzeigevorrichtung; ein Computerprogramm
US10168425B2 (en) * 2014-07-03 2019-01-01 GM Global Technology Operations LLC Centralized vehicle radar methods and systems
KR20170043212A (ko) * 2015-10-13 2017-04-21 엘지전자 주식회사 차량용 어라운드 뷰 제공 장치 및 차량
KR20170055091A (ko) 2015-11-10 2017-05-19 현대오트론 주식회사 헤드업 디스플레이 제어 장치 및 방법
JP6669569B2 (ja) * 2016-04-04 2020-03-18 アルパイン株式会社 車両用周辺監視装置
US9747804B1 (en) * 2016-06-23 2017-08-29 GM Global Technology Operations LLC Object detection-based directional control of light and sound
CA3041177C (fr) * 2016-10-13 2021-08-31 Nissan Motor Co., Ltd. Procede et dispositif d'estimation de position d'hote
WO2018159019A1 (fr) * 2017-02-28 2018-09-07 株式会社Ｊｖｃケンウッド Dispositif, système et procédé de génération d'image vidéo de vue à vol d'oiseau et programme associé
US10579067B2 (en) * 2017-07-20 2020-03-03 Huawei Technologies Co., Ltd. Method and system for vehicle localization
US10497264B2 (en) 2017-09-26 2019-12-03 Toyota Research Institute, Inc. Methods and systems for providing warnings of obstacle objects
CN108725319B (zh) * 2017-10-31 2021-05-04 无锡职业技术学院 一种影像式倒车指导方法
CN110949286B (zh) * 2019-12-16 2021-06-04 广州小鹏汽车科技有限公司 车辆及其控制方法与装置
CN112158197B (zh) * 2020-08-21 2021-08-27 恒大新能源汽车投资控股集团有限公司 一种车辆盲区障碍物规避方法、装置及系统
US11987961B2 (en) * 2021-03-29 2024-05-21 Joy Global Surface Mining Inc Virtual field-based track protection for a mining machine
US11939748B2 (en) 2021-03-29 2024-03-26 Joy Global Surface Mining Inc Virtual track model for a mining machine

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1179958A1 (fr) * 1999-04-16 2002-02-13 Matsushita Electric Industries Co., Ltd. Dispositif de traitement d'images et systeme de surveillance
US20020149673A1 (en) * 2001-03-29 2002-10-17 Matsushita Electric Industrial Co., Ltd. Image display method and apparatus for rearview system

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06333200A (ja) * 1993-05-21 1994-12-02 Toshiba Corp 車載用監視システム
JPH0717328A (ja) 1993-06-30 1995-01-20 Mitsubishi Motors Corp 車両用周辺認識補助装置
JP3371605B2 (ja) * 1995-04-19 2003-01-27 日産自動車株式会社 大気効果表示機能付き鳥瞰図表示ナビゲーションシステム
CN2238765Y (zh) * 1995-08-18 1996-10-30 兰天 汽车倒车防撞监视器
US7307655B1 (en) * 1998-07-31 2007-12-11 Matsushita Electric Industrial Co., Ltd. Method and apparatus for displaying a synthesized image viewed from a virtual point of view
JP3596314B2 (ja) * 1998-11-02 2004-12-02 日産自動車株式会社 物体端の位置計測装置および移動体の通行判断装置
JP2000161915A (ja) * 1998-11-26 2000-06-16 Matsushita Electric Ind Co Ltd 車両用単カメラ立体視システム
CN2417651Y (zh) * 1998-12-21 2001-01-31 吴晧华 汽车安全防撞监视装置
JP3966673B2 (ja) * 1999-10-26 2007-08-29 本田技研工業株式会社 物体検知装置および車両の走行安全装置
JP4660872B2 (ja) * 2000-02-09 2011-03-30 ソニー株式会社 運転支援装置及び運転支援方法
US6369701B1 (en) * 2000-06-30 2002-04-09 Matsushita Electric Industrial Co., Ltd. Rendering device for generating a drive assistant image for drive assistance
JP3830025B2 (ja) 2000-06-30 2006-10-04 松下電器産業株式会社 描画装置
JP3750512B2 (ja) * 2000-10-12 2006-03-01 日産自動車株式会社 車両用周辺障害物検出装置
JP4861574B2 (ja) * 2001-03-28 2012-01-25 パナソニック株式会社 運転支援装置
JP2002316602A (ja) * 2001-04-24 2002-10-29 Matsushita Electric Ind Co Ltd 車載カメラの撮像画像表示方法及びその装置
JP3608527B2 (ja) * 2001-05-15 2005-01-12 株式会社豊田中央研究所 周辺状況表示装置
US6636258B2 (en) * 2001-10-19 2003-10-21 Ford Global Technologies, Llc 360° vision system for a vehicle
JP2003267171A (ja) * 2002-03-13 2003-09-25 Nissan Motor Co Ltd 車両後方監視装置
JP2003348574A (ja) * 2002-05-24 2003-12-05 Nissan Motor Co Ltd 車両用映像表示装置
US7145519B2 (en) * 2002-04-18 2006-12-05 Nissan Motor Co., Ltd. Image display apparatus, method, and program for automotive vehicle
JP3683258B2 (ja) * 2002-05-31 2005-08-17 松下電器産業株式会社 車両周辺監視装置、画像生成方法および画像生成プログラム
CN1701242A (zh) * 2003-03-20 2005-11-23 松下电器产业株式会社 障碍检测设备
JP2007099261A (ja) * 2005-09-12 2007-04-19 Aisin Aw Co Ltd 駐車支援方法及び駐車支援装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1179958A1 (fr) * 1999-04-16 2002-02-13 Matsushita Electric Industries Co., Ltd. Dispositif de traitement d'images et systeme de surveillance
US20020149673A1 (en) * 2001-03-29 2002-10-17 Matsushita Electric Industrial Co., Ltd. Image display method and apparatus for rearview system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2005107261A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2541525A4 (fr) * 2010-02-24 2017-03-15 Aisin Seiki Kabushiki Kaisha Dispositif de surveillance de l'environnement immédiat d'un véhicule

Also Published As

Publication number Publication date
CN1898961A (zh) 2007-01-17
US20070120656A1 (en) 2007-05-31
EP1748654A4 (fr) 2013-01-02
US7369041B2 (en) 2008-05-06
CN100456828C (zh) 2009-01-28
JPWO2005107261A1 (ja) 2008-03-21
WO2005107261A1 (fr) 2005-11-10

Similar Documents

Publication Publication Date Title
EP1748654A1 (fr) Visualisation de circonférence d"un véhicule
CN109017570B (zh) 车辆周围场景呈现方法和装置、车辆
US6172601B1 (en) Three-dimensional scope system with a single camera for vehicles
JP4970926B2 (ja) 車両周辺監視装置
US8126210B2 (en) Vehicle periphery monitoring device, vehicle periphery monitoring program, and vehicle periphery monitoring method
US8559674B2 (en) Moving state estimating device
JP3349060B2 (ja) 車外監視装置
KR101656162B1 (ko) 자동차의 운전자 지원 장치 작동 방법, 운전자 지원 장치 및 자동차
JP4816923B2 (ja) 車両周辺画像提供装置および方法
US11518390B2 (en) Road surface detection apparatus, image display apparatus using road surface detection apparatus, obstacle detection apparatus using road surface detection apparatus, road surface detection method, image display method using road surface detection method, and obstacle detection method using road surface detection method
JP2013239015A (ja) 駐車支援装置、駐車支援方法およびプログラム
JP6392693B2 (ja) 車両周辺監視装置、車両周辺監視方法、及びプログラム
JP2016120892A (ja) 立体物検出装置、立体物検出方法および立体物検出プログラム
JP4510554B2 (ja) 立体物監視装置
JP2007304033A (ja) 車両の周辺監視装置、車両、車両の周辺監視方法、および車両の周辺監視用プログラム
EP2642364A1 (fr) Procédé pour avertir le conducteur d'un véhicule automobile de la présence d'un objet dans l'environnement du véhicule automobile, système de caméra et véhicule à moteur
JP2001052171A (ja) 周囲環境認識装置
JP2008262333A (ja) 路面判別装置および路面判別方法
JP2014089548A (ja) 路面段差検出方法、路面段差検出装置、路面段差検出装置を備えた車両
US20170368993A1 (en) Image generating device and image generating method
JPH11345336A (ja) 障害物検出装置
JP7047291B2 (ja) 情報処理装置、撮像装置、機器制御システム、移動体、情報処理方法およびプログラム
JP6770903B2 (ja) 距離算出装置及び距離算出方法
JP4539472B2 (ja) 車両用走行支援装置
JP6999239B2 (ja) 画像処理装置および画像処理方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20060629

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): DE FR GB

DAX Request for extension of the european patent (deleted)
RBV Designated contracting states (corrected)

Designated state(s): DE FR GB

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: PANASONIC CORPORATION

A4 Supplementary search report drawn up and despatched

Effective date: 20121129

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 7/18 20060101AFI20121123BHEP

Ipc: G01S 13/93 20060101ALI20121123BHEP

Ipc: G01S 7/04 20060101ALI20121123BHEP

Ipc: B60R 1/00 20060101ALI20121123BHEP

Ipc: B60R 21/00 20060101ALI20121123BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20121103