US7756618B2 - Camera calibration and image adjusting for drive assisting system - Google Patents
Camera calibration and image adjusting for drive assisting system Download PDFInfo
- Publication number
- US7756618B2 US7756618B2 US10/566,104 US56610404A US7756618B2 US 7756618 B2 US7756618 B2 US 7756618B2 US 56610404 A US56610404 A US 56610404A US 7756618 B2 US7756618 B2 US 7756618B2
- Authority
- US
- United States
- Prior art keywords
- locus
- data
- adjusting
- display
- vehicle
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 claims description 14
- 239000003550 marker Substances 0.000 description 21
- 238000010586 diagram Methods 0.000 description 14
- 230000000994 depressogenic effect Effects 0.000 description 8
- 230000004044 response Effects 0.000 description 7
- 230000002411 adverse Effects 0.000 description 3
- 230000002542 deteriorative effect Effects 0.000 description 2
- 238000011112 process operation Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/029—Steering assistants using warnings or proposing actions to the driver without influencing the steering system
- B62D15/0295—Steering assistants using warnings or proposing actions to the driver without influencing the steering system by overlaying a vehicle path based on present steering angle over an image without processing that image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
Definitions
- the present invention is related to a drive assisting apparatus and a drive assisting method, which provide both a backward picture of a vehicle, which is acquired by an on-vehicle camera, and also, a guide for assisting a drive operation on the backward picture with respect to a driver of the vehicle.
- drive assisting apparatus have been developed in which when vehicles are driven along backward directions, backward pictures acquired by on-vehicle cameras as to the vehicles are displayed on display screens of monitors within drivers' cabin.
- the drive assisting apparatus such systems have been mostly employed. That is, in the systems, various guides are superimposed on pictures of the on-vehicle cameras to display the superimposed pictures, while these guides are used to assist driving operations and correspond to predicted loci when the vehicles are backwardly traveled along straight directions, and distance lines indicative of constant distances from rear edges of the vehicles.
- Another drive assisting apparatus has been provided which displays travel predicted loci in response to steering angles of a steering wheel in a superimposing manner when the vehicle is driven along the backward direction.
- Patent Publication 1 Japanese Patent NO.2610146
- camera parameters which are used so as to calculate the display data of the predicted locus are different from actual camera parameters, and the adjusting amounts are determined based upon the typical point set in the camera picture, so that sufficiently high precision cannot be always obtained.
- the camera parameters there are two parameters of internal parameters and external parameters.
- the internal parameters include a focal distance, a distortion coefficient of a lens, an aspect magnification ratio, and a coordinate of an image center position
- the external parameters include a tilt angle, a pan angle, and a roll angle.
- a predicted locus which should be displayed may be deviated from the display screen.
- the predicted loci to be displayed is prepared, if only data within the display screen are held, when the display position is adjusted, such a locus portion which is deviated from the display screen cannot be displayed because there is no data.
- a display position outside the display screen which is not originally present, must be held as data.
- a confirmation for confirming a matching characteristic of the data can be hardly carried out.
- the loci data is previously prepared, as the varying camera parameters, at least, three parameters such as a pan angle, a roll angle, and a tilt angle must be considered. Even when three values are simply prepared for each of these pan, roll, and tilt angles, 27 sorts of data must be prepared in total. Thus, a required memory amount is increased, resulting in high cost.
- the present invention has been made to solve the problems, and therefore, has an object to provide a drive assisting apparatus and a drive assisting method, capable of displaying a high-precision predicted locus in a camera picture in a superimposing manner while suppressing an increase of cost in a minimum value, and further, capable of displaying loci on a screen up to edges of the screen with respect to all of locus data irrespective of adjusting amounts of display positions.
- a drive assisting apparatus for displaying an image around a vehicle, which is acquired by an on-vehicle camera, on a screen of an on-vehicle monitor, comprising: a data table for storing thereinto locus data which contains locus display data and adjusting data, the locus display data being used to display a travel predicted locus of the vehicle corresponding to a steering angle of a steering wheel on the screen, and the adjusting data being used to adjust a display position of the travel predicted locus on the screen based upon the locus display data; steering angle detecting means for detecting the steering angle of the steering wheel; and drive assisting image producing means for reading out the locus data corresponding to the steering angle detected by the steering angle detecting means from the data table, for producing a drive assisting image by superimposing the travel predicted locus on the image around the vehicle based upon the locus display data and the adjusting data, which are contained in the read locus data
- the display position of the travel predicted locus in correspondence with the steering angle is adjusted based upon the latest adjusting data, the previously prepared travel predicted locus can be displayed on the optimum position, and the precision as the guide of the locus can be improved.
- the drive assisting apparatus may be alternatively comprised of display position adjusting amount setting means for setting a value of the adjusting data contained in the locus data corresponding to the steering angle.
- the display position adjusting amount setting means may alternatively calculate values of adjusting data of the locus data with respect to all of other steering angles based upon a value of adjusting data of the locus data with respect to a typical steering angle.
- the display positions can be set to the optimum positions with respect to all of the steering angles by merely adjusting the display position of the travel predicted locus only as to the typical steering angle. Also, the operations for calculating the adjusting amounts of the display positions can be largely simplified.
- the locus data stored in the data table may alternatively contain initial position setting data used to set an initial position of the travel prediction locus based upon locus display data in addition to both the locus display data and the adjusting data.
- the travel predicted loci can be displayed on the screen up to the edges of the screen with respect to all of the locus data irrespective of the adjusting amounts of the display positions.
- the data table may alternatively store thereinto a plurality of different locus data sets as to a pan angle, or a roll angle as the locus data corresponding to the steering angle.
- the required memory amount can be reduced without deteriorating the precision as the guide of the travel predicted locus, and the cost can be reduced.
- a drive assisting method for displaying an image around a vehicle, which is acquired by an on-vehicle camera, on a screen of an on-vehicle monitor, comprising: a step for forming display data which is used to display a travel prediction locus of a vehicle corresponding to a steering angle of a steering wheel on the screen of the on-vehicle monitor in a superimposing manner; a step for setting adjusting data used to adjust a display position of the travel prediction locus; and a step for adjusting the display position of the travel prediction locus formed based upon the display data corresponding to the steering angle of the steering wheel in connection to steering operation of the steering wheel based upon the adjusting data, and for displaying the position-adjusted travel prediction locus on the screen of the on-vehicle monitor in the superimposing manner.
- the display position of the travel predicted locus in correspondence with the steering angle is adjusted based upon the latest adjusting data, the previously prepared travel predicted locus can be displayed on the optimum position, and the precision as the guide of the locus can be improved.
- the travel predicted locus which has been previously prepared can be continuously displayed on the optimum position, and the precision as the guide of the travel predicted locus can be improved.
- FIG. 1 is a block diagram for indicating a structure of a drive assisting apparatus according to an embodiment mode of the present invention
- FIG. 2 is a block diagram for representing a detailed arrangement of a locus superimposing apparatus employed in the drive assisting apparatus of the embodiment mode of the present invention
- FIG. 3 is a diagram for explaining a selecting operation of a locus data set and a setting operation of an individual adjusting amount in the drive assisting apparatus according to the embodiment mode of the present invention
- FIG. 4 is a diagram for showing switches used to select and ascertain both the locus data sets and markers in the drive assisting apparatus according to the embodiment mode of the present invention
- FIG. 5 is a diagram for explaining a selecting operation of locus data sets in the drive assisting apparatus according to the embodiment mode of the present invention.
- FIG. 6 is a diagram for explaining a setting operation of the individual adjusting amount in the drive assisting apparatus according to the embodiment mode of the present invention.
- FIG. 7 is a diagram for explaining a setting operation of an initial adjusting amount in the drive assisting apparatus according to the embodiment mode of the present invention.
- FIG. 8 is a diagram for explaining another setting operation of the initial adjusting amount in the drive assisting apparatus according to the embodiment mode of the present invention.
- FIG. 9 is a diagram for explaining influences caused by shifts in pan angles and roll angles, which are given to a locus display in the drive assisting apparatus according to the embodiment mode of the present invention.
- reference numeral 1 shows a vehicle
- reference numeral 2 indicates an on-vehicle camera
- reference numeral 3 represents a steering angle sensor
- reference numeral 4 denotes a locus superimposing apparatus
- reference numeral 5 shows an on-vehicle monitor
- reference numeral 31 indicates a target plate for selecting local data sets
- reference numerals 32 , 33 , and 35 shows markers
- reference numeral 40 represents a data setting unit
- reference numeral 41 indicates an individual adjusting amount setting unit
- reference numeral 42 shows a locus data set selecting unit
- reference numeral 43 denotes a locus data selecting unit
- reference numeral 44 indicates a display position adjusting unit
- reference numeral 45 represents a locus superimposing unit
- reference numeral 46 shows a data table
- reference numerals 51 and 51 A denote selection buttons
- reference numerals 54 and 54 A represent ascertain buttons.
- FIG. 1 is a block diagram for showing an arrangement of a drive assisting apparatus according to an embodiment mode of the present invention.
- the drive assisting apparatus according to this embodiment mode, is equipped with an on-vehicle camera 2 , a steering angle sensor 3 , a locus superimposing apparatus 4 , and an on-vehicle monitor 5 .
- the on-vehicle camera 2 is installed at a backward position of a vehicle 1 .
- the steering angle sensor 3 detects a steering angle of the vehicle 1 .
- the locus superimposing apparatus 4 superimposes a predicted locus in response to an output of the steering angle 3 on an image acquired by the on-vehicle camera 2 to output the superimposed image.
- the on-vehicle monitor 5 displays thereon the output of the locus superimposing apparatus 4 so as to provide the displayed output to a driver of the vehicle 1 .
- the on-vehicle camera 2 inputs an image acquired by imaging a backward scene of the vehicle 1 into the locus superimposing apparatus 4 .
- the steering angle sensor 3 senses a rotation amount of a steering column of the vehicle 1 , and inputs the sensed rotation amount to the locus superimposing apparatus 4 .
- the locus superimposing apparatus 4 superimposes the predicted locus of the vehicle 1 in response to the steering angle inputted from the steering angle sensor 3 on a picture of the on-vehicle camera 2 , and then, outputs the superimposed picture.
- the on-vehicle monitor 5 displays thereon the output of the locus superimposing apparatus 4 .
- FIG. 2 is a block diagram for representing a detailed arrangement of the locus superimposing apparatus 4 .
- the locus superimposing apparatus 4 is equipped with a data setting unit 40 , a locus data selecting unit 43 , a display position adjusting unit 44 , a locus superimposing unit 45 , and a data table 46 .
- the data setting unit 40 contains both an individual adjusting amount setting unit 41 and a locus data set selecting unit 42 .
- the data table 46 is constituted by a plurality of “locus data sets 0 to N” which have been previously prepared, and a “selected set number” indicative of such a locus data set which is actually used among the plural locus data sets “0” to “N”. Then, each of the locus data sets “0” to “N” is arranged by “reference data”, “marker data”, and “locus data 0 to H”. The reference data is employed in the case that a locus data set to be used is selected. The marker data is employed when an individual adjusting amount is determined. The locus data “0” to “H” correspond to the respective steering angles.
- a total number of locus data amounts to “81” pieces.
- Each of the locus data “0” to “H” is arranged by an “initial adjusting amount”, an “individual adjusting amount”, and “display data”.
- the initial adjusting amount has been previously set.
- the individual adjusting amount is set after the on-vehicle camera has been installed.
- the display data corresponds to image data used to display a locus. Since the individual adjusting amounts are stored as data, a display position can be adjusted with respect to each of the steering angles.
- the locus data set selecting unit 42 selects the optimum data set from the plurality of locus data sets which have been previously prepared.
- the selection of this locus data set is carried out as follows: That is, for instance, as shown in FIG. 3 , a target plate 31 for selecting a locus data set is installed in such a manner that this target plate 31 is located at a position separated from the vehicle 1 by a constant distance along the backward direction and is positioned parallel to a rear wheel shift of the vehicle 1 , and then, since a picture of this locus data set selecting target plate 31 displayed on the monitor screen is viewed, this locus data set is selected.
- locus data sets are prepared, i.e., (1) in the case that there is no shift in the roll angle; (2) in the case that the roll angle is shifted by a constant angle along a left direction; and in the case that the roll angle is shifted by a constant angle along a right direction.
- Such data are prepared by calculating positions where the locus data set selecting target plate 31 is displayed in the picture of the on-vehicle camera 2 in response to the respective shifts of the roll angle. It should be noted that these data have been previously recorded in the data table 46.
- selection buttons 51 (numeral indications) are provided on the locus data set selecting unit 42 , which correspond to the locus data sets, for example, as shown in FIG. 4 .
- the locus data set selecting unit 42 senses that this selection button 51 is pushed, and then, notifies to the locus data selecting unit 43 , both such a fact that this detection implies a selection of a locus data set, and the number of the locus data set corresponding to this pushed selection button 51 .
- the locus data selecting unit 43 reads out reference data as to the locus data set corresponding to the depressed selection button 51 from the data table 46 in accordance with this notification content, and enters display data contained in this read reference data into the locus superimposing unit 45 . At the same time, the locus data selecting unit 43 reads out both an initial adjusting amount and an individual adjusting amount, which are contained in the reference data, and then, inputs the initial adjusting amount and the individual adjusting amount to the display position adjusting unit 44 . It should also be understood that although initial adjusting amounts of reference data have been previously set, individual adjusting amounts thereof are not set. When a locus data set is selected, since an individual adjusting amount is not required, this individual adjusting amount may be alternatively omitted.
- the display position adjusting unit 44 owns a joystick corresponding to one of pointing devices, and calculates a display position based upon an operation result of this joystick and the various sorts of adjusting amounts derived from the locus data selecting unit 43 , and then, applies this calculation result to the locus superimposing unit 45 .
- the display position is calculated in such a manner that the respective adjusting amounts notified from the locus data selecting unit 43 are employed as initial values, move amounts of the joystick are sequentially added to the initial values.
- the locus superimposing unit 45 superimposes the display data entered from the locus data selecting unit 43 on the picture of the on-vehicle camera 2 in such a manner that the display data is moved by such an adjusting amount notified from the display position adjusting unit 44 .
- a resultant superimposed image is displayed on the screen of the on-vehicle monitor 5 .
- a reference shape of any one of such locus data sets “1” through “3” as shown in FIG. 5 is superimposed on the picture of the on-vehicle camera 2 , and then, the superimposed picture is displayed on the on-vehicle monitor 5 .
- a reference shape of the locus data set “1” (namely, uppermost diagram) is superimposed on the picture of the on-vehicle camera 2 ; since the selection button 51 of the numeral “2” is pushed, a reference shape of the locus data set “2” (namely, center diagram) is superimposed on the picture of the on-vehicle camera 2 ; since the selection button 51 of the numeral “3” is pushed, a reference shape of the locus data set “3” (namely, lowermost diagram) is superimposed on the picture of the on-vehicle camera 2 .
- a locus data set corresponds to “1” in this drawing, the inclination of which is optimally made coincident with that of the locus data set selecting target plate 31 within the picture of the on-vehicle camera 5 among these reference shapes.
- the locus data selecting unit 43 changes a selected set number contained in the data table 46 into the presently selected data set number, namely “1”. With execution of the above-described operation, the optimum locus data set is selected with respect to the mounting position of the on-vehicle camera 2 .
- a setting operation of an individual adjusting amount with respect to the selected locus data set is carried out.
- a plurality of selection buttons (defined as “ 51 A” in this embodiment) similar to, for example, the selection buttons indicated in FIG. 4 are provided in the individual adjusting amount setting unit 41 .
- These selection buttons 51 A correspond to marker (reference marker) positions which constitute references of adjustments.
- the individual adjusting amount setting unit 41 senses this switch depression, and notifies both such a fact that this switch depression is to set the individual adjusting amount and the number of the reference marker corresponding to this depressed selection button 51 A to the locus data selecting unit 43 .
- the locus data selecting unit 43 reads out data (marker data) of the reference marker corresponding to this notification content, and the, inputs the read marker data to the locus superimposing unit 45 . At the same time, the locus data selecting unit 43 reads out an initial adjusting amount contained in the marker data, and then, notifies the read initial adjusting amount to the display position adjusting unit 44 . It should also be noted that as the marker, for instance, as shown in FIG.
- markers 32 , 33 , 34 are set at positions which are separated from a vehicle on a predicted locus by a constant distance so as to be used, the marker 32 is set on a locus of a right direction during a maximum steering angle; the marker 33 is set on a locus during a straight driving operation; and the marker 34 is set on a locus of a left direction during a maximum steering angle.
- the display position adjusting unit 44 calculates a display position based upon both the operation result of the joystick and the initial adjusting amount supplied from the locus data selecting unit 43 , and then, notifies the calculation result to the locus superimposing unit 45 .
- the locus superimposing unit 45 superimposes the display data entered from the locus data selecting unit 43 on the picture of the on-vehicle camera 2 in such a manner that this display data is moved by the adjusting amount notified from the display position adjusting unit 44 .
- the superimposed image is displayed on the screen of the on-vehicle monitor 5 .
- any one of such markers “1” to “3” as represented in FIG. 6 is superimposed on the picture of the on-vehicle camera 2 , and then, the superimposed image is displayed on the on-vehicle monitor 5 .
- a display position of this marker is adjusted by employing the joystick of the display position adjusting unit 44 in such a manner that this display position is optimally made coincident with the marker within the picture of the on-vehicle camera 2 , and after the position adjusting operation, an ascertain button (defined as “ 54 A”) of the individual adjusting amount setting unit 41 is depressed.
- an ascertain button defined as “ 54 A”
- this button depression is notified to the locus data selecting unit 43 , and the locus data selecting unit 43 temporarily records the adjusting amount with respect to this marker.
- the locus data selecting unit 43 calculates an adjusting amount of each of steering angles from the ascertained adjusting amount with respect to each of the markers, and then, sets the calculated adjusting amounts as the individual adjusting amount data contained in the data table 46 .
- the optimum adjusting amount can be set every steering angle. It should also be noted that since adjusting amounts of other steering angles are calculated from an adjusting amount of a typical steering angle, the optimum adjusting amounts may be alternatively set in a simple manner while the adjusting operation of the display positions are not carried out with respect to all of the steering angles. It should also be understood that the setting method of the adjusting amounts of the respective steering angles is not limited only to this setting method, but may be alternatively changed, for instance, positioning operations may be actually carried out with respect to all of the steering angles, or the same adjusting amount may be set to steering angles present in a constant range.
- the locus data selecting unit 43 reads out such a locus data corresponding to the angle sensed by the steering sensor from the relevant data set in accordance with the selected set number of the data table 46 . Thereafter, the locus data selecting unit 43 notifies both an initial adjusting amount and an individual adjusting amount contained in the locus data to the display position adjusting unit 44 , and notifies the display data to the locus superimposing unit 45 .
- the display position adjusting unit 44 calculates a final adjusting amount based upon both the initial adjusting amount and the individual adjusting amount, which are entered from the locus data selecting unit 43 , and then, notifies this calculation result to the locus superimposing unit 45 .
- the locus superimposing unit 45 changes both the adjusting amount of the display position entered from the display position adjusting unit 44 and the display data entered from the locus data selecting unit 43 into the latest adjusting amounts thereof during a vertical blanking period which constitutes a transition of frames of the picture of the on-vehicle camera 2 , and continuously superimposes a locus on the picture of the on-vehicle camera 2 based upon the latest locus data.
- the display data entered from the locus data selecting unit 43 need not be the display data itself, but may be alternatively realized as an address used to refer to the display data contained in the data table 46 .
- the display data entered from the locus data selecting unit 43 need not be the display data itself, but may be alternatively realized as an address used to refer to the display data contained in the data table 46 .
- the locus superimposing unit 45 confirms both the display data and the display position adjusting amounts before displaying the frame and precisely adjusts the display position of the locus based upon the latest data, the previously prepared locus can be displayed at the optimum position. As a result, the precision as the guide of the locus can be improved.
- a method of using an initial adjusting amount will now be explained with employment of FIG. 7 and FIG. 8 .
- the display position is moved in such a manner that an entire portion of the locus is displayed within the screen.
- the locus data is set as display data, or a move amount required so as to display the locus data on an original display position is set as an initial adjusting amount.
- the locus data selecting unit 43 calculates the original display position based upon this initial adjusting amount, and inputs such a position which has been moved from the original display position by the individual adjusting amount to the locus superimposing unit 45 .
- the locus can be displayed up to the edges of the screen irrespective of the adjusting amounts of the display positions with respect to all of the locus data, while the exceptional process operation for recording the display positions outside the screen is no longer required.
- the data sets which are previously prepared.
- a plurality of locus data either the roll angles or the pan angles of which are different from each other, are prepared.
- 3 variables of a tilt angle, a pan angle, and a roll angle are unknown, which constitute the external parameters of the on-vehicle camera 2 .
- an adverse influence caused by a shift of pan angles, or a shift of roll angles appears as a rotation as indicated in FIG. 9 on the screen, and thus, these pan angles and roll angles may be substituted by any one of rotation angles.
- FIG. 9 indicates display positions of predicted loci on the screen in such a case that a predicted locus when a steering wheel is steered at the same angles along right and left directions, and also, another predicted locus when the vehicle is driven along a straight direction are acquired by a proper on-vehicle camera. While three sets of the loci are displayed, this drawing represents a locus which is rolled at a constant angle, a locus which is panned at a constant angle, and such a locus that the locus rolled at the constant angle has been moved in a parallel manner in such a manner that the display position of the locus rolled at the constant angle is made coincident with the display position of the locus panned at the constant angle as much as possible. Since an adverse influence caused by a shift of tilt angles appears as a parallel move on the screen, this adverse influence may be substantially eliminated by adjusting the display position.
- the locus data set may be alternatively selected by employing another method such as a positional shift of a marker. In such a case that the locus data set is not required to be selected, the locus data set selecting unit 42 is no longer provided in the data setting unit 40 .
- the present invention has such an advantage that the travel predicted locus which has been previously prepared can be continuously displayed on the optimum position, and the precision as the guide of the travel predicted locus can be improved, and is useful when the present invention is employed in the vehicles such as automobiles.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
- Traffic Control Systems (AREA)
- Navigation (AREA)
Abstract
Description
D(Θ)=DM1·Θ/ΘL+DM2·(ΘL−Θ)/ΘL (when Θ<0),
D(Θ)=DM2 (when Θ<0),
D(Θ)=DM3·Θ/ΘR+DM2·(ΘR−Θ)/ΘR (when Θ<0),
Claims (4)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003-288976 | 2003-08-07 | ||
JP2003288976A JP3916240B2 (en) | 2003-08-07 | 2003-08-07 | Driving support device and driving support method |
PCT/JP2004/002478 WO2005014341A1 (en) | 2003-08-07 | 2004-03-01 | Operation assisting system and operation assisting method |
Publications (2)
Publication Number | Publication Date |
---|---|
US20060209188A1 US20060209188A1 (en) | 2006-09-21 |
US7756618B2 true US7756618B2 (en) | 2010-07-13 |
Family
ID=34131537
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/566,104 Active 2025-01-28 US7756618B2 (en) | 2003-08-07 | 2004-01-03 | Camera calibration and image adjusting for drive assisting system |
Country Status (6)
Country | Link |
---|---|
US (1) | US7756618B2 (en) |
EP (1) | EP1652734B1 (en) |
JP (1) | JP3916240B2 (en) |
KR (1) | KR20060060005A (en) |
CN (1) | CN100488813C (en) |
WO (1) | WO2005014341A1 (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100245592A1 (en) * | 2009-03-31 | 2010-09-30 | Aisin Seiki Kabushiki Kaisha | Calibrating apparatus for on-board camera of vehicle |
US20100245575A1 (en) * | 2009-03-27 | 2010-09-30 | Aisin Aw Co., Ltd. | Driving support device, driving support method, and driving support program |
US20110102583A1 (en) * | 2009-10-30 | 2011-05-05 | Kim Kinzalow | Rear view camera system and calibration method |
CN107499234A (en) * | 2017-07-06 | 2017-12-22 | 吉利汽车研究院(宁波)有限公司 | A kind of vehicle blind zone view device and method |
US20180356832A1 (en) * | 2017-06-09 | 2018-12-13 | Andreas Stihl Ag & Co. Kg | Method for Identifying at Least One Section of a Boundary Edge of an Area to Be Treated, Method for Operating an Autonomous Mobile Green Area Maintenance Robot, Identifying System and Green Area Maintenance System |
US11713048B2 (en) | 2017-05-08 | 2023-08-01 | Joyson Safety Systems Acquisition Llc | Integration of occupant monitoring systems with vehicle control systems |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4924896B2 (en) * | 2007-07-05 | 2012-04-25 | アイシン精機株式会社 | Vehicle periphery monitoring device |
JP4521642B2 (en) * | 2008-02-13 | 2010-08-11 | 本田技研工業株式会社 | Vehicle periphery monitoring device, vehicle, vehicle periphery monitoring program |
JP4900326B2 (en) * | 2008-06-10 | 2012-03-21 | 日産自動車株式会社 | Parking assistance device and parking assistance method |
US8340870B2 (en) * | 2008-09-16 | 2012-12-25 | Honda Motor Co., Ltd. | Vehicle maneuver assistance device |
JP5446304B2 (en) * | 2009-02-13 | 2014-03-19 | セイコーエプソン株式会社 | Liquid ejecting apparatus and liquid ejecting method |
CN102473353B (en) * | 2009-07-22 | 2014-02-26 | 丰田自动车株式会社 | Driving support device |
DE102009040255A1 (en) * | 2009-09-04 | 2011-03-10 | Volkswagen Ag | A method of displaying scrolling information and apparatus therefor |
CN101814246A (en) * | 2010-04-16 | 2010-08-25 | 上海交通大学 | Vehicle position azimuth digital display unit |
EP2614997B1 (en) * | 2010-09-06 | 2018-02-28 | Aisin Seiki Kabushiki Kaisha | Driving assist apparatus |
KR20120106033A (en) * | 2011-03-17 | 2012-09-26 | 현대모비스 주식회사 | Apparatus for providing backward driving support line using vehicle information and method thereof |
JP5888087B2 (en) * | 2012-04-25 | 2016-03-16 | ソニー株式会社 | Driving support image generation device, driving support image generation method, in-vehicle camera, and device operation support image generation device |
TWI558588B (en) * | 2014-04-09 | 2016-11-21 | Papago Inc | Driving Recorder with Correcting Shooting Pose and Its Correction |
KR102258628B1 (en) * | 2014-11-03 | 2021-06-02 | 현대모비스 주식회사 | Method for adjusting parking guide |
CN104374391B (en) * | 2014-11-17 | 2018-12-28 | 深圳市中天安驰有限责任公司 | A kind of vehicle driving trace computing system and calculation method |
CN104778851B (en) * | 2015-02-16 | 2017-05-03 | 北京交通大学 | Traveling-track-based ecological driving optimization method and system |
CN105128935A (en) * | 2015-08-31 | 2015-12-09 | 梁世彦 | Steering angle measuring instrument and method |
CN105824592A (en) * | 2016-03-07 | 2016-08-03 | 乐卡汽车智能科技(北京)有限公司 | Reversing trajectory display method and device |
CN106043126A (en) * | 2016-07-28 | 2016-10-26 | 江苏罗思韦尔电气有限公司 | Heavy truck steering early warning auxiliary device and early warning method |
CN110996091B (en) * | 2019-12-26 | 2021-10-08 | 斑马网络技术有限公司 | Method and device for superimposing information on display image of mobile device |
DE102021129085B3 (en) * | 2021-11-09 | 2023-02-02 | Dr. Ing. H.C. F. Porsche Aktiengesellschaft | Method for generating a model for the automated prediction of interactions of a user with a user interface of a motor vehicle, also data processing unit for a motor vehicle and motor vehicle |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5588733A (en) * | 1995-01-17 | 1996-12-31 | Honda Giken Kogyo Kabushiki Kaisha | Head lamp device for vehicle |
JP2610146B2 (en) | 1987-12-04 | 1997-05-14 | 本田技研工業株式会社 | Vehicle rear view display device |
JPH1116097A (en) | 1997-06-25 | 1999-01-22 | Fuji Heavy Ind Ltd | Operation supporting device for vehicle |
JP2000229547A (en) | 1998-10-08 | 2000-08-22 | Matsushita Electric Ind Co Ltd | Drive operation assisting device and recording medium |
EP1094668A2 (en) | 1999-10-19 | 2001-04-25 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Image positional relation correction apparatus, steering supporting apparatus provided with the image positional relation correction apparatus, and image positional relation correction method |
EP1102226A2 (en) | 1999-10-27 | 2001-05-23 | Fujitsu Ten Limited | Vehicle driving support system, and steering angle detection device |
US20010026317A1 (en) | 2000-02-29 | 2001-10-04 | Toshiaki Kakinami | Assistant apparatus and method for a vehicle in reverse motion |
US20010026371A1 (en) | 2000-03-28 | 2001-10-04 | Iwao Nozaki | Digital photo processing apparatus and printing data recording method |
EP1170172A2 (en) | 2000-07-03 | 2002-01-09 | Toyota Jidosha Kabushiki Kaisha | Apparatus for displaying rear view from moving body and method of displaying the rear view |
US6421081B1 (en) * | 1999-01-07 | 2002-07-16 | Bernard Markus | Real time video rear and side viewing device for vehicles void of rear and quarter windows |
KR20020066214A (en) | 2001-02-09 | 2002-08-14 | 마쯔시다덴기산교 가부시키가이샤 | Picture synthesizing apparatus |
US6487481B2 (en) * | 2000-05-30 | 2002-11-26 | Aisin Seiki Kabushiki Kaisha | Parking assisting apparatus |
JP2003061085A (en) | 2001-08-10 | 2003-02-28 | Nippon Seiki Co Ltd | Vehicle-user supervisory device |
EP1288071A2 (en) | 2001-08-24 | 2003-03-05 | Aisin Seiki Kabushiki Kaisha | Parking assist system |
US20030045973A1 (en) | 2001-09-06 | 2003-03-06 | Yazaki Corporation | Motor vehicle parking support unit and method thereof |
US6813371B2 (en) * | 1999-12-24 | 2004-11-02 | Aisin Seiki Kabushiki Kaisha | On-vehicle camera calibration device |
US6919822B2 (en) * | 2002-01-23 | 2005-07-19 | Aisin Seiki Kabushiki Kaisha | Parking assist device and method for assisting parking |
-
2003
- 2003-08-07 JP JP2003288976A patent/JP3916240B2/en not_active Expired - Lifetime
-
2004
- 2004-01-03 US US10/566,104 patent/US7756618B2/en active Active
- 2004-03-01 EP EP04716018A patent/EP1652734B1/en not_active Expired - Lifetime
- 2004-03-01 CN CNB2004800290691A patent/CN100488813C/en not_active Expired - Lifetime
- 2004-03-01 WO PCT/JP2004/002478 patent/WO2005014341A1/en active Application Filing
- 2004-03-01 KR KR1020067002633A patent/KR20060060005A/en not_active Application Discontinuation
Patent Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2610146B2 (en) | 1987-12-04 | 1997-05-14 | 本田技研工業株式会社 | Vehicle rear view display device |
US5588733A (en) * | 1995-01-17 | 1996-12-31 | Honda Giken Kogyo Kabushiki Kaisha | Head lamp device for vehicle |
JPH1116097A (en) | 1997-06-25 | 1999-01-22 | Fuji Heavy Ind Ltd | Operation supporting device for vehicle |
JP2000229547A (en) | 1998-10-08 | 2000-08-22 | Matsushita Electric Ind Co Ltd | Drive operation assisting device and recording medium |
US6421081B1 (en) * | 1999-01-07 | 2002-07-16 | Bernard Markus | Real time video rear and side viewing device for vehicles void of rear and quarter windows |
EP1094668A2 (en) | 1999-10-19 | 2001-04-25 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Image positional relation correction apparatus, steering supporting apparatus provided with the image positional relation correction apparatus, and image positional relation correction method |
JP2001187552A (en) | 1999-10-19 | 2001-07-10 | Toyota Autom Loom Works Ltd | Image position relationship correction device, steering support system provided with it and image position relationship correction method |
US6785404B1 (en) * | 1999-10-19 | 2004-08-31 | Kabushiki Kaisha Toyoda Jidoshokki Seisakusho | Image positional relation correction apparatus, steering supporting apparatus provided with the image positional relation correction apparatus, and image positional relation correction method |
EP1102226A2 (en) | 1999-10-27 | 2001-05-23 | Fujitsu Ten Limited | Vehicle driving support system, and steering angle detection device |
US6567726B2 (en) * | 1999-10-27 | 2003-05-20 | Fujitsu Ten Limited | Vehicle driving support system, and steering angle detection device |
US6813371B2 (en) * | 1999-12-24 | 2004-11-02 | Aisin Seiki Kabushiki Kaisha | On-vehicle camera calibration device |
US20010026317A1 (en) | 2000-02-29 | 2001-10-04 | Toshiaki Kakinami | Assistant apparatus and method for a vehicle in reverse motion |
US6476730B2 (en) * | 2000-02-29 | 2002-11-05 | Aisin Seiki Kabushiki Kaisha | Assistant apparatus and method for a vehicle in reverse motion |
US20010026371A1 (en) | 2000-03-28 | 2001-10-04 | Iwao Nozaki | Digital photo processing apparatus and printing data recording method |
US6487481B2 (en) * | 2000-05-30 | 2002-11-26 | Aisin Seiki Kabushiki Kaisha | Parking assisting apparatus |
EP1170172A2 (en) | 2000-07-03 | 2002-01-09 | Toyota Jidosha Kabushiki Kaisha | Apparatus for displaying rear view from moving body and method of displaying the rear view |
JP2002019492A (en) | 2000-07-03 | 2002-01-23 | Toyota Motor Corp | Rear field of vision display device of moving body |
KR20020066214A (en) | 2001-02-09 | 2002-08-14 | 마쯔시다덴기산교 가부시키가이샤 | Picture synthesizing apparatus |
US20020110262A1 (en) | 2001-02-09 | 2002-08-15 | Matsushita Electric Industrial Co., Ltd | Picture synthesizing apparatus |
US7058207B2 (en) | 2001-02-09 | 2006-06-06 | Matsushita Electric Industrial Co. Ltd. | Picture synthesizing apparatus |
JP2003061085A (en) | 2001-08-10 | 2003-02-28 | Nippon Seiki Co Ltd | Vehicle-user supervisory device |
JP2003063336A (en) | 2001-08-24 | 2003-03-05 | Aisin Seiki Co Ltd | Parking supporting device |
US20030058337A1 (en) | 2001-08-24 | 2003-03-27 | Yuu Tanaka | Parking assist system |
EP1288071A2 (en) | 2001-08-24 | 2003-03-05 | Aisin Seiki Kabushiki Kaisha | Parking assist system |
US20030045973A1 (en) | 2001-09-06 | 2003-03-06 | Yazaki Corporation | Motor vehicle parking support unit and method thereof |
US6587760B2 (en) * | 2001-09-06 | 2003-07-01 | Yazaki Corporation | Motor vehicle parking support unit and method thereof |
US6919822B2 (en) * | 2002-01-23 | 2005-07-19 | Aisin Seiki Kabushiki Kaisha | Parking assist device and method for assisting parking |
Non-Patent Citations (1)
Title |
---|
Chinese Office Action, Dec. 7, 2007. Including English translation. |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100245575A1 (en) * | 2009-03-27 | 2010-09-30 | Aisin Aw Co., Ltd. | Driving support device, driving support method, and driving support program |
US8675070B2 (en) * | 2009-03-27 | 2014-03-18 | Aisin Aw Co., Ltd | Driving support device, driving support method, and driving support program |
US20100245592A1 (en) * | 2009-03-31 | 2010-09-30 | Aisin Seiki Kabushiki Kaisha | Calibrating apparatus for on-board camera of vehicle |
US8248471B2 (en) * | 2009-03-31 | 2012-08-21 | Aisin Seiki Kabushiki Kaisha | Calibrating apparatus for on-board camera of vehicle |
US20110102583A1 (en) * | 2009-10-30 | 2011-05-05 | Kim Kinzalow | Rear view camera system and calibration method |
US11713048B2 (en) | 2017-05-08 | 2023-08-01 | Joyson Safety Systems Acquisition Llc | Integration of occupant monitoring systems with vehicle control systems |
US20180356832A1 (en) * | 2017-06-09 | 2018-12-13 | Andreas Stihl Ag & Co. Kg | Method for Identifying at Least One Section of a Boundary Edge of an Area to Be Treated, Method for Operating an Autonomous Mobile Green Area Maintenance Robot, Identifying System and Green Area Maintenance System |
US10809740B2 (en) * | 2017-06-09 | 2020-10-20 | Andreas Stihl Ag & Co. Kg | Method for identifying at least one section of a boundary edge of an area to be treated, method for operating an autonomous mobile green area maintenance robot, identifying system and green area maintenance system |
CN107499234A (en) * | 2017-07-06 | 2017-12-22 | 吉利汽车研究院(宁波)有限公司 | A kind of vehicle blind zone view device and method |
Also Published As
Publication number | Publication date |
---|---|
EP1652734B1 (en) | 2012-07-04 |
CN1863694A (en) | 2006-11-15 |
EP1652734A1 (en) | 2006-05-03 |
WO2005014341A1 (en) | 2005-02-17 |
JP2005056320A (en) | 2005-03-03 |
US20060209188A1 (en) | 2006-09-21 |
EP1652734A4 (en) | 2007-05-16 |
CN100488813C (en) | 2009-05-20 |
KR20060060005A (en) | 2006-06-02 |
JP3916240B2 (en) | 2007-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7756618B2 (en) | Camera calibration and image adjusting for drive assisting system | |
US8077202B2 (en) | Driving-operation assist and recording medium | |
JP4861034B2 (en) | Car camera calibration system | |
US8346071B2 (en) | Camera system and method of correcting camera fitting errors | |
US7557691B2 (en) | Obstacle detector for vehicle | |
US7098997B2 (en) | Surveying system | |
US20010006554A1 (en) | On-vehicle camera calibration device | |
EP1168846A1 (en) | Vicinity display for car | |
JPH04313199A (en) | Distance between cars detector | |
JP2005106505A (en) | Detector and method for detecting corresponding points between images | |
JPH09133525A (en) | Distance measuring device | |
JP2007181129A (en) | Vehicle-mounted movable body detection instrument | |
US5381173A (en) | Inter-car distance detecting device for tracking a car running ahead | |
JPH08334681A (en) | Range finder | |
JP2644092B2 (en) | Automotive location equipment | |
JP4713033B2 (en) | Vehicle surrounding environment display device | |
EP0498416B1 (en) | Inter-car distance detecting device | |
JP2006117107A (en) | Periphery monitoring device for vehicle | |
JP2560147B2 (en) | Inter-vehicle distance detector | |
EP0529558B1 (en) | Inter-car distance detecting device | |
JPH04262500A (en) | Inter-vehicle distance detector | |
JPH04262499A (en) | Inter-vehicle distance detector | |
JPH06109467A (en) | Distance detector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MIZUSAWA, KAZUFUMI;REEL/FRAME:018210/0843 Effective date: 20051228 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0588 Effective date: 20081001 Owner name: PANASONIC CORPORATION,JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021897/0588 Effective date: 20081001 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552) Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |
|
AS | Assignment |
Owner name: PANASONIC HOLDINGS CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:066644/0558 Effective date: 20220401 |
|
AS | Assignment |
Owner name: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC HOLDINGS CORPORATION;REEL/FRAME:066703/0278 Effective date: 20240228 |